Find answers from the community

Home
Members
bidda7287
b
bidda7287
Offline, last seen 3 months ago
Joined September 25, 2024
How to use Auto merging retriever alongside vectordb
2 comments
k
How to use Auto merging retriever alongside chromadb
3 comments
k
how to set embeddings for each node
3 comments
k
i have some doubts
14 comments
k
b
Hello @everyone i have doubt in setting.llm my question is the setting.llm=huggingfaceLLM() is working fine but i'm using vllm OpenAI-Compatible Server to inference model while using setting.llm = OpenAI(api_key=openai_api_key, base_url=openai_api_base) is not working why? but endpoint is working fine only error in setting.llm = OpenAI(api_key=openai_api_key, base_url=openai_api_base)
1 comment
W
hello @everyone i have doubt how to set vllm server endpoints to Settings.llm , please help
1 comment
W
@kapa.ai why my model is generating two time i mean it refining the previous response
5 comments
k
b