Log in
Log into community
Find answers from the community
View all posts
Related posts
Did this answer your question?
๐
๐
๐
Powered by
Hall
Inactive
Updated 2 months ago
0
Follow
hello @everyone i have doubt how to set
hello @everyone i have doubt how to set
Inactive
0
Follow
b
bidda7287
7 months ago
ยท
hello
@everyone
i have doubt how to set vllm server endpoints to Settings.llm , please help
W
1 comment
Share
Open in Discord
W
WhiteFang_Jr
7 months ago
You'll have to create vLLM instance and add it to Settings.
Settings.llm = vLLM instance here
https://docs.llamaindex.ai/en/stable/examples/llm/vllm/?h=vllm#completion-response
Add a reply
Sign up and join the conversation on Discord
Join on Discord