LlamaIndex
Log in

Find answers from the community

Updated 2 months ago

Accessing endpoint models in serverless inference api

ddatadaba
·
I can see for the inference api which is serverless but let's say I want to access endpoint models how to do it .
W
L
d
4 comments
WWhiteFang_Jr
I believe this can help you: https://docs.llamaindex.ai/en/stable/examples/llm/huggingface/#using-hugging-face-text-generaton-inference
LLogan M
the inference api works for endpoint models too actually
ddatadaba
Thanks guys
ddatadaba
Thanks mate
Add a reply
Sign up and join the conversation on Discord