Find answers from the community

Updated 3 months ago

is there a way i can use VLLM embedding

is there a way i can use VLLM embedding endpoint?
W
1 comment
Didnt find anything related to vLLM embedding in the docs. You can extend custom embedding class to point towrds your vllm embedding endpoint: https://docs.llamaindex.ai/en/stable/examples/embeddings/custom_embeddings/#custom-embeddings
Add a reply
Sign up and join the conversation on Discord