Find answers from the community

Home
Members
tianzhi4599
t
tianzhi4599
Offline, last seen 3 months ago
Joined September 25, 2024
I tried to use custom LLM API and embedding API (not via openai, or huggingface). I implemented custom LLM class and custom embedding class. However, when I tried to use it, I got ConnectionError, which is caused by tiktoken in ChatMemoryBuffer
15 comments
L
t
E
I am wondering may I use custom LLM/embedding API (deployed by myself) for underlying LLM/embedding in llamaindex?
2 comments
t
L