Find answers from the community

Updated 3 months ago

I want to use llama-index in my company

I want to use llama-index in my company. But I am not able to find any documentation regarding 2 functionalities :
  1. Does it have something similar to chains present in Langchain
  2. Does it support streaming for custom LLM API end points
L
n
4 comments
Chains are just functions (kind of a useless abstraction in my mind, hot take? 🌢️ ). If you want to call an LLM or perform some function, you can just do that πŸ™‚ Was there something specific you wanted to do? We have a few features similar to chains for specific functions (most commonly generating structured output)

Depends on what you mean by "custom LLM". If it's an OpenAI-equivilant API, it's pretty easy to change the base url to point to it. Otherwise, you can implement the CustomLLM class
https://docs.llamaindex.ai/en/stable/module_guides/models/llms/usage_custom.html#example-using-a-custom-llm-model-advanced
  1. We mostly want to use chain like functionality for adding memory and conversarion flow.
  1. we have multiple LLMs hosted on our servers. The link that you shared would work for us , thanks!!
Thanks a lot!! Will give it a try
Add a reply
Sign up and join the conversation on Discord