Find answers from the community

Updated 3 months ago

LlamaIndex FastAPI

There are any plans from LlamaIndex to develop and provide support for a similar FastAPI like LangChain created https://blog.langchain.dev/introducing-langserve/ ?
A
j
6 comments
I'm new to this and try to figure out what library will be best to start with for long term
@Andrei two things:
1) we have a full-stack app template in the form of secinsights if you want to get started building an app on that: https://github.com/run-llama/sec-insights

2) privateGPT (using llamaindex) allows you to easily spin up a RAG pipeline in a fastapi server: https://github.com/imartinez/privateGPT
Thanks, good learning to start with. But what I mean is that LangChain will provide continuous updating and support on that FastAPI image with new features. I'm still new to this and try to understand what library is better. I like the multiple query methods from LlamaIndex, but don't have a full picture on long term where LlamaIndex will be compared with LangChain ?
if there's specific features on the fastapi image that you think would be useful let us know, right now my understanding is it's a relatively thin wrapper around their existing stuff.

right now we're a lot deeper into retrieval/queries/RAG. so if you want to build production RAG i'd vouch for our toolkit πŸ™‚

based on feedback like yours we might build something like this too if you think it helps with full-stack prototyping
SECInsights is a very nice release but is not modular for example to have a separate ingestion and use with a database ? instead of importing docs each time from an S3
How do you plan to support Multi-Agents, is that possible with LlamaIndex ? Any integration with Autogen ? Thanks
Add a reply
Sign up and join the conversation on Discord