Find answers from the community

Updated 2 years ago

Streaming

im about to spend the next few hours of my friday eve working this out. i shall not rest. (ill have to set it all up with langchain and then try integreate the llama index (right?))
L
m
6 comments
I would say make sure streaming works with the plain index first, then try to figure out how that can connect to langchain lol
Streaming in llama index can be a little weird, since internally it can make many llm calls, changing its answer along the way

I think only the last answer is streamed
Id love to be able to contribute to llama index and i suppose that starts with understanding langchain properly 🫑
Sounds like a plan! 😎
this may be why sometimes it streamed the json string of the output with sources (like i wanted) and othertimes it just streamed the initial 'thoughts' and then stopped? that would make sense
but nice one thankyou
Add a reply
Sign up and join the conversation on Discord