LlamaIndex
Log in

Find answers from the community

Updated 3 months ago

Hi guys, might be silly question, but I

aantonal01
·
Hi guys, might be silly question, but I have instantiated a stream_chat but I dont know how to expose the result through an API, i know i need to somehow wait for the response but dont know how, anybody could help me? much appreciated, thanks!
W
a
10 comments
WWhiteFang_Jr
You can check SecInsights project, its a fastAPI backned passing stream to React framework: https://www.secinsights.ai/

This will help you to get an idea
WWhiteFang_Jr
Also small FastAPI example to show you how to stream: https://discord.com/channels/1059199217496772688/1234867465352384634/1234888443977400361
aantonal01
thank you very much! the second example is what I was looking for! secinsights seems that they dont use stream chat. thank you very muchhh once again!! ❤️
aantonal01
sorry, one last question, what is the list of chat messages (history) suppose to incude? I guess the message is when you "talk" with the chatbot.
Attachment
image.png
aantonal01
because I see a chat message can have only role and content?
WWhiteFang_Jr
This is an optional arg, basically if you want to pass any chat_history
WWhiteFang_Jr
It's a list of chats , having role as System, user, assistant in each object inside the list
aantonal01
so I don't need to pass any kind of previous messages?
WWhiteFang_Jr
Yeah, it's optional.
If you don't have the need you don't need to pass it
aantonal01
I can't pass history properly...do you see why? really sorry to spam you but can't find a solution online.
Attachment
image.png
Add a reply
Sign up and join the conversation on Discord