Hello,
any way to make a streaming-response with streamlit + llamaindex instead of let the user wait with the "Thinking..." spinner?

I found nothing. Just found option streaming=True. But am not sure if you can use this with streamlit

Hello,

do you have to use the chatgpt api just once to create a vector index file ?

Or has it to be done every time? because that would be expensive 😄

i am building chatbot with langchain and need some knoledge based on local documents instead of using the cloud

edit: i think yes you just generate it one time.
BUT do you upload/pass it every time (at every request/input of a user) to the ChatGPT API then?