Find answers from the community

Updated 3 months ago

Logan M i had the response streaming

i had the response streaming perfectly before i updated my code to stop using SimpleVectorStore and start using ChromaVectorStore. Is there an extra config?

4 comments

LLogan M

hmm, no there should be no extra config. Only the retrieval step changes when you switch vector dbs, the response synthesis component remains the same 🤔

FFran Piantoni

I must be missing something then... That's really weird. Response time improved a TON.

FFran Piantoni

From 60 seconds to maybe 4 Hahaah

LLogan M

for large indexes, that sounds about right. The default vector store is not optimized at all, just quickly gets you off the ground and trying things 🙂

Add a reply