Find answers from the community

Updated 3 months ago

Whats the average response time from a

Whats the average response time from a retriever? just trying to figure out if mines slow or not.
Plain Text
retreiver = index.as_retriever()

nodes = retreiver.retrieve('Whats a good healthy recipe?')
L
g
7 comments
Depends on if your embedding model is local or API based, and the size of the index
I'd say 1 second or less though. Unless your index is huge
(also depends which vector store you are using too)
Api based w pinecone db, 800 nodes in the index
Getting ~2 second response time
eh, for pinecone (serverless I'm guessing?) that might be about right
Yeah i think im happy with that
Add a reply
Sign up and join the conversation on Discord