Find answers from the community

Updated 2 months ago

Whats the average response time from a

Whats the average response time from a retriever? just trying to figure out if mines slow or not.

Plain Text

retreiver = index.as_retriever()

nodes = retreiver.retrieve('Whats a good healthy recipe?')

7 comments

Depends on if your embedding model is local or API based, and the size of the index

I'd say 1 second or less though. Unless your index is huge

(also depends which vector store you are using too)

Api based w pinecone db, 800 nodes in the index

Getting ~2 second response time

eh, for pinecone (serverless I'm guessing?) that might be about right

Yeah i think im happy with that

Add a reply