Log in
Log into community
Find answers from the community
View all posts
Related posts
Did this answer your question?
๐
๐
๐
Powered by
Hall
Inactive
Updated 2 months ago
0
Follow
Whats the average response time from a
Whats the average response time from a
Inactive
0
Follow
g
goldenfuze
7 months ago
ยท
Whats the average response time from a retriever? just trying to figure out if mines slow or not.
Plain Text
Copy
retreiver = index.as_retriever() nodes = retreiver.retrieve('Whats a good healthy recipe?')
L
g
7 comments
Share
Open in Discord
L
Logan M
7 months ago
Depends on if your embedding model is local or API based, and the size of the index
L
Logan M
7 months ago
I'd say 1 second or less though. Unless your index is huge
L
Logan M
7 months ago
(also depends which vector store you are using too)
g
goldenfuze
7 months ago
Api based w pinecone db, 800 nodes in the index
g
goldenfuze
7 months ago
Getting ~2 second response time
L
Logan M
7 months ago
eh, for pinecone (serverless I'm guessing?) that might be about right
g
goldenfuze
7 months ago
Yeah i think im happy with that
Add a reply
Sign up and join the conversation on Discord
Join on Discord