Find answers from the community

Updated 3 months ago

Latency

is there a tool which i can use to track indexing latency and get maximum stats while indexing

L
B
6 comments
Arize? Using time.time()
ageed but for something like Actually latency per embedding call comparing TGI Based Embedding to OpenAI one
working with TB of Data
Arize tracks each embedding call
Keep in mind embedding calls are typically batched though
Add a reply
Sign up and join the conversation on Discord