Find answers from the community

Updated 10 months ago

Hi All. I searched the documents and

Hi All. I searched the documents and found that there is no way to calculate time taken by each step in a RAG or Agent. So can you guide me how to calculate the time taken by each step such as retrieval, llm completion etc..

2 comments

WWhiteFang_Jr

You can add observability in your current project to get logs about each intermediate step: https://docs.llamaindex.ai/en/stable/module_guides/observability/observability.html

Arize seems to be the best one as per Logan But I think it is having some issue. You can try other till then. all of them tell about the time taken by each step.

LLogan M

Arize is fixed now 🙌 should work out of the box

Add a reply