Find answers from the community

Updated last year

Hello, is there any ways to get the "

At a glance

Hello, is there any ways to get the "total and last token usage" in SubQuestionQueryEngine? I added a callback token counter in service context and added into "SubQuestionQueryEngine.default(service_context=...)" but I'm not seeing the token counts. Thanks in advance.

2 comments

WWhiteFang_Jr

I think this can help you with token counting: https://docs.llamaindex.ai/en/stable/examples/callbacks/TokenCountingHandler.html#advanced-usage

LLogan M

You'll probably want to make sure the service context is passed into all sub-indexes that the query engine is using too

Add a reply