Find answers from the community

Updated 3 months ago

hello, is there a way method to retrieve

hello, is there a way method to retrieve the output tokens of the response coming from a query_engine or do we have to calculate ourselves? I am using OpenAI LLMs

2 comments

WWhiteFang_Jr

This might help you: https://discord.com/channels/1059199217496772688/1260857471543808103/1260983791636189275

ggalvangjx

thanks for pointing me to that thread, I have read the documentation but it didn't mention anything about token counts. Had to nagivte through the documentation and some googling and found this https://docs.llamaindex.ai/en/v0.10.23/examples/callbacks/TokenCountingHandler/

Add a reply