Find answers from the community

Updated 2 months ago

hello, is there a way method to retrieve

hello, is there a way method to retrieve the output tokens of the response coming from a query_engine or do we have to calculate ourselves? I am using OpenAI LLMs
W
g
2 comments
thanks for pointing me to that thread, I have read the documentation but it didn't mention anything about token counts. Had to nagivte through the documentation and some googling and found this https://docs.llamaindex.ai/en/v0.10.23/examples/callbacks/TokenCountingHandler/
Add a reply
Sign up and join the conversation on Discord