Log in
Log into community
Find answers from the community
View all posts
Related posts
Did this answer your question?
๐
๐
๐
Powered by
Hall
Inactive
Updated 2 months ago
0
Follow
hello, is there a way method to retrieve
hello, is there a way method to retrieve
Inactive
0
Follow
g
galvangjx
4 months ago
ยท
hello, is there a way method to retrieve the output tokens of the response coming from a
query_engine
or do we have to calculate ourselves? I am using OpenAI LLMs
W
g
2 comments
Share
Open in Discord
W
WhiteFang_Jr
4 months ago
This might help you:
https://discord.com/channels/1059199217496772688/1260857471543808103/1260983791636189275
g
galvangjx
4 months ago
thanks for pointing me to that thread, I have read the documentation but it didn't mention anything about token counts. Had to nagivte through the documentation and some googling and found this
https://docs.llamaindex.ai/en/v0.10.23/examples/callbacks/TokenCountingHandler/
Add a reply
Sign up and join the conversation on Discord
Join on Discord