Hi jerryjliu98 9313 do we have a scope

The callback manager is essentially there is terms of scopes. Handles callbacks and provides traces to callbacks

The changes to it I foresee in the future is possibly adding more events to log and improving how tracing works

Anything you are thinking about or wanted to see?

https://github.com/jerryjliu/llama_index/issues/1107
Just like mentioned in this ticket, I am looking forward to get the prompt token and the completion token individually whereas now we are getting total token usages,

Ah yes, this is on my todo list 🙂 I want to move the token counting into a callback handler (hopefully)

Any ETA over this?

Hopefully sometime next week if I had to guess. Very open to PRs before I get to it though 🙏