Find answers from the community

Updated 3 months ago

With instrumentation deprecated

With instrumentation deprecated callbacks what does this mean for the
Plain Text
CallbackManager
? For instance I use a callback manager to surface function calls made by agents as a query is being processed. How would I do this with the
Plain Text
BaseEventHandler
in the
Plain Text
llama_index.core.instrumentation.event_handlers
? Is a callback manager used at all when creating an index with callbacks being deprecated?
L
S
4 comments
callbacks/callback manager is still there. Instrumentation is a sort of parallel system being implemented to replace callbacks

its still sort of in-progress, but the idea is you create an event handler or span handler to hook into events/spans happening under the hood (or even adding your own events/spans)
It would be really helpful to see how these both can coexist in an example.
I guess is the BaseEventHandler uncovering everything, callbacks included, and then its just a matter of queuing this BaseEvent for all events even agent function calls?
In a sense yea. We are still expanding the types of payloads for events being logged, but yea

There is an example here
https://docs.llamaindex.ai/en/stable/examples/instrumentation/observe_api_calls/
Still a bit of a work in prgress, but the eventual idea is to have this replace the callback system
Add a reply
Sign up and join the conversation on Discord