Find answers from the community

Updated 8 months ago

I am having issues with instrumentation

I am having issues with instrumentation span handlers, not catching LLM calls to bedrock. What should I do?
L
s
8 comments
Probably the LLM classes should all have their chat, complete, etc. methods decorated with the @dispatcher.span decorator (this only matters for direct LLM calls I think though) -- I would think this effects any LLM though, not just bedrock
Yeah I just checked the code, and I concluded that as well. For some reason, it doesn't get caught as a span. But I can catch the events in the event handler...
Oh wait, I lied
Instrumentation is happening in the @llm_chat_callback and @llm_completion_callback decorators
So unless bedrock is missing those
i dont get it ahah
just using the dispatch handler for now, wait for a fix ;D
Add a reply
Sign up and join the conversation on Discord