The community member is having issues with instrumentation span handlers not catching calls to the Bedrock LLM. The comments suggest that the LLM classes should have their methods decorated with the @dispatcher.span decorator, but this doesn't seem to be the issue. Another community member notes that instrumentation is happening in the @llm_chat_callback and @llm_completion_callback decorators, so the issue may be that Bedrock is missing those decorators. The community members are unable to determine the root cause of the problem and are currently using the dispatch handler as a workaround while waiting for a fix.
Probably the LLM classes should all have their chat, complete, etc. methods decorated with the @dispatcher.span decorator (this only matters for direct LLM calls I think though) -- I would think this effects any LLM though, not just bedrock
Yeah I just checked the code, and I concluded that as well. For some reason, it doesn't get caught as a span. But I can catch the events in the event handler...
