Hi,

The community member is trying to use the new Instrumentation module in LlamaIndex, but is having difficulty adding a @dispatcher.span decorator to a generator function since the span ends as soon as a value is yielded. They have tried implementing their own custom span without the decorator, but the source code suggests there is extra logic added to the decorator for handling threads, and they are unsure if they need to rewrite those locks in their code.

The comments suggest that due to how decorators and generators work, it is not easily possible to make the two compatible with just a generator. The community members would need to call span_enter() and span_exit() on their own. One community member suggests that if they call span_enter()/span_exit(), they may also need to call with dispatcher.lock: dispatcher.set_current_spanid(id), but another community member says this is only necessary if they are doing stuff with async/threading to keep it async/thread safe.

The community member is using async/threads since it's part of an HTTP service and needs to support multiple concurrent requests. They have found a "hacky workaround" for the decorator which seems to work, by replacing