Find answers from the community

Updated 2 months ago

Missing Spans in Langfuse

After integrating Langfuse with LlamaIndex, I noticed that certain steps did not have their own spans, notably the embedding of the user's question and the subsequent lookup of docs in Qdrant.

Is there a way to get these to show up? Am I missing a config or option somewhere?
v
L
9 comments
Span for the /query | query_docs handler that is missing the spans I expected
Attachment
Screenshot_2024-03-18_at_4.09.07_PM.png
If you aren't using the global handler option, you need to pass the callback manager into everything.

Notably I see it's not passed into the embedding model
Maybe try adding it there?
Is it correct to say the Settings.callback_manager is not applied as the default to the Settings.embed_model, while it is applied to the Settings.llm?
Got it working, thanks @Logan M
Attachment
Screenshot_2024-03-18_at_10.25.46_PM.png
The logic is kind of janky, but glad it works πŸ‘
yeah, janky is a good word for it, but there are times where one wants to get into the guts to see how things work and come together. This is partly, part of the learning process, but I also want to be able to share the documents used in producing an answer and certain parts of the metadata about them.

Is there any way to get the doc list & metadata used from the higher level APIs when making a query?
@Logan M would this be something I could also accomplish with QueryPipeline & Agents?
Add a reply
Sign up and join the conversation on Discord