Find answers from the community

Updated 2 months ago

anyone know if it's possible to pass in

sshawtyisaten

anyone know if it's possible to pass in the metadata from the retrieved documents into context_str?

13 comments

LLogan M

its included by default actually

LLogan M

https://docs.llamaindex.ai/en/stable/module_guides/loading/documents_and_nodes/usage_documents.html#advanced-metadata-customization

sshawtyisaten

but doesn't context_str consist of retrieved_document.text?

sshawtyisaten

what i want to do is ''.join(retrieved_document.metadata.field_name for retrieved_document in retrieved_documents)

LLogan M

nope

LLogan M

Plain Text

from llama_index.schema import MetadataMode
print(document.get_content(metadata_mode=MetadataMode.LLM))

LLogan M

thats what gets sent to the LLM

LLogan M

read the link above, it shows how to customize this 👍

sshawtyisaten

ok thanks!

sshawtyisaten

another question: i've tried out observability tools like arize but it seems to be just showing the input and outputs. I'm wondering if there's a way to log what gets passed around in the response_synthesizer.

LLogan M

What are you looking to see exactly? The LLM inputs / outputs are what gets passed around in the response synthesizer 🤔

sshawtyisaten

yea so i'm seeing that correct documents are retrieved from pinecone but for some reason the response is not what i'm expecting. So I'd like to see if the correct context_str was passed into response_synthesizer:text_qa_template

LLogan M

Doesn't arize log the exact LLM input? That will contain the context_str

Add a reply