LlamaIndex
Log in

Find answers from the community

Updated 3 months ago

Nodes

aasti009asti
·
Hi, I have a couple of questions on nodes' metadata:

  1. is there a way to evaluate how different metadata variables affects the cosine similarity node scores? I was thinking of building a correlation matrix to evaluate this but if there's already something available, I would appreciate a hint.
  1. Can somebody please explain how LLM visible metadata works? Is it sent along with the query and contexts like a contexts = [[node1_text, node1_metadata], [node2_text, node2_metadata], etc ] ? I wonder how LLM decides on the 'weight' of metadata information provided to help improve the answer.
W
a
2 comments
WWhiteFang_Jr
  1. I think, there is no evaulation tool for metadata affect on node. but there is evaluation tool for analyzing retrieved nodes if that interests you: https://docs.llamaindex.ai/en/stable/understanding/evaluating/evaluating.html#retrieval-evaluation
  1. LLM sees it as text only and generate response based on the given context ( metadata + node text ) + query
aasti009asti
thanks a lot - much appreciated
Add a reply
Sign up and join the conversation on Discord