Find answers from the community

Updated 6 months ago

For Llamaindex Knowledge Graph

For Llamaindex Knowledge Graph Extractors (SimpleLLMPathExtractor), as I understand, each chunk text will be fetched into the LLM model to extract triplets. Then, will this LLM extractions of each chunk be independent from each other, or how do they know information regarding previous LLM calls (eg: how do they know about the other chunks and triplets from them)?
If the calls are independent, then how does LlamaIndex ensure that there are no duplicate nodes / relationships in the knowledge graph, and how to deal with some information that is across chunks?
L
p
3 comments
each chunk is independent

Currently there isn't a good strategy for duplicates, unless the have the exact same names (then they get merged together)
This is a well known problem with KGs, and there really isn't a good automatic solution either
Got it, thank you!
Add a reply
Sign up and join the conversation on Discord