LlamaIndex
Log in

Find answers from the community

Updated 3 months ago

Also, one quick question : In the

AAbhay
·
Also, one quick question : In the document management with the ingestion pipeline section, when we insert a new document through the ingestion pipeline, does it bring in the entire docstore in memory to compare ?
L
2 comments
LLogan M
just the hashes
LLogan M
could be optimized more, but its not pulling in all the text

(if you are using the SimpleDocumentStore, its all in memory already though haha)
Add a reply
Sign up and join the conversation on Discord