Find answers from the community

Updated last year

Re-Indexing

Hello Guys. I'm facing a problem with profitability.

Let me explain in more detail. I have a document that LlamaIndex works with. The document is 200+ pages long.
At every slightest change in the file, the document is re-indexed. Is there any way to index only the part of the document that has been updated. And update part of the LlamaIndex indexes?

Because when re-indexing a document of 200+ pages, it hits my wallet hard....

6 comments

WWhiteFang_Jr

Yes there is

WWhiteFang_Jr

So your 200 pages are divided into chunks of Documents/nodes

WWhiteFang_Jr

You can update the part in which changes have occured using the doc_id associated with each document.

WWhiteFang_Jr

You can find more in here: https://docs.llamaindex.ai/en/stable/core_modules/data_modules/index/document_management.html

AAnoDy

thx

WWhiteFang_Jr

Re-Indexing

Add a reply