The community member is facing an issue with profitability due to the need to re-index a 200+ page document every time there is a slight change. They are asking if there is a way to only index the part of the document that has been updated, and update part of the LlamaIndex indexes, as re-indexing the entire document is costly.
The comments indicate that there is a solution, where the 200 pages are divided into chunks or documents/nodes, and the community member can update only the part where changes have occurred, using the associated doc_id. The community members are directed to the LlamaIndex documentation for more information on document management.
Hello Guys. I'm facing a problem with profitability.
Let me explain in more detail. I have a document that LlamaIndex works with. The document is 200+ pages long. At every slightest change in the file, the document is re-indexed. Is there any way to index only the part of the document that has been updated. And update part of the LlamaIndex indexes?
Because when re-indexing a document of 200+ pages, it hits my wallet hard....
