LlamaIndex
Log in

Find answers from the community

Updated 11 months ago

My Requirement is : When updating RAG,

AAmitKhandey
·
My Requirement is : When updating RAG, only generate embeddings for newly added documents rather than regenerating embeddings for all documents in chroma db using llamaindex.
W
A
L
4 comments
WWhiteFang_Jr
How are you currently adding new docs?
You can insert new docs using insert method that will only create embedding for the newly inserted docs.

Sample code would look like
Plain Text
docs = newly created documents

for doc in docs:
  index.insert(doc)
AAmitKhandey
Can I remove a doc ?
LLogan M
yes -- index.delete_ref_doc(ref_doc_id)
LLogan M
will delete all nodes associated with that ref doc id
Add a reply
Sign up and join the conversation on Discord