Find answers from the community

Updated 2 weeks ago

Refreshing an Existing Vector Store

One question regarding refreshing an existing vector store.
As far as i can see the normal VectorStoreIndex allows to pass in the show_progress flag which shows the nice tqdm-like bar when generating the chunks.
I don't see such an option for the refresh_indexmethod. Is there a way to show progress there? Would especially be interesting to see how many chunks/what kinds of chunks are being modified/refreshed.
Currently i'm executing it like this and unfortunately i don't see any indication.

Plain Text
storage_context = StorageContext.from_defaults(persist_dir=storage_dir)
index: VectorStoreIndex = load_index_from_storage(storage_context=storage_context)
index.refresh_ref_docs(documents)
L
S
3 comments
hmmm yea no progress bar at the moment. Should be easy enough to add
How exactly? Would be cool if i can add it temporarily by just overwriting some files
In the refresh_ref_docs method, would just need to use tqdm and maybe also pass in a show_progress bool
Attachment
image.png
Add a reply
Sign up and join the conversation on Discord