First of all, thank you so much for your expert guidance. One of the common topics I see around is that the persisted docstores and indexstores improve performance when loading big knowledge bases, as when these not exist, the framework will have to regenerate them in memory from the vectorstore, as you clarified today on another thread:
You don't need to call persist() on most 3rd party vector stores
You can reload the index by doing
VectorStoreIndex.from_vector_store(vector_store, service_context=service_context)
For an application that will maybe have thousands of documents or entries, for maybe thousands of users, does it make sense to avoid the use of the docstore and indexstore? what is the criteria that I should have in mind to use them or not?
Lastly, when you say that most of the time users do not need this capability, when would be a right time to use it?
Once again, thanks for your amazing help and support