Find answers from the community

Updated 4 months ago

If I have multiple indexes to query

At a glance

The community member has multiple indexes in Pinecone, one for Notion and one for Google Drive, and wants to know if it's better to compose a graph or merge them into a single index. The other community members suggest that it would be ideal to insert both sets of vectors into the same index, rather than using separate namespaces, as the information in the two indexes is generally the same. They recommend using index.insert(document) to add the documents to the existing index.

If I have multiple indexes to query against is advisable to compose a graph or merge them into one index?
b
H
L
6 comments
can you say more about why you have multiple indices?
i have two integrations - one with notion, one with gdrive.

the vectors are stored in pinecone in the format team_id-notion team_id-gdrive in the same index.

I want to query both together, but whether they exist at the same time cannot be guarenteed, one may exist without the other
sorry - those are the pinecone namespaces
Is there specific information in one vs. the other?

Maybe the best approach is summarizing each index, and using that summary in a router retriever?
no, generally the two have the same kind of information in them
hmm, I would say ideally these both get inserted into the some index, rather than different namespaces/indexes πŸ€”

You can insert into an existing index with index.insert(document)
Add a reply
Sign up and join the conversation on Discord