the above works. but
by default, pine cone does not store text
I went through the implementation of pinecone add and query function in gpt-index, I see you are storing text in the metadata. (neat trick applied there for doing away from the manual effort of managing mapping for text) and on pinecone query you are fetching back the text of the top_k for forming theVectorStoreQueryResult. got this much.
But I have a few concerns
- in pinecone documentation it says we can have metadata upto 5 or 10kb (https://community.pinecone.io/t/metadata-size-limit-10kb-or-40kb/900)
- With more heavy metadata will there be any impact on search?