Find answers from the community

Updated 2 months ago

Embedding token count when upserting nodes in pinecone

At a glance

Hi there, I'm getting errors with regards to embedding token count when upserting nodes in Pinecone.

Can anyone give me info as to how the token count for the Node object is counted? It looks like the metadata is counted towards the token count, my testing seems to confirm this

2 comments

LLogan M

It is, by default metadata is included in llm and embed model calls

You can exclude fields progamatically for each

https://docs.llamaindex.ai/en/stable/module_guides/loading/documents_and_nodes/usage_documents/#advanced-metadata-customization

eem

Thanks Logan

Add a reply