Find answers from the community

Updated 2 months ago

Chunking and Embedding Transformation

At a glance

The community member asks whether the nodegetcontent.metadata.embed part of the nodes is transformed into the embedding when using the default chunking settings. The comments indicate that this is correct by default, but the community members can configure excluded_llm_metadata_keys and excluded_embed_metadata_keys on the document/node to control what is included in the embedding.

Can i know when chunking using default setting, which part of the nodes are transformed into embedding ?

Is it the nodegetcontent.metadata.embed ?
L
V
4 comments
yea thats right
I kinda forgot is it using exclude rule ? If i added a random metadata to the node, will it get added to the embedding ?
by default yes. You can configure the exlcuded_llm_metadata_keys and excluded_embed_metadata_keys on the document/node to control and configure this
Add a reply
Sign up and join the conversation on Discord