Find answers from the community

Updated last year

Text

node_embedding = embed_model.get_text_embedding(
        node.get_content(metadata_mode="all")
)

Does this code also embed the metdata in the resulting vector?

6 comments

LLogan M

Yea it does. Try printing the output of the get content function to see what it's putting in

BBaygon

I find it a bit weird that they recommend that in the RAG from scratch page. It would skew the vector space towards context irrelevant data. Shouldn’t it be better to embed only what is context relevant?

LLogan M

Usually people put helpful stuff in their metadata actually. I feel like in most cases it improves embeddings

BBaygon

source_doc for example, in most cases it wouldnt improve the embedding. Ideally one would want to only select the metadata fields that are relvant, not all. I'm building the node content manually because of that

LLogan M

You can set which metadata keys to include for both embeddings and for sending to the LLM

node.excluded_embed_metadata_keys = ["key1", ...]

LLogan M

node.excluded_llm_metadata_keys = ["key1", ...]

Add a reply