Find answers from the community

Updated 10 months ago

is it included in the embedding if I use

is it included in the embedding if I use the llm to embed it? , does it just append it to the node text before embedding the chunk+ title

5 comments

LLogan M

yes and yes

You can see more details here
https://docs.llamaindex.ai/en/stable/module_guides/loading/documents_and_nodes/usage_documents.html#advanced-metadata-customization

sshakedbuk

      let titleExtractor= new TitleExtractor({llm:azureOpenAillm})
      let nodes = await titleExtractor.transform(titleExtractedNodes)
      
      let nodesWithMetadata = []

      for(let node of nodes){
          nodesWithMetadata.push(node.getContent())
      }

sshakedbuk

when I use it like this I also get the "documentTitle:" part inside the vector, how to remove it?

sshakedbuk

node.getContent({metadataMode:'all'}) using this does not work

LLogan M

Losing me a bit with that code there.

In any case, each piece of metadata can be included or not included in embeddings. Use metadataMode "embed", and set node.excludedEmbedMetadataKeys =[..] to a list of keys to exclude

Add a reply