Find answers from the community

Updated 9 months ago

I see something like `node.excluded_llm_

I see something like node.excluded_llm_metadata_keys = ["vector"] will work for that one node... but I wan to this to apply to all nodes coming from OS at all times. and I dotn want to blacklist like this, Id like to whitelist. Something like; forallnodes.included_llm_metadata_keys = None without the loop

8 comments

LLogan M

There is not whitelist, only a blacklist

Most vector stores are optimized for llama-index doing both the ingestion and retrieval (that way the nodes are serialized properly into the vector store)

For this usecase, the vector store might need a PR to specify the text field so that llama-index can at least create a textnode with the proper text when the serialized node is missing

eenoch

@Logan M - sorry just to make sure I understand - for this scenario there is no way to not have all the other OS index fields as metadata? I just have to loop through them all and remove it?

eenoch

And in addition, look into giving vector store a PR to support this case?

LLogan M

Yea, you'd have to loop and remove

eenoch

So something like:

Plain Text

for nodewithscore in nodeswithscores:
  nodewithscore.node.metadata = {}

After each retrieval?

LLogan M

Something like that should work yea

eenoch

I was doing this, but this doesnt work when setting up an "out of the box" chat-engine - have to set up the entire thing myself to keep this behavior seems like

eenoch

Currently using a quantized version of Mixtral 8x7b

Add a reply