Find answers from the community

Updated last year

So I want to ask for advice on 2 related

anjin · 2023-11-10T16:57:53.400Z

So I want to ask for advice on 2 related topics:If I have a corpus of many documents embedded in a vector store, how can I dynamically select (by metadata, for example) a subset of them and only perform retrieval on that subset for answer generation.I want LLaMa to be able to say I DO NOT KNOW if the context it retrieved cannot answer the question. This behavior is not stable yet from what I have seen.Thank you so much!

aanjin

So I want to ask for advice on 2 related topics:

If I have a corpus of many documents embedded in a vector store, how can I dynamically select (by metadata, for example) a subset of them and only perform retrieval on that subset for answer generation.

I want LLaMa to be able to say I DO NOT KNOW if the context it retrieved cannot answer the question. This behavior is not stable yet from what I have seen.

Thank you so much!

1 comment

TTeemu

You can use the metadata filters: https://docs.llamaindex.ai/en/stable/module_guides/indexing/vector_store_guide.html

This will mostly come down to prompting but less capable LLMs are prone to hallucinating for those types of questions

Add a reply