Find answers from the community

Updated 6 months ago

Open-Sourcing Rule-based Retrieval

At a glance

The community member posted a question about whether there is anything similar to rule-based/deterministic retrieval in LlamaIndex, as described in an article they saw. The comments suggest that LlamaIndex does support adding metadata to documents and then filtering by that metadata. One community member also mentioned the possibility of using an LLM to automatically select the appropriate filters based on the question. However, there is no explicitly marked answer in the comments.

Useful resources

PPujari12

Hi, I just saw this article - https://medium.com/enterprise-rag/open-sourcing-rule-based-retrieval-677946260973 which talks about rule-based/deterministically tell the model to use a particular chunk. Is there anything similar to this in llamaindex?

4 comments

TTeemu

Yeah you can do the same thing with Llamaindex

First you can add metadata: https://docs.llamaindex.ai/en/stable/understanding/loading/loading.html#adding-metadata

Then you can filter by it: https://docs.llamaindex.ai/en/stable/api/llama_index.core.vector_stores.MetadataFilters.html

PPujari12

lol, I thought it was something other than just metadata filtering. I think they have just added automatic filter selection according to the question.

vverdverm

you can probably do automatic filter selection by having a list and then asking an LLM which filters it should use when retrieving

ssansmoraxz

Tried that approach once. If you have a graph based implementation ensure you add backtracking as an option.

Add a reply