Find answers from the community

Updated 2 months ago

Hello, I have a RAG application with

Hello, I have a RAG application with Hybrid Search (Vector similiarity + BM25 Keyword search) and RRF ranking.

My goal is to implement BGE similarity reranker.
Am I wondering if I rather implement BGE reranker after vector search and before hybrid search and RRF
OR
After RRF ? But it sounds counter productive, since I may overwrite the value brought by keyword search.

3 comments

LLogan M

I think reranking will probably work best after RRF. So vector + hybrid returns a lot of nodes, RRF, then rerank and return a smaller top k

LLogan M

optionally you could replace RRF with reranking

ttarumi

Thanks !

Yes indeed, if I do not sub sample the nodes after the RRF, no need to keep it, so I could replace it with reranking

Add a reply