Find answers from the community

Updated 2 months ago

Hello, I have a RAG application with

Hello, I have a RAG application with Hybrid Search (Vector similiarity + BM25 Keyword search) and RRF ranking.

My goal is to implement BGE similarity reranker.
Am I wondering if I rather implement BGE reranker after vector search and before hybrid search and RRF
OR
After RRF ? But it sounds counter productive, since I may overwrite the value brought by keyword search.
L
t
3 comments
I think reranking will probably work best after RRF. So vector + hybrid returns a lot of nodes, RRF, then rerank and return a smaller top k
optionally you could replace RRF with reranking
Thanks !

Yes indeed, if I do not sub sample the nodes after the RRF, no need to keep it, so I could replace it with reranking
Add a reply
Sign up and join the conversation on Discord