Find answers from the community

Updated 9 months ago

Rerank

ddrewskidang

how do i set bge or local model has reranker

4 comments

LLogan M

You can use the SentenceTransformerRerank class

pip install llama-index-postprocessor-sbert-rerank

Plain Text

from llama_index.postprocessor.sbert_rerank import SentenceTransformerRerank
postprocessor = SentenceTransformerRerank(
    model="<model name>", top_n=3
)

ddrewskidang

What does the transformation pipeline do exactly

LLogan M

it takes a list of nodes, compares their text to the query text using the model, re-ranks/re-oders them, and then returns the top-n

LLogan M

So I might set my top-k to 6, rerank, and return the top-n as 3

Add a reply