Find answers from the community

Updated 6 months ago

Is it possible to compare and evaluate

At a glance

The community member is curious about whether it is possible to compare and evaluate the performance of different retrievers, such as an ensemble retriever and a BM25 retriever. In the comments, another community member suggests two options: looking at the nodes that the retrievers are returning, and using llamaindex evaluators. However, there is no explicitly marked answer in the provided information.

Is it possible to compare and evaluate performance between retrievers?


For example, let's say I implemented an ensemble retriever and a BM25 retriever. And can you compare the performance of the two?

What I'm curious about is whether it is possible to compare and evaluate implemented retrievers.
L
1 comment
You've different options.
  1. By looking at the nodes that the retrievers are returning.
  2. By using llamaindex evaluators
Add a reply
Sign up and join the conversation on Discord