need help with BatchEvalRunner
i tried to follow this example:
https://docs.llamaindex.ai/en/stable/examples/evaluation/batch_eval/ this is my code
print("*** start evaluation")
faithfulness = FaithfulnessEvaluator(service_context=service_context)
relevancy = RelevancyEvaluator(service_context=service_context)
correctness = CorrectnessEvaluator(service_context=service_context,score_threshold=2.0 ,parser_function=eval_parser)
runner = BatchEvalRunner(
{ "faithfulness": faithfulness, "relevancy": relevancy},
workers=8, show_progress=True
)
engine = index.as_query_engine()
eval_results = await runner.aevaluate_queries( engine, queries=eval_questions.questions )
for some reason, i am getting the error below
Traceback (most recent call last):
File "/Users/ilanpinto/dev/ai/lightspeed-rag-content/.conda/lib/python3.11/site-packages/llama_index/core/evaluation/batch_runner.py", line 268, in aevaluate_responses
multi_kwargs = isinstance(next(iter(eval_kwargs_lists.values())), dict)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
StopIteration