Find answers from the community

N
Neza
Offline, last seen 3 months ago
Joined September 25, 2024
I am using RagEvaluatorPack to evaluate a RAG system I created using the EmbeddedTablesUnstructuredRetrieverPack :

rag_evaluator = RagEvaluatorPack( query_engine=query_engine, rag_dataset=rag_dataset, )

when I execute
benchmark_df = rag_evaluator.run()
althought I do get some metrics, I run into RuntimeError: Event loop is closed and the script stops

I found the error usually occurs because of Asynchronous jobs, but I am not sure

I'd appreciate your insight/ help if anyone has an idea
3 comments
L
N