Find answers from the community

Updated 3 months ago

Hi all -- I'm building a RAG application

Hi all -- I'm building a RAG application with LlamaIndex and am trying to use DeepEval for testing. In particular, I'm working on faithfulness testing and am trying to figure out how to extract the context string for the retrieval_context parameter in DeepEval. I'm playing around with the no_text response synthesizer but am running into issues extracting an actual context string. I'm new to LLMs/RAG so any help would be appreciated, thanks!
r
2 comments
To perform faithfulness testing with DeepEval in your RAG application using LlamaIndex, you should not use the no_text response synthesizer, as it is designed to return an empty string and does not extract context strings.

Instead, you should use the FactualConsistencyEvaluator or a similar evaluator that can extract context strings from the responses generated by your model.
Add a reply
Sign up and join the conversation on Discord