Find answers from the community

Updated 6 months ago

Evaluations

At a glance

The community member is inquiring about the continued recommendation of a previous article on building and evaluating a QA system with llama-index. They mention seeing newer additions like FaithfulnessEvaluator. The comments indicate that the abstractions have been modified, and the blog post will be updated soon. The community members discuss using llama-index's in-house evaluation module or something like TrueLens, and one member recommends using the in-house evaluation, depending on the specific evaluation needs.

Useful resources
Do you still recommend following this article for evaluation purposes? - https://blog.llamaindex.ai/building-and-evaluating-a-qa-system-with-llamaindex-3f02e9d87ce1
I see newer additions like FaithfulnessEvaluator etc.
r
r
3 comments
Yeah, the abstractions are modified. Will update the blog post soon with updated ones.
What do you recommend?
Using llama-index's in house evaluation module or something like TrueLens?
You can surely use inhouse evaluation. And also depends on what you are looking to evaluate.
Add a reply
Sign up and join the conversation on Discord