LlamaIndex
Log in

Find answers from the community

Updated 2 months ago

Eval

VVish
·
Hey , does OpenAI agent work with evaluation modules? Wondering how one would evaluate agents without triggering memory, and if batch eval runner works with agents
L
V
4 comments
LLogan M
Hmm I think it would work fine? It would call the query of the agent, which overrides the chat history
LLogan M
https://github.com/run-llama/llama_index/blob/b24c79f417781cb19166ce5620e561f298c19385/llama_index/agent/types.py#L18
LLogan M
I have not tried though
VVish
Works
Add a reply
Sign up and join the conversation on Discord