Find answers from the community

Updated 3 months ago

When using the SubQuestionQueryEngine I

When using the SubQuestionQueryEngine, I keep running into the issue of 'KeyError: 'comparison'. I have multiple documents as query engine tool and feed them in the query_engine_tools parameter in constructing the SubQuestionQueryENgine.

14 comments

LLogan M

seems like it's hallucinating the name of an index/query_engine_tool ?

What kinds of names did you use?

MMilkman

I just use the file name as teh tool name.

LLogan M

are the names super similar or confusing?

MMilkman

I'd say they are similar but not confusing

LLogan M

can you share them? Just wondering why it's hallucinating a name. Usually it helps to re-engineer the names, at least in my experience

MMilkman

XXX AUM May 2023.pdf, XXX AUM April 2023.pdf

LLogan M

huh, well, I guess the LLM is just being silly then haha

I feeeeeell like I encountered this last week, and then we changed the prompt to better avoid this. What llama-index version are you on?

MMilkman

I'm actually quite far behin on 0.6.30

MMilkman

Oh that's why sometimes it works sometimes it doesn't

LLogan M

oh wow, that is quite far behind 😅 Updating may... be a little painful lol

LLogan M

I can't even remember what's changed since then

LLogan M

feels like 0.6.30 was a lifetime ago

MMilkman

Yea sadly we haven't got the Azure Function calling API, so I was reluctant to change

LLogan M

ah, that makes sense

Add a reply