Find answers from the community

Updated last year

Sub question

I got this code from a youtube and it works just fine but when i try to use sub question query it causes an error and i do not know why

Attachments

6 comments

The sub question query engine relies on the LLM being able to write json that we can parse.

However, open source LLMs usually suck at this

The query wrapper prompt is also incorrect for llama2-chat

Should be something like

"<s> [INST] {query_str} [/INST] "

So in order to use the sub question query is either i use models from openai or find other open source models that can write json?

Correct -- one could also use just openai for the question generator, and another LLM for everything else

Thank you.

Add a reply