Find answers from the community

Updated 3 months ago

When I call `get_prompts ` on query

When I call get_prompts on query engine, it provides back 2 prompts
response_synthesizer:text_qa_template
and
'response_synthesizer:refine_template'

how do I make it use the refine_template instead of the qa_template programmatically?

3 comments

LLogan M

The refine template is only used when enough context is retrieved that it doesn't all fit into one LLM call

Then, the llm gets an existing_answer, which is then refined using the rest of the retrieved context

LLogan M

So, not really a programmatic way to do that besides giving a synthesizer a lot of text

You could also call the llm directly with the prompt + prompt args

cchantlong

Thanks

Add a reply