custom prompt to better control the decomposition

AAndrei

I'm currently exploring the capabilities of the SubQuestionQueryEngine and its potential, and was wondering how I can use a custom prompt to better control the decomposition of complex queries into subqueries. Could you guide me on how to define and integrate a custom prompt for this purpose? Thanks!

2 comments

AAndrei

@Logan M @WhiteFang_Jr will this be possible to set a custom prompt for SubQuestionQueryEngine ? Thanks

WWhiteFang_Jr

SubQuestionQueryEngine uses prompt for generating sub questions , if you want to change the prompt for generating the sub questions you can do it this way:

CHeck both the generator code: https://github.com/run-llama/llama_index/tree/main/llama-index-integrations/question_gen

They have a default prompt that they use to generate queries, modify that and create the object of question generator and pass it in the subquestion engine:

Plain Text

question_gen = OpenAIQuestionGenerator.from_defaults(prompt_template_str="ADD_HERE"...)

# add it to SubQ
query_engine = SubQuestionQueryEngine.from_defaults(
    query_engine_tools=query_engine_tools,
    use_async=True,
    question_gen=question_gen
)

Add a reply

Find answers from the community

custom prompt to better control the decomposition