Find answers from the community

Updated 5 months ago

Prompts

At a glance

Are there any ways currently to alter the underlying prompts and flows within some of the query engines or retrievers? Like altering the prompt for how the sub questions created in the sub question retriever, how the answers are synthesized? Thanks!

5 comments

WWhiteFang_Jr

Ref on how you can customize the prompt in LlamaIndex: https://docs.llamaindex.ai/en/stable/module_guides/models/prompts.html

Also for sub query engines: You can change the prompt based on your need from here: https://github.com/run-llama/llama_index/blob/main/llama_index/query_engine/sub_question_query_engine.py

It has two ways to generate the questions:

OpenAIQuestionGenerator
LLMQuestionGenerator

Both of them use a default prompt which you can modify!

LLeMoussel

@WhiteFang_Jr How to generate questions from LLMQuestionGenerator?

WWhiteFang_Jr

https://github.com/run-llama/llama_index/blob/main/llama_index/question_gen/llm_generators.py

LLeMoussel

Some examples to use it?

WWhiteFang_Jr

Not sure if there is direct example of using it, But you can check the generate method in it and follow on the requirements.

https://github.com/run-llama/llama_index/blob/cdfebe6f438461549a5b3647c697bf4bbaa51d47/llama_index/question_gen/llm_generators.py#L61

Add a reply