Custom Tree Summary Prompt

At a glance

The community member is asking about the best way to use custom prompts when querying a GPTSimpleVectorIndex. They have provided some example code that sets up a custom summary prompt, but it doesn't seem to be using the prompt when they call index_with_query.query(). In the comments, another community member suggests that to use the summary prompt, the query should look like response = index_with_query.query('<string>', mode="summarize"). However, there is no explicitly marked answer in the comments.

IIshaan - liteLLM

what's the best way to use custom prompts when querying a GPTSImpleVectorIndex?

I've tried doing something like this but it doesn't seem to actually be using the prompt when i do index_with_query.query()

SUMMARY_PROMPT_TMPL = (
    "Context information is below. \n"
    "---------------------\n"
    "{context_str}"
    "\n---------------------\n"
    "Always answer the question in bullet points"
)
SUMMARY_PROMPT = SummaryPrompt(SUMMARY_PROMPT_TMPL)
# Build GPTTreeIndex: pass in custom prompt
index_with_query = GPTTreeIndex(documents, summary_template=SUMMARY_PROMPT)

1 comment

LLogan M

What does the code for calling the query look like?

I think to use the summary prompt, your query should look something like this:
response = index_with_query.query('<string>', mode="summarize")

Add a reply

Find answers from the community

Custom Tree Summary Prompt