Find answers from the community

Updated 3 months ago

If I ask "Why is the sky blue" to a

If I ask "Why is the sky blue" to a index of a pdf of insurance data, I assume it should respond with something like "That information isn't in the provided context", but instead the response still includes info about Raliegh scattering

8 comments

LLogan M

What chat engine are you using? The default? There are many, and some don't have any prompt template

LLogan M

index.as_chat_engine(..., system_prompt="...") is probably the solution though

OOrion Pax

the default

OOrion Pax

is there a good system_prompt to use for document querying?

LLogan M

Its totally up to you and your data and use case tbh

LLogan M

which is why there is no default, its pretty unique for each user generally

OOrion Pax

Ok. For anyone curious, I currently using this:

Plain Text

system_prompt = (
  "Context information is below.\n"
  "---------------------\n"
  "{context_str}\n"
  "---------------------\n"
  "Given the context information and not prior knowledge, "
  "answer the question: {query_str}\n"
  "If the question is unanswerable, please respond with 'I don't know'."
)

RRZ

try pass in chat_mode='context' in case not fixed

Add a reply