The community member is asking whether the DEFAULT_REFINE_PROMPT in the base query is sufficient to get a follow-up query to refine an existing answer, as they are getting unrelated responses when trying to do so. The comments suggest that the community members are interested in this use case, but the current implementation does not inherently support asking follow-up questions. One community member suggests parsing the response.source_nodes to get the documents the response came from, which could be useful for a specific use case. However, the overall functionality of handling follow-up questions like ChatGPT is not yet implemented, but the community members consider it a good idea that would require some thought to provide a good interface.
Should the DEFAULT_REFINE_PROMPT in base query, rather than providing a custom template be sufficient to get a follow up query to refine an existing answer? I keep getting a response that is unrelated to the existing answer when I try --
index.query('some initial query') --> returns an expected response
index.query('some query asking for additional information concerning response to initial query') --> returns either no context available message or completely unrelated response generated
Hey @Omar , this is a pretty interesting use case. What index are you using? Are you putting the existing response in the query prompt for the followup question? We don't inherently have support for asking followup questions but this seems like a great thing to add.
Ah yeah, I get that source nodes is probably sufficient for that particular use case
but it sounds like followup questions in the way that ChatGPT behaves when asked to clarify certain parts of a response is not something that is implemented just yet?