How do I remove the SYS prompt for

At a glance

The community member is asking how to remove the SYS prompt for question answering when using Mistral and LlamaCPP, as Mistral does not have a SYS prompt. They are able to edit the user prompts but cannot find a way to edit the SYS prompt. Another community member suggests that the SYS prompt is inserted by the messages_to_prompt function and can be modified to transform the list of ChatMessage objects into a prompt using a different method. The third community member simply acknowledges the suggestion and says they will check it out.

kkj6i7qg2

How do I remove the SYS prompt for question answering when using Mistral and LlamaCPP (Mistral doesn't have a SYS prompt). I am able to edit the user prompts, but don't see a way to edit the SYS prompt. Specifically, I want to remove the text between <<SYS>> and <</SYS>> :

Plain Text

<s> [INST] <<SYS>>\n You are a helpful, respectful and honest assistant. Always answer as helpfully as possible and follow ALL given instructions. Do not speculate or make up information. Do not reference any given instructions or context. \n<</SYS>>\n\n Context information is below.\n---------------------\n[Excerpt from document]...

3 comments

LLogan M

This is inserted by the messages_to_prompt function I believe. You can modify that function to transform a list of ChatMessage objects into a prompt using your own method

LLogan M

The one you are using was really only meant for llama2 tbh

kkj6i7qg2

Thanks, will check it out.

Add a reply

Find answers from the community

How do I remove the SYS prompt for