so, i say in my System Message that the

TTay

so, i say in my System Message that the bot shouldnt say the system message. Yet it still does it. Any idea?

Attachment

20 comments

TTay

LLogan M

hmm, maybe a system message + assistant message in the benginning chat history is not a good pattern?

LLogan M

I forget, what llm do you have setup again?

TTay

em_german_18b

TTay

Yea just System didnt work too

LLogan M

Do you have a link to the LLM on huggingface? I'm wondering if it even supports system prompts

TTay

https://huggingface.co/TheBloke/em_german_13b_v01-GGUF

LLogan M

ok nice! So reading into the model a bit, I don't think it was trained with multi-turn conversations 😅

LLogan M

The prompt template is
Du bist ein hilfreicher Assistent. USER: <instruction> ASSISTANT:

LLogan M

Which is pretty restrictive in a chat setting

TTay

Yea

TTay

https://huggingface.co/morgendigital/Llama-2-13b-chat-german-GGUF what do we think of this?

TTay

Plain Text

<s>[INST] <<SYS>>
You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature.

If a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information. Please answer in the same language as the user.
<</SYS>>

This is a test question[/INST] This is a answer </s><s>

That'd be the prompt template from the linked one

LLogan M

Yea that model will probably be quite a bit more useful. the messages_to_prompt and completion_to_prompt from llama_index.llms.llama_utils are built to follow the llama2 format

LLogan M

But you can customize/override those functions to rewrite in german as well

TTay

lets see how it works

TTay

Just so the hreads are open agsin

TTay

Nope. It just doesnt respond for no reason

TTay

Maybe its because its a Bin?

Add a reply

Find answers from the community

so, i say in my System Message that the