LLMs-at-DoD/tutorials/Chatting with your...

LLogan M

Very cool! Thanks for sharing!

btw, I noticed that you are using mistral-openorca, but you are using the llama2 messages_to_prompt functions -- this might be decreasing your accuracy

The mistral-openorca model seems to be fine-tuned with a different scheme, so you'll need a custom messages_to_prompt function 👀

The format is something like

Plain Text

<|im_start|>system
You are MistralOrca, a large language model trained by Alignment Lab AI. Write out your reasoning step-by-step to be sure you get the right answers!
<|im_end|>
<|im_start|>user
How are you?<|im_end|>
<|im_start|>assistant
I am doing well!<|im_end|>
<|im_start|>user
Please tell me about how mistral winds have attracted super-orcas.<|im_end|>
<|im_start|>assistant

https://huggingface.co/Open-Orca/Mistral-7B-OpenOrca

GGlenn

ah great catch! thank you for point this out @Logan M

jjerryjliu0

this is awesome!

Find answers from the community

LLMs-at-DoD/tutorials/Chatting with your...