Very cool! Thanks for sharing!
btw, I noticed that you are using mistral-openorca, but you are using the llama2
messages_to_prompt functions -- this might be decreasing your accuracy
The mistral-openorca model seems to be fine-tuned with a different scheme, so you'll need a custom messages_to_prompt function 👀
The format is something like
<|im_start|>system
You are MistralOrca, a large language model trained by Alignment Lab AI. Write out your reasoning step-by-step to be sure you get the right answers!
<|im_end|>
<|im_start|>user
How are you?<|im_end|>
<|im_start|>assistant
I am doing well!<|im_end|>
<|im_start|>user
Please tell me about how mistral winds have attracted super-orcas.<|im_end|>
<|im_start|>assistant
