Hello everyone,

Like the name instruct might imply, it wasn't trained with the concept of a system prompt

Best you can do is modify the instruction

@Logan M, so it’s best not used for chat purposes ? Or how can you modify the instruction ?

Best not used for chat purposes.

What LLM class are you using for this?

Not sure if this was you, but also saw this on github
https://github.com/run-llama/llama_index/issues/10072#issuecomment-1894115576

I was trying some stuff with VLLM and their openai like api. I guess I’ll start the history with the system prompt and see what it does

ah yea, vLLM handles the formatting for you

no idea what it will do for that lol