Welcome message

Question

Happy new year. I recently fine-tune a model. I used Ollama to run it. It shows a welcome message in Ollama terminal.
In my python code, I use
llm = Ollama(model="xxxx", request_timeout=60.0)
chat_engine =index.as_chat_engine(
chat_mode="context",
llm=llm,
memory=memory
)
How to get welcome message generated by the model when it starts?

Logan M · Answer

Not sure what you mean by welcome message? You can just print() any message you want?

MoekaChan · Answer

The first img is llama3.2, the second one is our fine-tuned model.The welcome message is "Hi my name is ....."I don't know how to get the welcome message in python

Logan M · Answer

Thats just a matter of setting a system prompt when you chat with the llmFor example

Logan M · Answer

index.as_chat_engine(..., system_prompt="Your name is Paul, always greet yourself when you start a new conversation.")

MoekaChan · Answer

system prompt is in system, in the fourth row... message is in the 3rd row... the messages is added into the language model.. Can python extract it from the model?

Logan M · Answer

I don't think that system message is used by default in Ollama + llama-index

Logan M · Answer

You need to provide your own

Logan M · Answer

not really sure how that ends up working in ollama

You can see the actual usage here
https://github.com/run-llama/llama_index/blob/ad3be7fec4fa0f032661f9783c462a45cf3f6a3f/llama-index-integrations/llms/llama-index-llms-ollama/llama_index/llms/ollama/base.py#L306

Logan M · Answer

Set the system prompt on the chat engine imo

Find answers from the community

Welcome message