Which chat engine are you using? It shouuuuld be possible if you customize the prompt template for the query engine, but you'll have to build the chat engine a little more manually (i.e. not using as_chat_engine
I am using as_chat_engine right now. Also have a use case with query_engine and a custom prompt, works fine if i ask it to reply in the specific language. But unsure how a custom prompt would work best in a chat. Maybe some kind of intro prompt.