If you're having trouble with the retrieval portion, you might have to fine-tune but from my experience even when working with niche domain specific context in a different language, at least the OpenAI embedding model was able to perform well. Using metadata will also help here
