Yeah the OpenAI embedding models and LLMs are pretty good with different languages. For open source they will struggle more but you can finetune them like Elliot mentioned. You can also find some multilingual models or even language specific for some
You might also want to consider the prompts since they're English by default, with my language and 3.5 I found that including the prompts in my language helped with the response quality somewhat
