LlamaIndex
Log in

Find answers from the community

Updated last year

Everyone – I have a very little

ddisco.dr
·
Everyone – I have a very little knowledge and experience in AI. I am looking to pickup a small size model to fine tune it for Indian local languages. How do I go about it?
T
d
2 comments
TTeemu
That will be an incredibly difficult task, I'd start with looking for a foundational model that is close to the language. Just reading this thread it seems like a lot of people have struggled with implementing any language knowledge retention through fine-tuning: https://www.reddit.com/r/LocalLLaMA/comments/14chx6o/finetuning_a_llm_on_another_language/

This paper might also be an interesting read: https://arxiv.org/abs/2304.08177
ddisco.dr
Will go through these @Teemu. Thanks a ton.
Add a reply
Sign up and join the conversation on Discord