Find answers from the community

Updated 2 months ago

Hi everyone, what's the easiest way to

Hi everyone, what's the easiest way to finetune an LLM model (not embedding) on my VectorDB?
I already have a RAG pipeline inplace and I'd like to fine-tune open source models to enhance the overall usefullness.
I saw the llama-index finetuning doc, specifically the part with Llama2 + Gradient.AI but I was wondering if there is a more transparent way without paid tools:
https://docs.llamaindex.ai/en/stable/optimizing/fine-tuning/fine-tuning.html#fine-tuning-llama-2-for-better-text-to-sql
W
d
3 comments
There are two more options there that I think are not using paid way to finetune the LLM modeoption 2 and 3
Attachment
image.png
Are they not good?
As far as I know, Modal is also a paid solution but I'll try to dig deeper
Add a reply
Sign up and join the conversation on Discord