Find answers from the community

Updated 3 months ago

Free alternative

Hello everyone!
I'm very new to the field, so forgive my primitive question: Do i need a subscription to some hosted service like OpenAI's in order to use llama index for RAG? Or is there a free alternative?
1
E
C
M
13 comments
You can use local models, but it would cost you a goor hardware to run it
You don't need a subscription, you could use a free vector db such as Chroma db and you will have to use for example openais api for the llm. For embedding the texts to vector embeddings, you could use the free Sentence-Transformers tool.
You can also use the gpt chat that is available on the llama index docs page, it has been very helpful for me.
You can ask it to help get you started and then ask clarifying questions.
Thanks a lot. Would i need to do fine-tuning? i just have a couple of (small) excel sheets containing questions and answers as a "database".
Thank a lot! Do you think i would need fine-tuning? or can i just run the llm as it is?
Not required, you can just use the csv as a document for llama_índex directly
Thanks a lot, i appreciate it
But the openai api isn't free, is it? Or is there no way to use a free llm?
It's not free but relatively cheap for embedding models and 3.5 turbo. However you can also use the open source LLMs and embedding models instead of OpenAI
I'm loving this server xD
Add a reply
Sign up and join the conversation on Discord