Free alternative

You can use local models, but it would cost you a goor hardware to run it

You don't need a subscription, you could use a free vector db such as Chroma db and you will have to use for example openais api for the llm. For embedding the texts to vector embeddings, you could use the free Sentence-Transformers tool.

You can also use the gpt chat that is available on the llama index docs page, it has been very helpful for me.

You can ask it to help get you started and then ask clarifying questions.

Thanks a lot. Would i need to do fine-tuning? i just have a couple of (small) excel sheets containing questions and answers as a "database".

Thank a lot! Do you think i would need fine-tuning? or can i just run the llm as it is?

Not required, you can just use the csv as a document for llama_índex directly

I would recommend you to see the starter tutorial - https://gpt-index.readthedocs.io/en/stable/getting_started/starter_example.html

Thanks a lot, i appreciate it

But the openai api isn't free, is it? Or is there no way to use a free llm?

It's not free but relatively cheap for embedding models and 3.5 turbo. However you can also use the open source LLMs and embedding models instead of OpenAI

Thanks a lot

I'm loving this server xD