Find answers from the community

Updated 8 months ago

What is the cheapest / free way for a

What is the cheapest / free way for a compsci student to use llamaindex to build a simple RAG based chatbot? Are there free APIs to create the vectors? Then to call some light version of something like chat?

♔

5 comments

TTeemu

You can do it for free with the local LLMs:
https://docs.llamaindex.ai/en/stable/getting_started/starter_example_local/

Then for the chatbot part there is the Chat Engine: https://docs.llamaindex.ai/en/stable/module_guides/deploying/chat_engines/

♔♔†𝓟𝓘𝓣𝓑𝓤𝓛𝓛 †

Okay so what's the purpose of chat engine when u have llm?

TTeemu

It's to have a back and forth conversation (with memory)

♔♔†𝓟𝓘𝓣𝓑𝓤𝓛𝓛 †

does llamaindex use hnsw ?

TTeemu

Depends on what integrations you're using

Add a reply