Find answers from the community

Updated 9 months ago

Cli

At a glance

Hi 👋 Is it possible to use llamaindex-cli rag with a local model? (preferably these that llama-cpp cli is able to run really fast with on an M1 Mac https://huggingface.co/ggml-org). Looking at the source code, it looks like OpenAI is hardcoded into the CLI.

2 comments

LLogan M

It's not hard-coded

https://docs.llamaindex.ai/en/stable/getting_started/starter_tools/rag_cli/?h=rag+cli#customization

CCarsten

ok, thank you, I'll give that a try 🙂

Add a reply