Find answers from the community

V
Voldev
Offline, last seen 2 months ago
Joined September 25, 2024
Is there a FOSS vectorizer to store things in the vectorDBs? I don't want to use the OpenAI embeddings API, looking for something that can be run entirely local.
6 comments
L
V
d
V
Voldev
·

Llamacpp

Hi, I'm trying to get llama-index working with llamacpp to query documents entirely locally.
I have the code working for openai, but when I pass llamacpp as the LLMPredictor, my cpu just ramps to 100% and hangs for hours. Anyone have any idea how to proceed? M1 MBP 32G, normal llamacpp works great.
18 comments
l
L
V