Find answers from the community

Home
Members
bifunctor
b
bifunctor
Offline, last seen 3 months ago
Joined September 25, 2024
b
bifunctor
·

Hi all,

Hi all,
Is a node equal to a document? For example, when I have a JSON file, it is equal to 1 node?
2 comments
b
L
Hello everyone,

I intend to utilize openchat_3.5 as my Language Model (LLM) instead of ChatGPT for Retrieval-Augmented Generation. To achieve this, I've successfully downloaded the openchat_3.5.Q8_0.gguf model onto my computer. I'm employing the llama_cpp library to establish a connection to the LLM, as illustrated below:
Plain Text
from llama_cpp import Llama

llm = Llama(model_path="/Users/developer/ai/models/openchat_3.5.Q8_0.gguf", n_gpu_layers=1, n_ctx=2048)

Now, I'm seeking guidance on how to link LlamaIndex to the local LLM, such as openchat_3.5.Q8_0.gguf.

Thank you.
15 comments
b
S