Hello there!
I'm working off the following example code from the docs for creating and displaying Property Graph Index:
https://docs.llamaindex.ai/en/stable/examples/property_graph/property_graph_basic/It works fine with OpenAI llm/embeddings, but I can't get it to work with huggingface and other models.
It will successfully save the html containing the graph, but it's mostly empty.
Here's a snippet of the kind of thing I've been trying in order to replace the LLM and embeddings:
%pip install -q llama-index-embeddings-huggingface
%pip install -Uq bitsandbytes
import torch
from llama_index.core import set_global_tokenizer
from transformers import AutoTokenizer
from llama_index.embeddings.huggingface import HuggingFaceEmbedding
LLAMA2_7B = "meta-llama/Llama-2-7b-hf"
selected_model = LLAMA2_7B
llm = HuggingFaceLLM(
context_window=4096,
max_new_tokens=2048,
generate_kwargs={"temperature": 0.0, "do_sample": False},
# query_wrapper_prompt=query_wrapper_prompt,
tokenizer_name=selected_model,
model_name=selected_model,
device_map="auto",
# change these settings below depending on your GPU
model_kwargs={"torch_dtype": torch.float16, "load_in_8bit": True},
)
BGE_SMALL = "BAAI/bge-small-en-v1.5"
selected_embed_model = BGE_SMALL
embed_model = HuggingFaceEmbedding(model_name=selected_embed_model)
from llama_index.core import Settings
Settings.llm = llm
Settings.embed_model = embed_model
from llama_index.core import PropertyGraphIndex
index = PropertyGraphIndex.from_documents(
documents,
llm=llm,
temperature=0.3,
embed_model=embed_model,
show_progress=True,
)
%pip install -q pyvis
index.property_graph_store.save_networkx_graph(name="./kg.html")Is there a way to do this?
