Find answers from the community

h
hz
Offline, last seen 3 months ago
Joined September 25, 2024
Following the example for Graph Store with a Custom LLM, I was able to build the indices, but when running query, it seems to hang

response = query_engine.query("Tell me more about Interleaf")

I have only implemented metadata and complete function in CustomLLM. What could be the reason behind the hang?
18 comments
L
h
Following the customized LLM example on the documentation, upon initializing service context
service_context = ServiceContext.from_defaults(
llm=llm,
context_window=context_window,
num_output=num_output
)

I am getting an error, did I missed a configuration somewhere?
10 comments
h
L
I am not, python 3.9
21 comments
L
h
W
b