Find answers from the community

Updated 3 months ago

I am trying to implement the demo of

I am trying to implement the demo of Metadata References: Summaries + Generated Questions referring to a bigger chunk loading PDF documents, this is my implementation, however when executing the code it stays waiting and never moves forward loading the PDF data

Attachments

3 comments

LLogan M

I think ollama is pretty slow if you are running on CPU -- it might take some time?

LLogan M

also you, I don't think you hit it yet, but you'll want to set an embed_model in the service context as well

SSebitas

Oh I understand, what other way of using the LLM model do you recommend?

Add a reply