Find answers from the community

Updated 6 months ago

Timeout

At a glance

The post shows community members configuring global and local settings for the llama_index library, specifically setting the Ollama language model and request timeout. A comment suggests increasing the timeout, but there is no explicitly marked answer.

MMS

Global settings

from llama_index.core import Settings
from llama_index.llms.ollama import Ollama

Settings.llm = Ollama(model="mistral", request_timeout=60.0)

Local settings

index.as_query_engine(llm=Ollama(model="mistral", request_timeout=60.0))

1 comment

LLogan M

Increase the timeout?

Add a reply