Find answers from the community

Updated 9 months ago

does anybody knows how to set up the llm

does anybody knows how to set up the llm parameters (temperature, top_p and max output tokens) when using ollama to load a model ?
this is the code :

Plain Text

from llama_index.llms.ollama import Ollama

llm = Ollama(model="llama2", request_timeout=60.0)

response = llm.complete("")
print(response)

1 comment

You can pass temperature and other values as kwarg,
like this:

Plain Text

llm = Ollama(model="llama2", request_timeout=60.0, temperature=0.8)

Add a reply