Find answers from the community

Updated 9 months ago

does anybody knows how to set up the llm

does anybody knows how to set up the llm parameters (temperature, top_p and max output tokens) when using ollama to load a model ?
this is the code :
Plain Text
from llama_index.llms.ollama import Ollama

llm = Ollama(model="llama2", request_timeout=60.0)

response = llm.complete("")
print(response)
W
1 comment
You can pass temperature and other values as kwarg,
like this:

Plain Text
llm = Ollama(model="llama2", request_timeout=60.0, temperature=0.8)


https://github.com/run-llama/llama_index/blob/2b77f89775840d6b796bcc693f7593d2aebc5fec/llama-index-integrations/llms/llama-index-llms-ollama/llama_index/llms/ollama/base.py#L56
Add a reply
Sign up and join the conversation on Discord