LlamaIndex
Log in

Find answers from the community

Updated 3 months ago

Kwargs

ddrewskidang
·
"do_sample": True,
"temperature": 0.6,
"top_p": 0.9,
},

Is there a way to add this in the openailike class....I tried additonal kwargs but no avail
L
1 comment
LLogan M
Additional kwargs should be it, those get added to every api request
https://github.com/run-llama/llama_index/blob/b767f274f8563298b607229e4598b4ed92056394/llama-index-integrations/llms/llama-index-llms-openai/llama_index/llms/openai/base.py#L357
Add a reply
Sign up and join the conversation on Discord