Find answers from the community

m
max
Offline, last seen 3 months ago
Joined September 25, 2024
Hi guys, sorry quick question, is there a way to set a global top_k, top_p, max_tokens in Settings.llm? I'm using Mistral and couldn't find anything in the documentation (generate_kwarg and additional_kwarg seems not to work)
5 comments
m
W