Hi guys, sorry quick question, is there

top_p and max_tokens are part of LLM , setting it while initialising your LLM makes more sense.

For top_K, you can set it in the query_engine directly!.

Are they not working when you set it there?

Thanks for your reply!

It's ok for the top_k,

I agree with you about setting top_p and max_tokens while initialising my LLM that's why I would like to use it like this :

"Settings.llm = MistralAI(api_key=api_key, model="mistral-small", top_p = 0.90, max_tokens = 300) "

There is another way ?

You can set max_tokens like how you have defined here.
For others you can pass it as a dict, mentioned here: https://github.com/run-llama/llama_index/blob/d63fec1c69a2e1e51bf884a805b9fd31ad8d1ee9/llama-index-integrations/llms/llama-index-llms-mistralai/llama_index/llms/mistralai/base.py#L72

keyword should be exact: additional_kwargs

Thanks a lot !