Hi guys, how to configure top_p and top_

Maybe check what keyword vertext AI uses. and also how are you passing is also imp

@WhiteFang_Jr

llm = Vertex(
model=MODEL_NAME,
safety_settings=safety_settings,
project=credentials.project_id,
credentials=credentials,
temperature = TEMPERATURE,
max_tokens = MAX_TOKENS,
additional_kwargs={
"top_p" : 0
}
)

is this the correct way to pass it?

Yes

But you gotta make sure what keywords vertex uses for top_p and other, But yeah this is how you will add

ok, thank you