Log in
Log into community
Find answers from the community
View all posts
Related posts
Did this answer your question?
๐
๐
๐
Powered by
Hall
Inactive
Updated 5 months ago
0
Follow
Hi guys, how to configure top_p and top_
Hi guys, how to configure top_p and top_
Inactive
0
Follow
_
__.destro.__
5 months ago
ยท
Hi guys, how to configure top_p and top_k for vertex ai in llamaindex. Its not working when I pass it in additional_kwargs
W
_
5 comments
Share
Open in Discord
W
WhiteFang_Jr
5 months ago
Maybe check what keyword vertext AI uses. and also how are you passing is also imp
_
__.destro.__
5 months ago
@WhiteFang_Jr
llm = Vertex(
model=MODEL_NAME,
safety_settings=safety_settings,
project=credentials.project_id,
credentials=credentials,
temperature = TEMPERATURE,
max_tokens = MAX_TOKENS,
additional_kwargs={
"top_p" : 0
}
)
is this the correct way to pass it?
W
WhiteFang_Jr
5 months ago
Yes
W
WhiteFang_Jr
5 months ago
But you gotta make sure what keywords vertex uses for top_p and other, But yeah this is how you will add
_
__.destro.__
5 months ago
ok, thank you
Add a reply
Sign up and join the conversation on Discord
Join on Discord