Log in
Log into community
Find answers from the community
View all posts
Related posts
Did this answer your question?
π
π
π
Powered by
Hall
Inactive
Updated 3 months ago
0
Follow
Gcp vertex ai support for llama 3.1 and 3.2 models
Gcp vertex ai support for llama 3.1 and 3.2 models
Inactive
0
Follow
C
Chico262
3 months ago
Β·
Hello! Is there support for llama 3.1 and 3.2 models through GCP's Vertex AI? I can't seem to find any library related to it on llama hub
W
C
2 comments
Share
Open in Discord
W
WhiteFang_Jr
edited 3 months ago
You can follow these links to setup llama3.1 with Vertex:
https://docs.llamaindex.ai/en/stable/examples/llm/vertex/
https://cloud.google.com/blog/products/ai-machine-learning/llama-3-1-on-vertex-ai
C
Chico262
3 months ago
Hey, I eventually figured it out, however it seems to me that it is not possible to do it with the Vertex llama index library.
I did it using OpenAPILike ->
https://llamahub.ai/l/llms/llama-index-llms-openai-like?from=llms
Add a reply
Sign up and join the conversation on Discord
Join on Discord