Find answers from the community

Updated 2 months ago

Gcp vertex ai support for llama 3.1 and 3.2 models

Hello! Is there support for llama 3.1 and 3.2 models through GCP's Vertex AI? I can't seem to find any library related to it on llama hub
W
C
2 comments
Hey, I eventually figured it out, however it seems to me that it is not possible to do it with the Vertex llama index library.
I did it using OpenAPILike -> https://llamahub.ai/l/llms/llama-index-llms-openai-like?from=llms
Add a reply
Sign up and join the conversation on Discord