Find answers from the community

Updated last month

Llama-index support for structured output mode when using vertex ai

At a glance

The community member is asking if the llama-index library supports the structured output mode when using Vertex AI. They mention that Google has a link about structured output control for Vertex AI, but they don't see the same functionality implemented in the llama-index Vertex package. Other community members respond that the structured output functionality should be available, and they provide links to relevant documentation on the llama-index website. The community members indicate that the structured output functionality can be used with the Vertex LLM.

Useful resources
Hi, does llama-index support the structured output mode when using vertex ai? Google has one link about https://cloud.google.com/vertex-ai/generative-ai/docs/multimodal/control-generated-output, but I don't see the same thing implemented for the llama-index vertex package. Did I miss something?
W
Z
3 comments
You should be able to do it:
You can follow this example along with your vertex LLM to generate structured outputs: https://docs.llamaindex.ai/en/stable/examples/structured_outputs/structured_outputs/
Got it, thanks!
Add a reply
Sign up and join the conversation on Discord