Hi @Logan M Do you know whether the

Open-source llms are not good with Pydantic support tbh. You can check https://docs.llamaindex.ai/en/stable/examples/output_parsing/llm_program/

Set open-source LLM with Settings and try with prompt manipulation.

I did recently add a json_mode flag to the Ollama LLM, should help a bit