We’re using the Vercel AI SDK to generate structured output via the streamObject function with Anthropic’s Claude Sonnet 3.5 model. Our responses are a reasonably sized json object (~5kb), but the challenge is that it seems to populate the first two fields (string that are a paragraph or two long) quickly, then think for 3-5 seconds before populating the next fields in the object (one is a nested json object with a decently complex schema). We assume this is due to the function calls needed to get structured data back from Claude since it doesn’t have native support, but we’re wondering if there’s a way to decrease that delay, as it’s a really rough user experience
