Architecture

The case for structured outputs in production AI

Most production AI systems parse prose from LLMs instead of requesting structured JSON, and the cost and reliability gap this creates is larger than expected.