Incremental Json Parsing With Llm Streaming Tolerance

via “streaming partial object construction”

Get structured, validated outputs from LLMs using Pydantic models — patches any LLM client.

Unique: Implements a token-aware JSON parser that can detect field boundaries in incomplete JSON, allowing validation of individual fields before the full response is complete. Uses a state machine to track parsing progress and yield partial objects at natural boundaries (e.g., when a field is complete).

vs others: More efficient than buffering the entire response before validation (enables real-time feedback) and more robust than naive token-by-token parsing (handles nested structures and arrays correctly)