Constrained Decoding With Regex Patterns

via “regex-constrained generation”

Structured text generation — guarantees LLM outputs match JSON schemas or grammars.

Unique: Converts regex patterns to DFAs and integrates them into the token generation loop for real-time constraint enforcement, avoiding the need for rejection sampling or post-hoc validation.

vs others: Faster and more reliable than regex validation + retry loops because it prevents invalid tokens from being generated in the first place.

via “regex-based generation with pattern matching”

Microsoft's language for efficient LLM control flow.

Unique: Converts regex patterns into grammar constraints (RegexNode) that guide token-by-token generation, ensuring output matches the pattern without post-processing. Uses the regex engine to validate token sequences in real-time during generation.

vs others: More efficient than regex validation after generation because invalid tokens are prevented from being produced, and more flexible than hardcoded format strings because arbitrary regex patterns can be used.

via “constrained-decoding-with-regex-patterns”

Probabilistic Generative Model Programming

Unique: Uses interleaved finite automata evaluation during token sampling rather than post-hoc validation, enabling hard constraints without rejection sampling or model re-runs. Implements efficient token masking by precomputing valid next tokens for each automata state.

vs others: Faster and more reliable than rejection sampling approaches because constraints are enforced during generation, not after, eliminating wasted computation and guarantee of format compliance

via “regex-based pattern matching and text extraction”

A guidance language for controlling large language models.

Unique: Compiles regex patterns into grammar constraints that are enforced during token generation, not after. Uses named capture groups that are automatically extracted into the lm state, enabling seamless integration with multi-step generation pipelines.

vs others: More efficient than regex validation-and-retry because constraints are enforced during generation, and more flexible than hardcoded templates because it allows the model to generate variable content within the pattern constraints.