Non Causal Attention In Fine Model For Bidirectional Audio Context

via “fine-grained audio detail synthesis via non-causal refinement”

Open-source text-to-audio — speech, music, sound effects, 13+ languages, runs locally.

Unique: Uses non-causal (bidirectional) attention to refine audio tokens, allowing each position to condition on future context for higher-quality reconstruction than causal-only approaches

vs others: Bidirectional refinement produces more natural audio than single-pass causal models; hierarchical approach enables faster coarse generation with optional fine refinement