Semantic Token Based Generation With Hierarchical Structure

via “semantic token generation for high-level musical structure”

A model by Google Research for generating high-fidelity music from text descriptions.

via “semantic token-based generation with hierarchical structure”

Unique: Uses hierarchical sequence-to-sequence architecture with explicit semantic token intermediate representation to enable better compositional coherence and multiple conditioning modes; semantic tokens serve as a unified representation that text, melody, and sequential prompts can all condition on, enabling flexible composition of conditioning strategies.

vs others: Hierarchical semantic token approach enables better structural coherence and enables multiple conditioning modes to compose naturally, whereas end-to-end text-to-audio models struggle with long-range coherence and conditioning flexibility; intermediate representation also enables potential future manipulation and inspection capabilities.