Voice Design Parameter Based Prosody And Speaker Characteristic Control

via “ssml-based prosody and speech control with fine-grained markup”

text-to-speech model by undefined. 15,92,474 downloads.

Unique: Converts SSML tags into continuous control signals (rate, pitch, energy) injected into decoder attention, enabling smooth prosody transitions rather than discrete tag-based modifications. Uses learned prosody embeddings that interact with speaker embeddings, allowing speaker-dependent prosody effects.

vs others: Provides finer prosody control than simple rate/pitch scaling (which affects entire utterance) and better integration with speaker adaptation than tag-based systems that treat prosody independently from voice characteristics.