Transformer Encoder Decoder With Cross Attention For Phoneme To Acoustic Mapping

via “language-specific-character-decoding”

automatic-speech-recognition model by undefined. 21,14,117 downloads.

Unique: Maintains separate lightweight output heads per language (linear layers mapping 768-dim embeddings to language-specific character vocabularies) rather than a single shared decoder, enabling efficient language-specific adaptation and zero-shot transfer to new languages by training only the output head

vs others: More efficient than retraining full models per language because the expensive acoustic encoder is shared; more flexible than single-decoder architectures because each language can have optimized vocabulary and decoding strategy