Modal Specific Pre Nets And Post Nets For Speech Text Conversion

via “modal-specific pre-nets and post-nets for speech-text conversion”

* ⭐ 06/2022: [WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processing (WavLM)](https://ieeexplore.ieee.org/abstract/document/9814838)

Unique: Implements separate pre-nets and post-nets for each modality (speech and text) that interface with a unified encoder-decoder, enabling modality-specific input/output handling while maintaining a shared semantic space. This design allows the core encoder-decoder to remain modality-agnostic.

Modality-specific pre/post-nets enable flexible input/output handling compared to fully unified architectures, but add architectural complexity and parameters compared to single-modality models.