Large Scale Semi Supervised Asr Pre Training With Unlabeled Audio

via “fine-tuning on custom russian speech datasets with transfer learning”

automatic-speech-recognition model by undefined. 50,44,932 downloads.

Unique: Leverages XLSR-53's multilingual pretraining to enable effective fine-tuning with minimal Russian-specific data (1-10 hours vs. 100+ hours required for training from scratch). The frozen encoder layers retain language-agnostic acoustic features while only the classification head is adapted, reducing overfitting risk and training time.

vs others: Requires 10-100x less labeled data than training a Russian ASR model from scratch (e.g., DeepSpeech, Kaldi) while achieving comparable or better accuracy on domain-specific tasks; more practical than commercial APIs (Google, Yandex) for proprietary data due to privacy and cost constraints.