Multi Domain Audio Quality Evaluation Via Mushra Subjective Testing

via “audio quality assessment and artifact detection”

text-to-speech model by undefined. 96,95,562 downloads.

Unique: Provides built-in artifact detection through spectrogram analysis without requiring external audio quality assessment tools, enabling quality monitoring directly within the synthesis pipeline

vs others: Lighter-weight than formal MOS evaluation or external quality assessment services, making it practical for real-time quality monitoring in production systems

via “multi-domain audio quality evaluation via mushra subjective testing”

* ⭐ 12/2022: [Robust Speech Recognition via Large-Scale Weak Supervision (Whisper)](https://arxiv.org/abs/2212.04356)

Unique: Systematically evaluates codec across multiple audio domains (speech, noisy speech, music) using MUSHRA methodology, revealing domain-specific quality characteristics rather than reporting single aggregate quality metric. This multi-domain approach identifies where codec performance varies, enabling informed deployment decisions.

vs others: MUSHRA subjective evaluation provides more reliable quality assessment than objective metrics (PESQ, STOI) alone, because it captures human perception of audio quality including artifacts and artifacts that objective metrics miss — critical for consumer-facing audio applications where subjective quality directly impacts user satisfaction.

via “audio model evaluation with domain-specific metrics and benchmarking”

* ⭐ 04/2022: [MAESTRO: Matched Speech Text Representations through Modality Matching (Maestro)](https://arxiv.org/abs/2204.03409)

Unique: Integrates patchout-trained model evaluation with standard audio benchmarks, providing insights into how augmentation-based training affects generalization across different audio domains and class distributions

vs others: More comprehensive than basic accuracy reporting because it combines domain-specific metrics (per-class F1, ROC-AUC) with confusion analysis and benchmark comparisons, enabling deeper understanding of model behavior than single-metric evaluation