Neural Vocoder Based Waveform Reconstruction From Discrete Tokens

via “vocoder-based waveform generation from spectrograms”

Open-source TTS library — 1100+ languages, voice cloning, multiple architectures, Python API.

Unique: Implements a pluggable vocoder architecture where multiple neural vocoder families (HiFi-GAN, Glow-TTS, WaveGlow) are supported through a unified interface, with automatic spectrogram normalization/denormalization and compatibility checking between TTS models and vocoders, enabling users to swap vocoders without changing TTS model code

vs others: Offers more vocoder choices than single-vocoder TTS libraries (like Glow-TTS which uses only its native vocoder) and more transparency than commercial APIs which hide vocoder selection, though with lower average audio quality than commercial vocoders optimized on proprietary datasets

via “encodec-based neural audio waveform reconstruction”

Open-source text-to-audio — speech, music, sound effects, 13+ languages, runs locally.

Unique: Leverages Facebook's EnCodec neural codec for efficient, high-quality waveform reconstruction from discrete tokens, enabling end-to-end generative audio without traditional vocoder artifacts

vs others: Neural codec approach produces fewer artifacts than traditional vocoders (WaveGlow, HiFi-GAN); learned compression maintains perceptual quality at lower bitrates than hand-crafted codecs

via “mel-spectrogram to waveform vocoding with glow-based architecture”

text-to-speech model by undefined. 75,55,083 downloads.

Unique: Uses a glow-based invertible neural network architecture for vocoding, enabling parallel waveform generation without autoregressive decoding. This approach is faster and more stable than traditional autoregressive vocoders (WaveNet, WaveGlow) while maintaining high audio quality.

vs others: Faster inference than autoregressive vocoders (WaveNet) because it generates waveforms in parallel rather than sample-by-sample; more stable than GAN-based vocoders because it uses likelihood-based training rather than adversarial objectives; produces higher quality audio than traditional signal processing vocoders (Griffin-Lim).

via “neural vocoding with vocos for waveform generation”

A generative speech model for daily dialogue.

Unique: Uses Vocos, a modern neural vocoder trained on large-scale speech data, rather than traditional signal processing vocoders (e.g., Griffin-Lim) or older neural vocoders (e.g., WaveGlow). Vocos is fast, high-quality, and can be swapped independently of the TTS model, enabling flexible vocoding strategies.

vs others: Faster and higher-quality than Griffin-Lim because it uses a neural network trained on real speech rather than iterative signal processing. More flexible than end-to-end TTS models because the vocoder is a separate component that can be fine-tuned or replaced independently.

via “neural vocoding with waveform reconstruction”

text-to-speech model by undefined. 21,08,297 downloads.

Unique: Uses a pre-trained, frozen neural vocoder rather than training vocoding jointly with TTS, enabling modular architecture where vocoder can be swapped without retraining the TTS model. Vocoder is optimized for mel-spectrogram inversion specifically, not general audio generation.

vs others: Faster and higher quality than Griffin-Lim phase reconstruction (traditional signal processing approach) but slower and less controllable than end-to-end neural waveform models like WaveNet or Glow-TTS that generate waveforms directly from text.

via “neural vocoder integration for waveform generation”

text-to-speech model by undefined. 20,90,369 downloads.

Unique: Integrates modular neural vocoder architecture (HiFi-GAN) with acoustic model, enabling vocoder swapping for quality/latency optimization without retraining acoustic components

vs others: Achieves audio quality comparable to end-to-end models (Glow-TTS + vocoder) while maintaining modularity for vocoder experimentation and optimization, vs. monolithic end-to-end architectures

via “mel-spectrogram to waveform vocoding with neural upsampling”

text-to-speech model by undefined. 11,52,993 downloads.

Unique: Uses learned neural vocoding instead of traditional signal processing (Griffin-Lim, WORLD) — enables end-to-end differentiable TTS pipeline and better generalization to diverse speaker characteristics. Optimized for 0.5B-scale inference with depthwise-separable convolutions and pruned residual blocks, achieving <100ms latency on mobile GPUs.

vs others: Faster and more natural-sounding than Griffin-Lim (traditional) while using 10x fewer parameters than HiFi-GAN or UnivNet, making it suitable for edge deployment where model size and latency are critical.

via “neural-vocoder-agnostic-mel-to-waveform-conversion”

text-to-speech model by undefined. 7,81,533 downloads.

Unique: Standardizes mel-spectrogram output format across all Indic languages to ensure vocoder compatibility, using consistent frequency binning (80-128 bins) and frame shift (12.5ms) regardless of language. Mel-spectrogram normalization is language-agnostic, enabling seamless vocoder swapping without language-specific tuning.

vs others: Provides greater vocoder flexibility than end-to-end TTS models (e.g., Glow-TTS) that bundle vocoder inference, enabling users to optimize for latency or quality independently. Outperforms single-vocoder TTS systems by allowing vocoder upgrades without model retraining.

via “neural vocoder waveform synthesis”

text-to-speech model by undefined. 2,67,330 downloads.

Unique: Employs a lightweight flow-matching or diffusion-based vocoder architecture (vs. traditional GAN-based vocoders like HiFi-GAN) that achieves comparable quality at 0.5B parameters through iterative refinement rather than single-pass generation, enabling better convergence on edge devices with limited training data

vs others: More parameter-efficient than HiFi-GAN (10M parameters) while maintaining comparable audio quality; faster inference than autoregressive vocoders (WaveNet) due to parallel generation; more stable training than GAN-based approaches, reducing mode collapse artifacts

via “mel-spectrogram to waveform vocoding”

text-to-speech model by undefined. 4,69,583 downloads.

Unique: Uses a non-autoregressive vocoder (likely HiFi-GAN variant) that generates entire waveforms in a single forward pass, achieving 50-100x speedup compared to autoregressive alternatives like WaveNet. The vocoder is optimized for MLX inference, leveraging GPU acceleration to produce 22050 Hz audio at real-time or faster-than-real-time speeds.

vs others: Faster than WaveGlow or WaveNet vocoders while maintaining comparable audio quality; more efficient than traditional signal processing vocoders (WORLD, STRAIGHT) because neural vocoding requires no explicit pitch extraction or spectral envelope modeling.

via “neural vocoder integration for waveform synthesis”

text-to-speech model by undefined. 4,36,984 downloads.

Unique: Integrates a multilingual neural vocoder trained on diverse language acoustic characteristics, enabling consistent waveform quality across 1100+ languages without language-specific vocoder variants — most TTS systems either use language-specific vocoders or apply generic vocoders that may not handle tonal languages or unusual phonetic features well

vs others: Produces higher-quality waveforms than traditional DSP-based vocoders (Griffin-Lim, WORLD) and maintains quality across diverse languages, though with higher computational cost than lightweight vocoders like WaveRNN

via “neural vocoder-based waveform synthesis from mel-spectrograms”

text-to-speech model by undefined. 1,53,127 downloads.

Unique: Decouples linguistic modeling (TTS encoder-decoder) from acoustic synthesis (vocoder), allowing independent optimization and vocoder swapping — this modular design trades off end-to-end optimization for flexibility, compared to end-to-end models that jointly optimize text-to-waveform

vs others: More flexible than end-to-end TTS models because vocoder can be swapped or fine-tuned independently; faster inference than autoregressive waveform models (WaveNet) due to parallel vocoder architecture, but potentially lower quality than carefully tuned end-to-end systems

via “mel-spectrogram to waveform vocoding with neural upsampling”

text-to-speech model by undefined. 2,10,673 downloads.

Unique: Uses a pre-trained HiFi-GAN vocoder optimized for Japanese speech characteristics, with transposed convolution layers trained on Japanese phonetic distributions to minimize artifacts specific to Japanese phoneme transitions (e.g., geminate consonants, pitch accent patterns). The vocoder is fine-tuned on mel-spectrograms from the TTS encoder, ensuring tight integration and minimal spectral mismatch.

vs others: Faster than WaveNet or WaveGlow vocoders (100-200x speedup) while maintaining comparable audio quality; more efficient than Griffin-Lim phase reconstruction (eliminates iterative optimization); produces cleaner audio than simple linear interpolation by learning non-linear upsampling patterns from data.

via “neural vocoder-based waveform generation from spectrograms”

Deep learning for Text to Speech by Coqui.

Unique: Implements vocoder abstraction as a separate, swappable component with automatic spectrogram normalization based on vocoder-specific statistics, enabling zero-shot vocoder switching without TTS model retraining. The system maintains vocoder metadata in model configurations, ensuring compatibility checking at inference time.

vs others: Supports multiple vocoder architectures (HiFi-GAN, Glow-TTS, WaveGlow) in a unified interface, whereas most TTS systems hardcode a single vocoder or require manual vocoder integration.

via “hifigan neural vocoding with high-fidelity waveform synthesis”

A high quality multi-voice text-to-speech library

Unique: Uses HiFiGAN architecture with multi-scale discriminators and periodic/aperiodic decomposition, which is more efficient and higher-quality than earlier vocoders (WaveGlow, WaveNet). Optimized for 24kHz synthesis with minimal artifacts.

vs others: Faster and higher-quality than WaveNet-based vocoders; more stable than WaveGlow because GAN training is more robust; produces fewer artifacts than Griffin-Lim phase reconstruction.

via “audio codec compression with discrete token representation”

A single-stop code base for generative audio needs, by Meta. Includes MusicGen for music and AudioGen for sounds. #opensource

Unique: Combines convolutional autoencoders with vector quantization to create a learned codec that produces discrete tokens suitable for language model training, rather than using traditional codecs (MP3, AAC) or continuous latent representations that don't integrate naturally with transformer architectures

vs others: More efficient than raw waveform generation because it reduces sequence length by 50-100x, and more flexible than traditional audio codecs because the discrete representation is learned end-to-end for the downstream task rather than optimized for human perception alone

via “encodec-based audio tokenization and reconstruction”

A transformer-based text-to-audio model. #opensource

via “audio quality and vocoder selection”

Generative AI for Voice.

via “neural vocoder-based waveform reconstruction from discrete tokens”

* ⭐ 01/2023: [MusicLM: Generating Music From Text (MusicLM)](https://arxiv.org/abs/2301.11325)

Unique: Decouples vocoding from token prediction, allowing the vocoder to be trained independently on high-quality audio and enabling efficient parallel processing, unlike end-to-end models where waveform generation is tightly coupled to acoustic modeling

vs others: Faster and more stable than WaveNet-style autoregressive vocoders (parallel generation instead of sequential) and produces higher quality audio than simple upsampling or interpolation methods because it learns the complex mapping from discrete tokens to natural waveforms