Kokoro TTS

Generates natural-sounding speech from text using a lightweight 82-million parameter transformer-based neural model (KModel class) that operates on phoneme sequences rather than raw text, with parallel Python and JavaScript implementations enabling deployment from CLI to web browsers. The KPipeline orchestrates text processing through language-specific G2P conversion (misaki or espeak-ng backends) followed by neural synthesis and ONNX-based audio waveform generation via istftnet modules.

Converts text characters to phoneme sequences using a dual-backend architecture: misaki library as primary G2P engine for most languages, with espeak-ng fallback for Hindi and other languages requiring rule-based phonetic conversion. The text processing pipeline (in kokoro/pipeline.py) selects the appropriate G2P backend based on language code, handles text chunking for long inputs, and produces phoneme sequences that feed into neural synthesis.

Generates raw audio waveforms from phoneme token sequences using ONNX-optimized istftnet modules that perform inverse short-time Fourier transform (ISTFT) synthesis. The KModel class produces mel-spectrogram embeddings from phoneme tokens, which are then converted to linear spectrograms and finally to waveforms via the ONNX-compiled istftnet vocoder, enabling efficient CPU/GPU inference without PyTorch overhead.

Enables selection from multiple pre-trained voice styles (e.g., 'af_heart' for American female, various British voices) by conditioning the neural model with voice-specific embeddings. The KModel class accepts a voice identifier parameter that retrieves corresponding embeddings from HuggingFace Hub, which are concatenated with phoneme embeddings during synthesis to produce voice-specific speech characteristics without retraining the base model.

Provides parallel Python (KPipeline, KModel classes) and JavaScript (KokoroTTS class) implementations with identical functional semantics, enabling code portability and consistent behavior across environments. Both implementations share the same text processing pipeline, model inference logic, and audio synthesis approach, with language-specific optimizations (PyTorch for Python, ONNX.js for JavaScript) while maintaining API compatibility.

Provides CLI tools for text-to-speech synthesis without programmatic API usage, supporting both interactive input and batch file processing. The CLI wraps the KPipeline class, accepting text input via stdin or file arguments, language/voice parameters, and output file specifications, enabling integration into shell scripts and data processing pipelines.

Provides utilities (examples/export.py) to export the KModel neural network and istftnet vocoder to ONNX format for optimized inference across different hardware and runtime environments. The export process converts PyTorch models to ONNX intermediate representation, enabling deployment on ONNX Runtime (CPU, GPU, mobile) without PyTorch dependency, reducing model size and inference latency.

Implements generator-based processing pipeline that yields audio segments incrementally as they are synthesized, rather than buffering entire output. The KPipeline class returns Python generators that yield tuples of (graphemes, phonemes, audio_segment) for each text chunk, enabling memory-efficient processing of long texts and streaming output to audio devices or files.

Enables client-side text-to-speech synthesis in web browsers using ONNX.js runtime for neural model inference and Web Audio API for audio playback. The JavaScript KokoroTTS class implements the same pipeline as Python version but uses ONNX.js for model inference, avoiding server-side processing and enabling offline-capable web applications.

Automatically downloads and caches model weights, voice embeddings, and language-specific assets from HuggingFace Hub on first use, eliminating manual model management. The system uses HuggingFace's hub_download API to fetch the 82M parameter model, istftnet decoder, voice embeddings, and G2P resources, with local caching to avoid repeated downloads. Model versioning is handled via HuggingFace Hub's revision system, enabling easy updates and rollbacks without code changes.