Streaming Online Inference With Sliding Window Buffering

via “streaming-audio-transcription”

automatic-speech-recognition model by undefined. 49,28,734 downloads.

Unique: Implements streaming via sliding-window inference on the full encoder-decoder model without requiring a separate streaming-optimized architecture. Uses overlapping chunks (30s windows with 5s overlap) and context stitching to maintain transcript coherence while processing audio incrementally.

vs others: Simpler to implement than streaming-specific models (e.g., Conformer-based streaming ASR) because it reuses the standard Whisper architecture; however, introduces higher latency (2-5s) and lower accuracy (1-3% degradation) compared to true streaming models optimized for low-latency inference.

via “streaming-audio-chunking-with-context-windows”

automatic-speech-recognition model by undefined. 21,47,274 downloads.

Unique: Whisper base model does not natively support streaming, but can be adapted via sliding-window chunking with overlap-based context preservation, a pattern documented in community implementations but not built into the model

vs others: Simpler than training a streaming-capable model from scratch, though introduces boundary artifacts compared to native streaming architectures (e.g., RNN-T, Conformer with streaming attention)

via “streaming/online inference with sliding window buffering”

automatic-speech-recognition model by undefined. 12,62,349 downloads.

Unique: Adapts wav2vec2's transformer architecture for streaming by using a sliding window of cached encoder states, avoiding recomputation of earlier frames while maintaining sufficient context for accurate Korean phoneme recognition. Requires custom implementation of stateful inference not provided by standard transformers library.

vs others: Achieves lower latency than batch inference for real-time applications, while maintaining higher accuracy than simpler streaming approaches (e.g., frame-by-frame HMM-based ASR) due to transformer's global attention.

via “real-time-streaming-transcription-with-chunking”

automatic-speech-recognition model by undefined. 10,07,776 downloads.

Unique: Implements sliding window chunking with configurable overlap to balance latency vs. accuracy — the overlap allows the model to see context across chunk boundaries, reducing boundary artifacts compared to non-overlapping chunks while maintaining streaming capability.

vs others: Enables real-time transcription on consumer hardware (CPU or modest GPU) with acceptable latency, whereas full-audio processing requires buffering entire utterances and introduces unacceptable delays for interactive applications.

via “memory-efficient video diffusion inference with streaming frame output”

text-to-video model by undefined. 21,862 downloads.

Unique: Streaming frame output during diffusion is less common in T2V models compared to image generation; most T2V implementations buffer full video before output. This capability requires careful temporal consistency management to ensure early-stage noisy frames don't degrade final output quality, likely implemented through denoising schedule awareness or frame refinement passes.

vs others: Reduces peak memory usage compared to full-buffering approaches and enables real-time progress feedback, but with added complexity and potential temporal consistency trade-offs compared to standard batch inference

via “streaming/real-time transcription with sliding window buffering”

Port of OpenAI's Whisper model in C/C++. #opensource

Unique: Implements sliding window buffering with configurable overlap to maintain context across chunks, allowing Whisper (designed for full-audio processing) to work in streaming scenarios without architectural changes to the model

vs others: Simpler than streaming-native ASR models (Conformer, Squeezeformer) but with higher latency; trades latency for accuracy and multilingual support vs purpose-built streaming models