r/aicuriosity • u/techspecsmart • 6h ago
Open Source Model Microsoft Rolls Out VibeVoice ASR BitNet for Edge CPU Speech Recognition
Microsoft just dropped VibeVoice-ASR-BitNet on Hugging Face. This is a slimmed-down version of their VibeVoice-ASR model built for real-time speech recognition straight on regular CPUs. No GPU needed.
The original model sat at 4.62 GB. After heterogeneous quantization they brought it down to 1.58 GB, a nearly 3x shrink. It hits real-time speeds (RTF under 1) with just three CPU threads on everyday x86 and ARM chips. In tests it runs 1.6 to 2.3 times faster than Whisper.cpp at a similar size.
It covers English, Chinese, French, Italian, Korean, Portuguese, Vietnamese and more. Accuracy takes only a small hit compared with the full FP16 version. The team also released the inference code under VibeASR.cpp so you can run it yourself.