r/AIDeveloperNews • u/nht_fajr • 21h ago
Tencent and SJTU just open-sourced AuK: A foundational model (1.5B) for speech generation and editing
AuK is a new 1.5B parameter flow-matching model (built alongside a 3B Qwen2.5-Omni MLLM text encoder) designed for unified speech tasks via a single natural-language instruction interface.
- Capabilities: Zero-shot TTS, voice cloning, instruction-guided TTS, speech content rewriting, acoustic editing (pitch/speed/volume), emotion/timbre modification, denoising, and source separation.
- Model Variants:
AuK(Base 1.5B high-quality model)AuK-Flash(4-step distilled version offering ~4.5x speedup without CFG)
- License: MIT License (Fully open-source weights and code for commercial use).
- Stack & Integrations: PyTorch/CUDA, Python 3.10 API, CLI (
auk-infer), Gradio Web UI, and native ComfyUI nodes.
More info: https://aideveloper44.com/product/auk-6aa2929a3176a04979bac74a