Clone ANY Voice for Free — Qwen Just Changed Everything

Quick Overview

Qwen-TTS models, including the newly open-sourced Qwen3-TTS family featuring VoiceDesign, VoiceClone, and Generation capabilities, are demonstrated to achieve state-of-the-art performance across multilingual TTS tasks, offering fine-grained control over voice characteristics and supporting 10 languages and 9 dialects.

Key Points: Qwen3-TTS models are now fully open-sourced on GitHub and accessible via the Qwen API, supporting 10 main languages and 9 dialects. The Qwen3-TTS-12Hz-1.7B-VoiceDesign model allows users to describe voices using natural language instructions, creating entirely new voices. The Qwen3-TTS-12Hz-1.7B-Base model supports 3-second rapid voice cloning from reference audio. The CustomVoice model (1.7B and 0.6B variants) adds instruction control for emotion, tone, and speaking style (e.g., happy, sad, whispering, loud) on preset voices. The Qwen-TTS-Tokenizer-12Hz achieves state-of-the-art performance in speech reconstruction metrics like PESQ (3.21 wideband) and STOI (0.96), outperforming similar tokenizers. The demonstration includes generating multilingual speech, comparing different speaking styles, and showcasing the Voice Design workflow using a custom 'Wise Old Wizard' voice. The model architecture utilizes a dual-track LM architecture with two specialized tokenizers (Qwen3-TTS-Tokenizer-25Hz and Qwen-TTS-Tokenizer-12Hz) for efficient streaming generation.

Context: The video serves as a technical showcase and tutorial for the Qwen3-TTS family of text-to-speech models, recently released open-source by the Qwen Team. The presentation highlights the models' capabilities in multilingual synthesis, voice cloning, and fine-grained voice design via natural language instructions. It reviews the technical report, compares performance benchmarks against other leading models, and provides runnable code examples demonstrating basic TTS, multilingual output, emotion/style control, voice cloning from reference audio, and the reusable voice prompt workflow.