Lời nói, âm thanh & giọng nói

Qwen3-TTS: multilingual speech, voice design and cloning

QwenLM/Qwen3-TTS

An open speech model family from Qwen with preset speakers, text-driven voice design and reference-audio cloning for narration and speech applications.

Mở kho lưu trữ chính thức ↗
★ 13,4KSố sao
⑂ 1,7KFork
57Vấn đề đang mở
PythonNgôn ngữ
Apache-2.0Giấy phép
Q84Điểm biên tập

Tổng quan

Qwen3-TTS offers separate checkpoints for distinct speech workflows. The 1.7B VoiceDesign model creates voices from natural-language descriptions, CustomVoice provides preset speakers, and Base models accept reference audio for cloning. Choose the workflow before downloading weights: the model families expose different generation interfaces. Useful applications include product narration, course audio and interactive speech features with repeatable speaker settings.

Tính năng chính

  • Supports ten languages, including Chinese, English, Japanese and Korean.
  • Offers 0.6B and 1.7B model sizes.
  • CustomVoice includes nine preset speakers.
  • The 1.7B VoiceDesign checkpoint accepts voice descriptions.
  • Base supports reference-audio cloning and reusable voice prompts.
  • Includes Python APIs, a web demo and streaming generation capabilities.

Yêu cầu, cài đặt và bắt đầu nhanh

1. Create an isolated environment; the upstream guide recommends Python 3.12.
2. Run pip install -U qwen-tts.
3. Select a checkpoint from the official Qwen collection and allow storage for its weights.
4. Load it with Qwen3TTSModel using a device and precision appropriate to your hardware.
5. Match generate_custom_voice, generate_voice_design or generate_voice_clone to the checkpoint.
6. Generate and save a short sentence first, checking language, speaker and sample rate before processing longer scripts.

Cách sử dụng

For product narration, choose one preset speaker, split scripts at natural pauses and review names and technical terms before editing audio into the video. For cloning, use a clean reference recording that you have permission to use and supply its transcript as required by the API. Reuse the same voice prompt across segments, and retain the text, model identifier and generation settings so revised passages can be regenerated.

Implementation notes
Reference noise, accent and speaking style affect cloning. Review pauses between long-text segments. Measure first-audio latency and concurrency on the actual deployment hardware instead of treating upstream demonstrations as a service guarantee.

Khả năng tương thích của mô hình và trường hợp sử dụng

Requires Python, downloaded model weights and suitable compute. GPU and attention-backend compatibility depend on the environment. The 0.6B CustomVoice model does not offer the same instruction control as its 1.7B counterpart.

Ghi chú về giấy phép và rủi ro

The repository uses Apache-2.0. Check the selected checkpoint’s model card as well, and obtain appropriate rights to reference recordings.

ChatTTS

2noise/ChatTTS

★ 39,8KPython