跳到正文
@OpenBMB· @OpenBMB · X·· 2026-08-31AI 评分51
AI 导读

一位开发者推出开源项目 Video Dubbing Translator,基于面壁智能 VoxCPM2 把视频翻译成其他语言,同时保留原始说话人的音色。该项目整合 VoxCPM2 参考音色克隆、Whisper 转录与词级对齐、自动翻译以及可选的 LatentSync 口型同步,并采用本地优先处理以兼顾灵活性与隐私。流程覆盖从人声与背景音分离,到生成译制语音、重建最终视频的完整环节。

正文

🎙️ Can AI preserve your voice across languages? See how VoxCPM2 transforms a video into a natural AI dub.

A developer built an open-source Video Dubbing Translator, enabling users to translate videos into different languages while preserving the original speaker’s voice and the natural flow of the conversation.

Powered by VoxCPM2, this project combines voice cloning, speech recognition, translation, and video reconstruction into a complete AI dubbing workflow:

✨ Reference-voice cloning with VoxCPM2 to preserve speaker identity
✨ Whisper for accurate transcription and word-level alignment
✨ Automatic translation for multilingual content creation
✨ Optional lip-sync support with LatentSync
✨ Local-first processing for more flexible and private workflows

From separating vocals and background audio to generating translated speech and rebuilding the final video, the project provides an end-to-end pipeline for creating AI-dubbed content.

🔗 Explore it:
https://t.co/ln7yVCKMs1

🤗 Model:
https://t.co/38THCiSdsz

🎬 Turn on sound to compare the original clip and the VoxCPM2 dubbing result.👇

来源:@OpenBMB · x.com