ElevenLabs 推出强制对齐模型 Cue,可将每个字符精确定位到音频时间轴,在 29 种语言的基准测试中准确率超过所有被测开源对齐器。Cue 单次即可处理任意长度录音,单 GPU 上约 0.5 秒对齐 1 小时音频,目前已驱动 ElevenLabs 全部语音转文字功能,并通过 Forced Alignment API 单独提供。
New from ElevenLabs research: Today we’re sharing more about Cue, our new forced alignment model. It places every character on the audio timeline with more precision than any other aligner we tested. That means the right words show up at the right time.
Forced alignment is the step that turns a transcript into timestamps. It’s how subtitles land on time, how dubbed lines match the speaker, and how clicking a word in a transcript jumps to the moment it was said. Most open-source aligners are built for short, clean clips in a limited set of languages. Cue is one model that handles recordings of any length in a single pass. On real-world audio, it was more accurate than every open-source aligner we tested in all 29 languages of our benchmark. It aligns an hour of audio in about half a second on one GPU.
Cue already powers every Speech to Text transcription on ElevenLabs, and it’s available on its own through the Forced Alignment API.
Read the full post: https://elevenlabs.io/blog/cue-aligner
来源:ElevenLabs · x.com