跳到正文
@rohanpaul_ai· @rohanpaul_ai · X·· 14 天前AI 评分46
AI 导读

VoiceArena 推出 Diarization Bench,在相同的真实音频和评分规则下对比 12 个说话人分离系统。 它揭示了当语音重叠和说话人增多时,准确率下降得有多快。 STT、TTS、对话式智能体,如今再加上说话人分离,全都在 @voicearena_ai 上 让我震惊的是那个 collar 效应:collar 其实就是说话人切换时的时间容差。 NVIDIA Nemotron 3 在 250 ms collar 下得分为 4.29% DER。把完全相同的输出按 0 ms 评分,就变成 14.72%。

正文

VoiceArena launched Diarization Bench to compare 12 diarization systems on the same real-world audio and scoring rules.
It exposes how quickly accuracy drops with overlap and more speakers.

STT, TTS, conversational agents, and now diarization, all on @voicearena_ai

The number that got me is the collar effect: the collar is simply the timing tolerance around a speaker change.

NVIDIA Nemotron 3 scores 4.29% DER with a 250 ms collar. Score the exact same output at 0 ms and it becomes 14.72%.

来源:@rohanpaul_ai · x.com