跳到正文
elvis· @omarsar0 · X·· 2 小时前AI 评分39
AI 导读

孟加拉语上仅一次微调,WER 就从 85% 降到 7.65%。 这样的数字正是 80 家实验室在一周内申请授权 Monsoon 的原因。我最敬佩的是背后的规则:@voicearena_ai 只做能真正带来提升的数据集。大多数数据供应商做不到这一点。

正文

WER dropped from 85% to 7.65% on Bengali with one fine-tune.

Numbers like that are why 80 labs asked to license Monsoon in a week. What I respect most is the rule behind it: @voicearena_ai only builds a dataset if it moves the needle. Most data vendors can't say that.

引用Shobhit Banga@shobhitbanga
Crazy week for Voice Arena at Interspeech in Sydney. 80+ organisations have asked to license Monsoon ASR corpus since we launched it seven days ago. The most common reason why labs are interested: Monsoon promises results. When we decided to build datasets at Voice Arena, we set one rule. Either the dataset promises results, or we don't build it. Monsoon promises results. On Bengali FLEURS, fine-tuning Whisper Medium on Monsoon took its LLM word error rate from 85.27% down to 7.65%. The other thing labs like is that we give them access to our model API. They can test it on their own internal benchmarks and see for themselves whether it will improve their models. You can see the detailed results and get API access here: https://voicearena.com/datasets/monsoon#results Monsoon is 100,000 hours across 50 languages from around the world, and most of them are long-tail languages. 100 languages by February, 1,000 by the end of 2027. It's only the first dataset Voice Arena has launched. We are excited to keep working on the key problems that get us closer to the dream of machines that talk like humans.
在 X 查看被引用的帖子

来源:elvis · x.com