AI 导读
在顶级模型层面,真实世界的可用性远比 AA 上 +/- 2 分重要得多。这对一个模型来说需要一段时间才能理解,AA 在某种程度上是一种潜力,但有些模型能兑现,有些则不能(例如 opus 5 与 5.5)。看起来 3.1 可能更偏向不能兑现的那一侧。
正文
At the top end of models, real-world usability matters a lot more than +/- 2 points on AA. This takes a while to understand for a model, where AA is a sort of potential, but some models hit and some miss (e.g. opus 5 vs 5.5). Seems like 3.1 may be closer to the miss side.
OPENAI IS NO LONGER EVEN TOP 5 ON AA ANALYSIS AFTER KIMI K3.1在 X 查看被引用的帖子
来源:Nathan Lambert · x.com