跳到正文
Ethan Mollick· @emollick · X·· 2 小时前AI 评分64
AI 导读

Artificial Analysis 将基准更新至 v5 并改用闭式基准(弃用 GDPval-AA),结果显示开源权重模型进一步落后。榜首 Kimi K3.1 Pro 得分 46,落后领先者 12 分,而 v4.3 中差距仅 3 分;已发布权重的 DeepSeek V4.1 Flash 1017(max)与 GLM-5.3(max)最高得 32,Claude Haiku 5.5(max)超过它们。差距在 HLE-Diamond 和 Terminal-Bench-Science 上最大,Kimi K3.1 Pro 分别为 37% 和 34%,Claude Opus 5.5(max)为 68%,GPT-6 Astra(max)为 63%。Mollick 提醒需谨慎看待,但符合目前还没出现 Fable 级开源模型的普遍观感。

正文

Artificial Analysis finally moves to closed benchmarks (goodbye GDPval-AA), and finds that open weights models are falling further behind than they had previously measured. Take with a grain of salt, but matches the general vibes that we haven't seen a Fable-class open model.

引用Artificial Analysis@ArtificialAnlys
Open weights models fall further behind in v5. The leader, Kimi K3.1 Pro (weights not yet released), scores 46, 12 points behind the leader, compared with a 3-point gap in v4.3. Of models with released weights, DeepSeek V4.1 Flash 1017 (max) and GLM-5.3 (max) score highest at 32, and Claude Haiku 5.5 (max) outscores all of them. The gap is widest on HLE-Diamond and Terminal-Bench-Science, where Kimi K3.1 Pro scores 37% and 34%, compared with 68% for Claude Opus 5.5 (max) and 63% for GPT-6 Astra (max).
在 X 查看被引用的帖子

来源:Ethan Mollick · x.com