AI 导读
Artificial Analysis 上线 HLE-Diamond 榜单,对精炼后的 1,000 题 Humanity's Last Exam 做无工具独立评测。Gemini 4 Carbon (high) 以 69% 居首,Claude Opus 5.5 (max) 68%;仅约 13% 的模型超过 50%,开源权重模型最高的 Kimi K3.1 Pro 为 37%,落后 30 分以上。
正文
It's really cool to see that Gemini 4 Carbon is currently leading all the major benchmarks, such as the new HLE Diamond (no tools), with almost 70%. Competition at its best, your turn Anthropic and OpenAI.
We've launched our HLE-Diamond leaderboard, our independent evaluation of the refined 1,000-question version of Humanity's Last Exam, as part of v5 of the Artificial Analysis Intelligence Index HLE-Diamond was released by @CAIS and @scale_AI after a year of cleaning and refining the original Humanity's Last Exam dataset with input from the research community. It has 1,000 closed-ended questions, split evenly between reasoning and knowledge, and 272 of them include an image. We run every question once without tools, using the official HLE system prompt. GPT-5.6 Luna (medium) grades each answer against the reference answer with the official HLE judge prompt, and we report the share of questions judged correct (pass@1). Key takeaways: ➤ Only 17 model variants (~13%) score above 50% today: Gemini 4 Carbon (high) leads at 69%, followed by Claude Opus 5.5 (max) at 68% ➤ Models score higher on reasoning than on knowledge: Over 90% of the models we measured do better on the reasoning portion of the benchmark. Gemini 4 Carbon (high) leads both, at 80% on reasoning and 59% on knowledge. Claude Opus 5.5 (max) and GPT-6 Astra (max) both score 78% on reasoning, and Opus 5.5 is ahead on knowledge, 58% vs 50% ➤ Open weights models trail by more than 30 points: Kimi K3.1 Pro (weights not yet released) is the top open weights model at 37%, followed by MiniMax-M3.1-Flash at 28% and Kimi K3 (max) at 27%在 X 查看被引用的帖子
来源:Chubby♨️ · x.com