跳到正文
dex· @dexhorthy · X·· 4 小时前AI 评分58
AI 导读

HumanLayer 的 Dex Horthy 发布 SlopCodeBench 最新测评,gpt-6 astra 以 16.3% strict 通过率居首,较 5 月 gpt-5.5 的 14.8% 略有提升,被测前沿模型 strict 通过率在 12.2%-16.3%,core 通过率 65.8%-74.0%。

正文

took a while to get these all collated together, but excited to share latest SlopCodeBench (scbench dot ai) findings. Shouts out @gorlanski for helping put this together - findings should make it into the main results leaderboard soon. https://x.com/i/article/2111206187945603072

来源:dex · x.com