跳到正文
Epoch AI· @EpochAIResearch · X·· 1 小时前AI 评分33
AI 导读

我们已更新 Epoch Capabilities Index(ECI),改用贝叶斯方法。这改进了不确定性估计,让我们能更准确地比较模型,即使它们各自的 ECI 不确定性区间存在重叠。 前沿模型的分数基本未变:强于 GPT-4 的模型平均变动不到 1 个 ECI 点。

正文

We’ve updated the Epoch Capabilities Index (ECI) to use a Bayesian methodology. This improves uncertainty estimates and lets us compare models more accurately, even when their individual ECI uncertainty intervals overlap.

Frontier model scores are largely unchanged: models stronger than GPT-4 move by less than 1 ECI point on average.

来源:Epoch AI · x.com