Meta 表示,6 月将下一代自主 AI 研究系统 AIRA₃ 投入 NVIDIA 主办的 Kaggle 竞赛,任务是微调 30B Nemotron 模型以提升推理能力,所有参赛者信息相同并按私有测试集外部评分。AIRA₃ 在约 4,000 支队伍中排第 8 获金牌,Meta 认为这表明 AIRA₃ 能以接近人类专家的水平改进模型的目标能力。
As a test of our progress to advance the frontier of AI research, in June we entered the next generation of our autonomous AI research system, AIRA₃, in a live Kaggle competition run by NVIDIA to fine-tune a 30B Nemotron model. The challenge was to teach the model to reason better — all competitors had access to the same information and were graded externally on a private test set.
AIRA₃ placed 8th out of ~4,000 teams to win Gold, outperforming human competitors who had access to the same frontier tools.
We believe this is a reliable signal that AIRA₃ can improve a targeted capability of an AI model at a level similar to human experts.
来源:AI at Meta · x.com