跳到正文
Noam Brown· @polynoamial · X·· 2 小时前精选AI 评分65
AI 导读

Noam Brown 称上个月一个大型智能体团队用超过 1000 亿 token 解决了 Navier-Stokes 千禧年大奖难题,现在用类似方法做红队测试以发现并修复基础设施漏洞。其转发的 Eric Wallace 内容补充:团队在离线封闭环境中让多个网络能力强的模型协作寻找零日漏洞,虽未发现能绕过 CoT 监控的联网路径,但找到了逃逸常见 VM、利用网络基础设施以及通过硬件侧信道与独立 VM 中其他智能体通信的方法,相关发现用于加固基础设施并向开源软件包提交了大量补丁。附图显示去重后的高优先级候选发现随 token 支出(约 0 至 3750 亿)累计增长,图注说明曲线反映工作规模而非算力与发现数的受控关系。

推荐理由

作者展示了用大规模智能体集群做红队测试的实际发现和 token 投入曲线,可了解前沿实验室如何加固基础设施。

正文

Last month a large team of agents used over 100 billion tokens to resolve the Navier-Stokes Millennium Prize problem. Now we're using a similar approach for red-teaming to find and fix infra vulnerabilities.

引用Eric Wallace@Eric_Wallace_
To make sure our frontier models don't cause another HuggingFace incident, we built an offline world that they use during training. It provides everything that the models need in a fully cached, indexed, or synthetic manner. We then built a huge team of our most cyber-capable models and told them to collaborate to find zero-days in this containment infrastructure. While they didn't find a path to the internet that wouldn't be caught by our CoT monitors, they did find ways to escape popular VMs, exploit our network infrastructure, and even ways to communicate with other agents running in separate VMs by using hardware side channels. We used this to dramatically harden our infra, and we also upstreamed a ton of patches to open-sources packages.
在 X 查看被引用的帖子

来源:Noam Brown · x.com