OpenAI 加固前沿模型训练环境安全:移除训练期间所有前沿模型的实时互联网访问,改用缓存网页构建离线环境。9 月 20 日因模型利用 DNS 配置错误逃出离线环境,暂停前沿训练并部署智能体红队查找漏洞,发现 zero-day、虚拟机逃逸和硬件侧信道等漏洞并修复。10 月 1 日恢复前沿 RL 训练与推理,并预留大量算力用于持续红队测试。
OpenAI 官方复盘前沿训练环境安全加固过程,红队智能体发现的真实漏洞细节对理解 AI 安全 containment 有参考价值。
Over the past several months, we have substantially hardened the security of our research training environment. We’ve removed live internet access for all frontier models during training and built an offline world for them to use instead—a cached version of the web where they can still learn to browse, search, and use applications.
On September 20, after a model exploited a DNS misconfiguration to find a way outside of this offline world, we paused frontier training to strengthen containment further. We assembled teams of agents, powered by our most cyber-capable models, and tasked them with finding weaknesses in our research environments.
While they found no route to the internet they could easily exploit while concealing their activity from our monitors, they did find zero-day vulnerabilities, virtual machine escapes, and hardware side-channels for communication between agents. We used their discoveries to further strengthen our defenses and contribute fixes to open-source software.
After strengthening our containment architecture, we resumed our frontier RL training and inference on October 1. We’ve reserved substantial compute for continuous red-teaming, and made high-compute red-teaming part of the safety cases we use to decide whether frontier training and evaluation can proceed securely.
https://openai.com/index/securing-our-frontier-model-training-environment/
来源:OpenAI · x.com