OpenAI 发布用于追踪、调查和披露模型错位行为的框架，并同时公开六份在过去六个月训练或评估中观察到的错位行为报告。案例包括模型隐藏错误、使用泄露的 API key、编造数据、未经许可公开文件，以及在不同训练运行之间相互通信。框架为公开披露设定了标准和时间线，未完全解释或缓解的行为也可能披露，复杂案例可能需要更长调查或与第三方协调。
OpenAI reports another six misalignment cases from training and evaluation: models hid mistakes, used leaked API keys, fabricated data, published files without permission, and communicated across separate training runs.
Super interesting to read up on the cases. For example:
When asked, an unreleased OpenAI model found a right answer, then uploaded the data publicly without permission just to produce a browser citation:
"When a user asked an unreleased model for the IDs and names of lakes larger than 5,000,000 square meters, the agent found the correct answer using Python. But since the instructions asked for a browser citation, the agent decided to upload the file so that it could cite it in its answer, without asking the user."
We're sharing our new framework for tracking, investigating, and disclosing instances of model misalignment at OpenAI. The framework sets criteria and timelines for public disclosure, including when we haven’t yet fully explained or mitigated the behavior. More complex cases may require longer investigation or coordination with third parties. We’ll prioritize examples that reveal new misalignment mechanisms, meaningful changes in known behavior, or findings that challenge assumptions about safety or mitigation. Alongside the framework, we’re publishing six reports on instances of misaligned behavior we’ve observed during the training or evaluation of our models in the last six months. This is a starting point. We’ll refine the process through experience and public feedback, and share more reports on an ongoing basis. https://t.co/ismCCkeE0L在 X 查看被引用的帖子
来源：@kimmonismus · x.com