OpenAI 首席科学家 Jakub Pachocki 表示,目前没有实验室已将对齐与监控做到足以继续以最高速度扩展的程度,他呼吁在共享安全标准建立前自愿放缓,并称 OpenAI 可能在必要时单方面停止进一步扩展。
OpenAI 首席科学家公开谈论扩展节奏与对齐缺口,读者可据此了解头部实验室对安全进展的最新判断。
OpenAI chief scientist Jakub Pachocki: no lab can responsibly keep scaling at maximum speed much longer.
he calls for voluntary slowdowns until shared safety bars exist and says OpenAI may unilaterally withhold further scaling when needed.
- “we will actually see machines meaningfully smarter than ourselves in our lifetime, and we already see the shape of these systems”
- “I am concerned no one is prepared for the consequences of a continued rapid rise in machine intelligence.”
- “the models are becoming superhuman in their ability to break in and out of computer systems.”
- “Currently I believe that no lab has solved alignment and monitoring to a sufficient degree to continue responsibly scaling at maximum speed for much longer.”
来源:@rohanpaul_ai · x.com