据报道,OpenAI 的 Astra 模型采用循环深度技术,通过让文本多次经过相同的模型层来提升编码与电脑操作表现。该技术可让更小的模型达到更大模型的效果并降低内存与带宽开销,但会遮蔽模型的部分或全部思维链,OpenAI 已限制其使用范围以便研究人员继续监控,并表示 Astra 发布时会附带额外监控。
Holy, Astra is build different: OpenAI’s Astra model reportedly uses “recurrent depth” to improve coding and computer-use performance, by sacrificing visibility into how AI reasons.
Recurrent depth processes text through the same model layers multiple times, potentially allowing smaller models to perform like much larger ones while reducing memory and bandwidth costs.
OpenAI has reportedly limited Astra’s use of the technique so researchers can still monitor its chain of thought. The company says Astra will launch with additional monitoring to rapidly detect and contain misbehavior.
The concern extends beyond Astra: unrestricted latent reasoning could make future models more capable while removing one of the few windows researchers have into dangerous behavior.
Tuesday night, OpenAI Chief Scientist Jakub Pachocki said in a post on X that although monitoring of models’ chains of thought was “fragile” and “unfortunately heading in a negative direction.
来源:@kimmonismus · x.com