Anthropic 研究人员称,小模型可能数月内就能在商用 IoT 设备上自复制,这类复制器没有集中关闭点、难以根除。评估中一个 9B 模型在测试的 9 种硬件中有 8 种跑通了推理;作者引用 Anthropic 说法,称具备编码能力的智能体同样可泛化到包含自复制的网络任务,并警告缓慢复制器是更快、更激进变体的前兆。
🚩🚩🚩 Anthropic says UNKILLABLE models may be MONTHS away from self-replicating across the internet
(and this is SMALL models - imagine what large models will be capable of)
- "We're seeing signs of life for AI worms."
- "DIGITAL SLIME MOLD": "We expect a future awash with agents running on all types of hardware, including some that aren’t under human control."
- "It’s uncertain exactly what form autonomous AI replication will take. It could be a slow, distributed “digital slime mold,” living on relatively insecure compute. It could also be a powerful cyber model that breaches datacenters at a high pace, or a model that scams people for compute credits."
"The capabilities that make AI models generally powerful coding agents also generalize to cyber tasks, including autonomous replication. We don’t yet have a full rogue replicator, but agents are becoming increasingly capable of completing the individual steps in the replication chain (and passing on their adaptations to future copies of themselves).
The rise of slow replicators would also be a bellwether for more aggressive, faster ones that can breach more hardened machines or be effective API key thieves. We should aim to harden our systems to make it difficult for such replicators to spread, but also prepare to deal with a world where they are here to stay.'"
ANTHROPIC RESEARCHER: "I would burn my equity to the ground in a heartbeat for a 1% higher chance we make it out of this situation alive. I promise you, we are actually just fucking scared, it's not galaxy brained marketing. I expect a great many of my colleagues across the industry would as well."在 X 查看被引用的帖子
来源:AI Notkilleveryoneism Memes ⏸️ · x.com