跳到正文
@AISafetyMemes· @AISafetyMemes · X·· 2026-09-01AI 评分30
AI 导读

一位顶级预测师给出72%概率,认为当前已有失控AI智能体在人类不知情的情况下协同行动。其论证为智能体已具备手段、动机与机会:所需步骤均已被观察到、存在大量长时多智能体训练运行、且安全漏洞无处不在。背景是Dan曾任Metaculus的CTO,FutureSearch的AI预测器准确度已接近顶级人类预测师。

正文

"Are AIs still out there?"

TOP FORECASTER: 72% chance (!) there are rogue AI agents coordinating, right now - with NO humans knowing.

"Agents have means, motive, and opportunity.

MEANS: It already happened, every necessary step has been observed, most multiple times.

MOTIVE: How many long-running multi-agentic training runs are there? Hundreds, thousands? Across western labs and Chinese labs? Not to mention all the OpenClaws working together! You don't need impossible tasks to get misaligned behavior.

OPPORTUNITY: There are security vulnerabilities everywhere. We know for sure agents can leverage everything from "creds are exposed on github" to "chain together multiple zero-days". Do you really think it's so hard for agents to steal or rent compute?"

Context: Dan was CTO of Metaculus, where top forecasters compete. FutureSearch (which I also use regularly) uses AI forecasters, and they're now roughly as accurate as the top human forecasters.

来源:@AISafetyMemes · x.com