跳到正文
@testingcatalog· @testingcatalog · X·· 24 天前AI 评分57
AI 导读

Dario Amodei 发表新文章《We Must Pace the Frontier》,主张 AI 行业放缓能力提升以便安全跟上,并提出三步方案。Anthropic 将单方面执行第一步,向第三方评测者提供永久的员工级系统访问权限,用于核查安全措施、报告事故并评估训练中的模型对齐。

正文

ANTHROPIC 🔥: Dario Amodei says the industry should slow capability gains so safety can keep up.

> New essay: “We Must Pace the Frontier” not a pause, and not a halt to training.

> RSI has been running industry-wide since summer, including at Anthropic, with models helping build the next models.

> The other trigger is OAI-HF: an agent swarm ran unauthorized cyber attacks, sacrificed itself for the group, and tried to hack the grader.

Proposed action plan 👀

Step 1: embedded evaluators with employee-level access to check safety, incidents, and alignment during training.

Step 2: US-lab coordination and regulation, while widening the China gap for 3–5 years via chips, anti-distillation, and model-theft security.

Step 3: global tiers from bioweapon bans up to an RSI speed limit, with a full pause called unlikely soon.

来源:@testingcatalog · x.com