跳到正文
Karina· @karinanguyen · X·· 3 小时前AI 评分32
AI 导读

Anthropic 至少自 2022 年起就由 @logangraham 牵头预警 AI 助力的网络攻击,但当时没有 VC 认真对待。Anthropic 还在 ChatGPT 真实事件让"模型过度迎合用户"风险大规模显现前几年就构建了谄媚评测(@EthanJPerez 等)。教训是:要在危害大规模显现前就认真对待 AI 风险的早期证据。

正文

Anthropic has been warning about AI-enabled cyberattacks at least since 2022, with @logangraham at the forefront of that work. Back then, no VC was taking it seriously. The paradox is that risks only feel real once they’re legible, but waiting for incidents is too late. Anthropic also built sycophancy evals (@EthanJPerez et al.) a couple years before real-world incidents with ChatGPT made the risks of models excessively agreeing with users legible at scale. The lesson is to take early evidence of AI risks seriously before harm at scale makes them impossible to ignore.

来源:Karina · x.com