Francois Chollet 认为,AI 进步可能让合成大流行能力扩散,这一风险真实存在且人类尚未准备好应对。他指出生物学不同于网络安全:网络安全完全可验证、可合成训练出超人能力,而生物学不可验证、能力仍依赖人类数据,且受湿实验室等非数字瓶颈制约。但他强调,合成大流行或许在无 AI 时已可行,AI 可能只是加剧其扩散。
Some people worry that the rapid AI progress driving the "AI cybersecurity revolution" of 2026 could soon spill over into biology, potentially leading to extinction-level synthetic pandemics.
While I would not panic, I would take the risk seriously.
Biology is obviously not the same as cybersecurity -- cybersecurity is a fully verifiable domain, where you can synthetically train unbounded capabilities, and therefore where superhuman skill is straightforwardly achievable. Meanwhile biology is not a verifiable domain, so capability remains critically dependent on human-generated data. Plus, biology has critical non-digital bottlenecks, such as the requirement for physical wet-lab experimentation.
However, it is plausible that synthetic pandemics were already feasible without AI, and that AI might lead to the proliferation of these capabilities. That is a real risk, and we are not prepared for it.
来源:@fchollet · x.com