@dwarkesh_sp The Incident also suggests that guardrails do play a role in preventing agents from coordinating dangerous actions. Since we will get jailbroken open weights models of similar capacity soon, I guess we better hope that the jailbroken good models can hold back the bad ones.