10 obvious reasons that the danger from AGI is way more serious than nuclear weapons:

1) Nuclear weapons are not smarter than humanity.

2) Nuclear weapons are not self-replicating.

3) Nuclear weapons are not self-improving.

4) Scientists understand how nuclear weapons work.

5) You can calculate how powerful a nuclear weapon will be before setting it off.

6) A realistic full exchange between two nuclear powers wouldn't extinguish literally all of humanity.

7) It would be hard to do a full nuclear exchange by accident and without any human being having decided to do that.

8) The materials and factories for building nuclear weapons are relatively easy to spot.

9) The process for making one nuclear weapon doesn't let you deploy 100,000 of them immediately after.

10) Humanity understands that nuclear weapons are dangerous, politicians treat them seriously, and leading scientists can have actual conversations about the dangers.

(this was written by Eliezer in 2023 but it's a banger, still relevant, and few people see RTs)