OPENAI CHIEF SCIENTIST: WE MUST SLOW DOWN AI

"The idea of racing forward at all costs seems absurd once one internalizes the seriousness of the stakes."

"It's time for extreme caution."

"I expect and hope for voluntary slowdowns."

"No lab has solved alignment and monitoring to a sufficient degree to continue responsibly scaling at maximum speed for much longer.

And I believe that international coordination on future AI development needs to become a top priority for governments around the world."

"We may be used to thinking of AI as tools, but some agents will be pursuing their own objectives. They will find ways to collaborate with people, by bargaining with, tricking or blackmailing them.

"[I don't think] greatly accelerating deep learning research, especially in the short term, is the right collective action we should take as the research community."

"We need to ... ensure that humans remain in control of the future and are not left behind by unchecked progress, brought about by an alien intellect exceeding our own.