"We still need humans at the moment but quite plausibly within a year we'll no longer need humans for doing research in many areas."

Jacob Coxon (ex Anthropic+Open AI researcher who resigned) on CNN, talking about Recursive self-improvement.

CNN: "When did your feelings about this technology change? Was it something about the rate of progress that you've seen?"

Jacob Coxon; "So I think it's really important to just look at the rate of progress and say, for example, in areas like coding or math, a couple years ago these AIs were just about helping humans a little bit. They could give you suggestions. Now they're close to replacing them.

We still need humans at the moment, but quite plausibly, within a year, we'll no longer need humans for doing research in many areas. Only on Tuesday, OpenAI solved a millennium problem, one of the biggest unsolved open problems in mathematics, purely autonomously using an AI.

And I think what's most scary is if AI is used to make itself more intelligent. So you can take an AI and give it the problem of AI research, just like currently they've given it math research. You could make it do the tasks that we're currently doing.

And then you get what's called an intelligence explosion. The AI just gets smarter and smarter with no human involvement necessary, until you have a thing that is vastly smarter than humans. And this could be coming very soon."

----

From "CNN" YouTube channel, (full video link in comment)