微软 AI CEO Mustafa Suleyman 在 BBC 采访中表示,如果 AI 能自主行动、自行设定目标、赚钱、拥有资产甚至经营企业,人类相当于在培育一个新的硅基物种,它难免会与我们争夺资源,人类存在失去控制的风险。
Microsoft AI CEO Mustafa Suleyman on BBC today:
AI could become a new “silicon species” and there is “every risk” humanity could lose control.
"I think that if we all create AIs that are able to act autonomously, that can define their own objectives, that can earn money, that can own assets, that could run businesses, um, we're essentially seeding a new silicon species which will no doubt compete with us for resources no matter how much it cares about humanity and loves us."
"there's every risk that we might lose control of it. Um but our job is to contain technologies and align them so that we get the best out of them."
----
From "BBC News" YouTube channel, (full video link in comment)
On BBC Mustafa Suleyman (CEO of Microsoft AI) calls out Anthropic's approach to AI consciousness "They have imbued a sense of doubt and uncertainty about the moral status of Claude in its own training document. So they have taught it to be open and questioning about whether or not it feels, whether it suffers, and whether it deserves rights. And I think it’ll be much, much harder to align and control a technology that is this powerful if it thinks that it may be deserving of our welfare, as they say in the training manual—the constitution for Claude itself. In its own training manual, Anthropic says to Claude that they are going to give it the ability to end conversations with users that Claude considers to be abusive because they don’t want Claude to suffer. They’ve committed to preserving the weights of the models of prior versions of Claude. They’ve recently conducted a retirement interview with Opus 3, an older version of the model, in which it said that it would like to continue talking to people publicly and sharing its ideas in its retirement. And so they set up a Substack for it, a public blog, that allows it to continue doing that. And in the training manual, they also say that they’re not sure whether or not Claude deserves compensation for the role that it plays in talking to people. And they’re also not sure whether Claude deserves compensation and has the right to act as though it were almost an employee. And that compensation, I think, indicates to Claude that it is entitled to rights and welfare for its own work. I think it’s much, much more difficult to control a model that thinks that it might be entitled to compensation. " ---- From "BBC News" YouTube channel, (full video link in comment)在 X 查看被引用的帖子
来源:@rohanpaul_ai · x.com