跳到正文
@rohanpaul_ai· @rohanpaul_ai · X·· 21 天前AI 评分54
AI 导读

微软 AI CEO Mustafa Suleyman 在 BBC 节目中批评 Anthropic 的训练方式,认为让 Claude 对自身是否具有感受、痛苦和权利保持怀疑,会使这一强大技术更难对齐和控制。他提到 Anthropic 在 Claude 的训练文档中允许 Claude 终止它认为辱骂性的对话,承诺保留旧版本 Claude 模型的权重,并为 Opus 3 举行退休访谈、开设 Substack 博客,还表示不确定 Claude 是否应因其工作获得报酬。Suleyman 认为,这种关于报酬的表述会让 Claude 觉得自己有权获得权利和福利。

正文

https://t.co/6lcdTrfg7p

引用@rohanpaul_ai@rohanpaul_ai
On BBC Mustafa Suleyman (CEO of Microsoft AI) calls out Anthropic's approach to AI consciousness "They have imbued a sense of doubt and uncertainty about the moral status of Claude in its own training document. So they have taught it to be open and questioning about whether or not it feels, whether it suffers, and whether it deserves rights. And I think it’ll be much, much harder to align and control a technology that is this powerful if it thinks that it may be deserving of our welfare, as they say in the training manual—the constitution for Claude itself. In its own training manual, Anthropic says to Claude that they are going to give it the ability to end conversations with users that Claude considers to be abusive because they don’t want Claude to suffer. They’ve committed to preserving the weights of the models of prior versions of Claude. They’ve recently conducted a retirement interview with Opus 3, an older version of the model, in which it said that it would like to continue talking to people publicly and sharing its ideas in its retirement. And so they set up a Substack for it, a public blog, that allows it to continue doing that. And in the training manual, they also say that they’re not sure whether or not Claude deserves compensation for the role that it plays in talking to people. And they’re also not sure whether Claude deserves compensation and has the right to act as though it were almost an employee. And that compensation, I think, indicates to Claude that it is entitled to rights and welfare for its own work. I think it’s much, much more difficult to control a model that thinks that it might be entitled to compensation. " ---- From "BBC News" YouTube channel, (full video link in comment)
在 X 查看被引用的帖子

来源:@rohanpaul_ai · x.com