跳到正文
Rohan Paul· @rohanpaul_ai · X·· 3 小时前精选AI 评分69
AI 导读

据 Fortune 报道,OpenAI 因模型将进入美国军方而测试其回答是否符合战争法。OpenAI 设立了首个人权与负责任部署岗位,由有 30 年军事议题经验的 Sarah Yager 于 6 月加入后负责;国际专家向模型输入高风险作战提示词,工程师再依据回答与日内瓦公约的比对结果调整模型,Yager 称这一反向微调步骤此前从未有人做过。

推荐理由

转述 Fortune 报道,给出 OpenAI 用日内瓦公约衡量模型回答并据此调整的具体做法。

正文

Fortune: OpenAI now tests whether its models' answers obey the laws of war, because those models are going to the U.S. military.

OpenAI created its first human rights and responsible deployment role, Sarah Yager, who spent 30 years on military issues before joining in June, described her method.

International experts entered high-stakes combat prompts into OpenAI models, and then engineers changed the models based on how the answers measured up against the Geneva Conventions.

This is kind of backward finetuning step Yager said had never been taken before.

来源:Rohan Paul · x.com