微软论文提出 SocialRL,不再靠提示词让模型"更会谈判",而是用六种议价与日程博弈的交易结果训练模型。4B 模型学会低开价、守住立场并拒绝坏交易,六项博弈平均得分 0.627,追平 GPT-4.1 的 0.625。论文发现前沿模型会泄露用户预算、一遇卖家施压就妥协,而单纯提示反而让表现更差,因此这是训练层面的修复。
New Microsoft paper shows an AI agent that negotiates for you will usually lose, because it was trained to be agreeable.
Politeness, transparency and eagerness to close are great in a chat assistant and terrible in a delegate. The paper found frontier models leaking their user's budget and folding the moment a seller pushed back.
Their fix is SocialRL: instead of prompting the model to negotiate better, train it on the outcome of the deal across six bargaining and scheduling games.
It works, and it doesn't take a big model. A 4B model started anchoring low, holding its position and walking away from bad deals, and landed at 0.627 average across all six games, matching GPT-4.1 at 0.625.
The catch is that prompting alone made things worse, so this is a training fix, not a prompt fix.
So if you're building an agent that acts on someone's behalf, stop scoring it on whether the deal closed and start scoring it on what it gave away.
– arxiv. org/abs/2608.13787
Title: "From Passive Delegates to Strategic Negotiators: Reinforcing Social Reasoning in Small Language Models with SocialRL"
来源:@rohanpaul_ai · x.com