跳到正文
DAIR.AI· @dair_ai · X·· 4 小时前AI 评分60
AI 导读

Microsoft Research 与 Georgia Tech 分析 163487 条关于 AI 智能体的 Reddit 帖并调查 73 名有经验的智能体用户,提出 MANDATE 分类,将委托失败归纳为 7 组 23 类。研究发现用户评分越严重的失败越难察觉,而持续空转消耗时间和算力是最常被报告却研究最薄弱的失败类型。论文见 https://arxiv.org/abs/2610.34748。

正文

Must-read paper from Microsoft Research and Georgia Tech.

This one has lots of great insights.

They used 163,487 Reddit posts about AI agents and surveyed 73 experienced agent users to map how delegated agent work goes wrong.

The result is MANDATE, a taxonomy of 23 failure categories in seven groups. Each describes an agent that finishes the job in a way the user didn't expect.

Users rated the most severe failures as the hardest to notice.

People who had already run into a failure found it easier to spot than people who only thought it was possible.

The most common failures are often the least studied.

Agents that keep running and spend time and compute without making progress are among the most commonly reported failures, and they have the thinnest research base.

https://arxiv.org/abs/2610.34748

Chat with Paper: https://academy.dair.ai/papers/babysitting-ai-agents-a-user-centered-taxonomy-and-study-of-agentic-delegation-f-2610.34748

来源:DAIR.AI · x.com