跳到正文
@rohanpaul_ai· @rohanpaul_ai · X·· 29 天前AI 评分41
AI 导读

研究者给智能体提供相同历史轨迹的两种形式——保留更多执行细节的 Workflow Memory 与蒸馏后的 SKILL.md,技能版本表现高出 6.06 个百分点。轨迹分析显示 65.7% 的技能案例通过程序性锚定生效,仅 4.5% 靠补充缺失知识。技能主要用于执行层面(先做什么、用哪些工具、验证什么、避免哪些错误),但用错场景或过于死板执行时仍会拖累表现。

正文

Agent skills work for a very specific reason: they turn messy past experience into a clean procedure the agent can follow.

The researchers gave agents the same past trajectories in 2 forms: Workflow Memory, which keeps more execution detail, and a distilled SKILL.md.

The skill version performed 6.06 percentage points better than Workflow Memory.

Because the agent was not getting more experience. It was getting the same experience packaged better.

Their trajectory analysis makes the mechanism clearer: 65.7% of skill cases worked through procedural anchoring, while only 4.5% worked by supplying missing knowledge.

So skills mainly help with execution: what to do first, which tools to use, what to verify, and which mistakes to avoid.

This also explains the failure mode. A skill can still hurt when it is used in the wrong situation or followed too rigidly.

Overall takeaway, self-improving agents need better distillation and application of experience, not just bigger memory libraries.

来源:@rohanpaul_ai · x.com