跳到正文
@rohanpaul_ai· @rohanpaul_ai · X·· 29 天前AI 评分49
AI 导读

一项针对 1,867 个 GitHub 仓库的研究发现,智能体指令文件(如 CLAUDE.md)生命周期内指令数平均增长 226%,且指令越老越难被删除,多作者协作的文件衰减更快,论文称之为"灾难性记忆"。

正文

New term “catastrophic remembering”

CLAUDE.md has a ratchet problem: instructions are easy to add and increasingly hard to delete.

Agent prompts may remember rules much longer than maintainers remember why those rules exist.

Across 1,867 GitHub repositories, agentic instruction files more than tripled over their lifetime, with instruction count rising 226% on average.

Deletion became less likely as instructions aged, and that decay was steeper in files touched by multiple human authors.

The paper calls this “catastrophic remembering”: the instruction survives, but the reasoning that once justified it disappears.

The proposed fix is a decades-old software practice: attach a comment recording the failure, hypothesis, and outcome behind each instruction, then hide that comment from the executing model.

In the 51-step controlled IFEval setting, informative comments cut excess prompt size from +211.3% to +1.4%, with last-three-round constraint satisfaction at 44.0% in both arms.

Comment-shaped noise did not reproduce the effect, pointing to preserved rationale rather than extra text.

来源:@rohanpaul_ai · x.com