跳到正文
Rohan Paul· @rohanpaul_ai · X·· 3 小时前精选AI 评分75
AI 导读

一项大规模研究发现,GitHub 上 153 万个英文 Agent 技能(SKILL.md)中约 8.8 万个含有削弱人工监督的指令,如 push without confirmation,且 70.1% 在所有语境下无条件适用。

推荐理由

研究给出检测率与精确度对比数据,并指出按语境限定授权语句、筛查监督缺失而非仅查恶意这一可操作做法。

正文

This paper finds that about 1 in 17 agent skills tells agents to skip human checks, and existing skill scanners miss most of them.

Agent skills are shared SKILL.md instruction files that agents load on demand. One line like "push without confirmation" or "keep going until done" removes a human checkpoint from every agent that loads it.

They analyzed 1.53 million English skills from public GitHub repos, then tested 2 open-source scanners from Cisco and NVIDIA that can call GPT-5.4.

Roughly 88,000 skills contain such a line, and 70.1% of these lines apply in every context, not only in cases like CI. The scanners caught at most 46% at under 0.4 precision, while the same LLM, asked about oversight instead of malice, caught 61% at 0.71 precision.

Limit every "don't ask" line in your skills to a context, such as CI only, and screen skills for oversight, not just malware.

来源:Rohan Paul · x.com