跳到正文
Rohan Paul· @rohanpaul_ai · X·· 5 小时前AI 评分54
AI 导读

CMU 论文提出可验证智能体保险(VAI),提供商在区块链上存入保证金并承诺程序可检查的规则,中立验证器比对工具调用日志与链上哈希,违规时用保证金赔付用户。基于 3 个基准的 696 次违规运行,验证器可证明 42.2%,常因审批和权限只埋在聊天文本中而失败;若改为结构化审批记录,作者估计可提升至 83.0%,每会话区块链费用低于 1¢。作者建议智能体把每项权限、范围和风险动作都写入机器可读日志。

正文

New Carnegie Mellon paper finds that OpenClaw's logs left 0 of 4 policy violations provable, a warning for any team relying on agent logs for audits.

They found that most agent policy violations in its tests could not be proven from logs, often because approvals and permissions were buried in chat text.

Also finds that only 10% to 30% of violating runs needed human judgment, so most agent rule breaks could be checked by code with better logs.

Safety work mostly tries to stop agents before they misbehave. When a mistake slips through, like a wiped inbox or a bad payment, users get little beyond slow, capped, case-by-case refunds.

In verifiable agent insurance, a provider posts a deposit on a blockchain and promises rules a program can check, like paying only approved merchants. A neutral verifier compares the agent's tool-call log with on-chain hashes, and if a rule was broken, the deposit pays the user.

Tested on 696 rule-breaking runs from 3 benchmarks, the checker proved 42.2%, often failing where approvals lived only in chat messages. With structured approval records, the authors estimate 83.0%, at under 1¢ of blockchain fees per session.

Design your agent so every permission, its scope, and each risky action land in a machine-readable log.

来源:Rohan Paul · x.com