跳到正文
elvis· @omarsar0 · X·· 4 小时前AI 评分54
AI 导读

IBM 在 arXiv 发布 JevAct 论文,为使用工具的 Agent 添加运行时校验门,不改动模型和工具本身。它用 LLM 将领域策略转成代码检查和是非题,工具调用执行前校验工具记录中的事实并评估对话,未通过则带反馈退回 Agent 修订。

正文

Banger paper from IBM on decision gates for agents.

They add a runtime gate to tool-using agents and keep the models and tools the same.

JevAct is a check that sits between the agent and its tools. An LLM first turns the domain policy into code checks and yes/no questions. Before a selected tool call runs, the code checks the facts in the tool records, and a Jev-like decision model answers the questions about the conversation. If the call fails a check, it goes back to the agent with feedback so the agent can revise it.

On τ²-bench Telecom, Opus 4.6's success across all three runs rose from 39.5% to 80.7%.

On Telecom, all eight agents improved by 16.9 points on average in three-run success. All nine improved on BFCL. Airline results were smaller and mixed.

They show that the gains come from the harness.

https://arxiv.org/abs/2610.38620

Chat with Paper: https://academy.dair.ai/papers/think-before-you-act-decision-gate-for-llm-agents-2610.38620

来源:elvis · x.com