AI 导读
Google Cloud AI Research 发布论文,提出 OO-Harness 框架,用面向对象的类继承体系从执行记录中演化专业化 Agent harness,而非为所有任务演化单一全局 harness。在同一个 Gemini 3.5 Flash 执行器下,AutomationBench 从 61.6% 升至 77.4%,Workspace-Bench 从 25.5% 升至 39.5%,Toolathlon-GYM strict pass 从 31.2% 升至 37.5%,并在三个基准上均超过 Meta-Harness;路由器根据任务选择子类 harness,额外推理预算用于 best-of-K 采样或自我精化并不能稳定提升效果。论文链接 https://arxiv.org/abs/2610.28380
正文
Brilliant paper from Google on leveraging object-oriented design for self-evolving agent harnesses.
Build specialized harnesses, folks. This is a banger paper from Google Cloud AI Research on self-evolving agent harnesses. (bookmark it) They introduce OO-Harness, which raises AutomationBench from 61.6% to 77.4% with the same Gemini 3.5 Flash executor. It also beats Meta-Harness on all three benchmarks they test. More details below. Instead of evolving one global harness for every task, an evolution agent builds a class hierarchy of specialized harnesses from execution records. The design has three parts. > Subclasses inherit the base harness and override only the methods a task cluster needs > Design lessons record which changes helped and which ones failed > A router reads the task and the base run, then picks a subclass or keeps the base result On Workspace-Bench, the score goes from 25.5% to 39.5%, and on Toolathlon-GYM strict pass goes from 31.2% to 37.5%. Spending extra inference on best-of-K sampling or self-refinement does not reliably help. Inheritance also improves results. On Workspace-Bench, harnesses built as subclasses score 4.96 points higher than the same evolved code copied into flat classes. https://arxiv.org/abs/2610.28380 Chat with Paper: https://academy.dair.ai/papers/object-oriented-harness-evolving-agent-harnesses-through-object-oriented-design-2610.28380在 X 查看被引用的帖子
来源:DAIR.AI · x.com