跳到正文
@rohanpaul_ai· @rohanpaul_ai · X·· 2026-08-26AI 评分40
AI 导读

一篇题为《Terminal Agents: A Survey of AI Agents in Command-Line Environments》的综述指出,模型外围的脚手架(harness)对基准分数的决定作用大于模型本身,因此脚手架选择应被视为一阶工程决策。

正文

The harness around a model decided more of the benchmark score than the model itself. So treat scaffold selection as a first-order engineering decision.

This survey pairs its synthesis with matched-task diagnostics, and finds system differences that are measurable while the model-variant differences are not.

A stronger model variant inside the same harness bought no extra resolved tasks, only latency.

– arxiv. org/abs/2608.20485

Title: "Terminal Agents: A Survey of AI Agents in Command-Line Environments"

来源:@rohanpaul_ai · x.com