Rohan Paul 引用 a16z 数据分析称,Agent 集群的新增 token 大多流向更便宜的模型,因此 Agent 的 token 用量增长将跑赢前沿模型收入。
Agent swarms send most new token volume to cheaper models, so agent token counts will outrun frontier-model revenue.
In a swarm, a parent agent plans while child agents handle narrow jobs like searching files or running tests. Narrow jobs are usually easy to check, so developers can route them to the cheapest model that passes.
And this massive token-explosion is also the major reason, flat-rate and per-seat pricing for AI software will give way to metering, because it relied on human prompting speed to cap usage.
A person sends only so many prompts a day, so vendors could charge per user and still predict inference bills.
But that equation will not hold with agent swarms working 24x7.
Your next users are machines Agents burn nearly 5x the tokens people do, up 14x in six months在 X 查看被引用的帖子
来源:Rohan Paul · x.com