自建 Agent harness 能进一步压低 token 成本,因为开箱即用的 harness 过于臃肿,试图解决太多并非人人需要的功能,用户为此支付了高额溢价。可通过针对自身任务优化、更轻量的 system prompt、更高效的工具调用、更好的上下文压缩与交接、自定义路由调用不同模型、以及自定义验证器提升可靠性等方式实现。成本并非唯一考量,但自建 harness 的最大收益之一就是降本。
If you build your own harness, you can drive that cost down even further.
Out-of-the-box agent harnesses are, in my opinion, way too bloated. They try to solve way too many things that aren't useful for everyone.
You are paying a huge premium for no good reason.
While cost is not the only reason to build your own harness, it's one of the biggest benefits.
A few optimizations that make it possible:
- optimize for tasks you care about
- lighter and more optimal system prompt
- more efficient tool calling
- better context compaction/handoff
- leverage different models via custom routing
- improved reliability through custom verifiers
... and much more.
Just some quick thoughts on it, but I really think it's important for folks reading the OP to understand that token cost is not the only thing to consider in all of this.
来源:@omarsar0 · x.com