用 Jev 为 agent harness 的 /goal 功能构建自定义验证器,每轮对话后检查目标是否真正完成,使持续验证的成本低到可以规模化。此前这类验证由另一个昂贵的推理模型承担,现在可更频繁运行以保持智能体不跑偏。
One of the craziest use cases I’ve found for Jev: verifiers.
I am so excited about this that I at least wanted to share the high-level idea.
I used Jev to build a custom verifier for the /goal feature in my agent harness.
It checks whether the goal is actually complete after every turn, making continuous verification cheap enough to scale.
This means I can run more of these verifiers (previously handled by another expensive reasoning model) more frequently to keep the agents on track.
System One models are perfect for verification.
I think of this as scaling harnesses further by cleverly combining System One and System Two models.
I have a feeling this will enable a new wave of scalable test-time compute methods. Watch this space closely.
I've just started to experiment with this and am already seeing really good results. I need to explore and figure out a way to benchmark it. I will share more once I have more results.
This is an insane unlock for long-horizon agents.
You heard it here first. And you can expect to see more harnesses embracing this new pattern.
Full guide dropping in the next couple of days.
来源:@omarsar0 · x.com