AI 导读
你的智能体 trace 就是最好的评估数据。 最重要的失败只会在生产环境中暴露，而它们很少会进入你的测试集。 DigitalOcean 的 Signals 会标记用户受挫或工具失败的会话，并一键将其转化为评估用例。随后，模拟会在你的智能体真实 harness 上针对你的修复方案进行回放，然后才正式上线。 如果你在生产环境中运行智能体，你需要这个闭环。 https://x.com/digitalocean/status/2109658818196242684/video/1
正文
Your agent traces are your best eval data.
The most important failures only show up in production, and they rarely make it into your test set.
DigitalOcean's Signals flags sessions where users got frustrated or tools failed and turns them into evals with one click. Simulations then replay them against your fix on your agent's real harness before it ships.
If you're running agents in production, you need this loop.
https://x.com/digitalocean/status/2109658818196242684/video/1
Catch it at the first user, not the four-hundredth. A new user’s bank link fails, the agent says “try again later,” and nothing shows up in the logs. Watch a team find the bug and fix it before anyone else hits it, with Agent Learning Services and Agent Data Services, launching today.在 X 查看被引用的帖子
来源：elvis · x.com