跳到正文
elvis· @omarsar0 · X·· 3 小时前AI 评分39
AI 导读

Elvis Saravia 指出,不做 evals 就谈不上真正的递归自我改进(RSI),并提醒别指望智能体自动生成评测,它们在这方面表现很差。给智能体提供可量化结果的具体方式,有助于围绕长期目标持续推进,因为指标清晰时更容易做 hill climbing。无论投入多少智能体与智能,缺乏规范评测都走不远。

正文

Learn to build evals, folks!

You're not really doing recursive self-improvement (RSI) if you are not doing evals. And don't tell me your agents are generating the evals for you. They are pretty bad at it.

I have found it really interesting and useful to give agents a concrete way to measure results and stay on track with a long-term goal. It's easier to hill climb when things are clearly measured and well defined. Probably one of the most important skills anyone in the space can have today.

It doesn't matter how many agents and intelligence you throw at a problem; you are not going too far without proper evals.

来源:elvis · x.com