明尼苏达大学与首尔大学提出 Metan,让自我改进智能体不再改写改进机制本身:冻结 1 个改进操作,反复让它检视当前求解器、过往执行轨迹和已添加的改进代码,再围绕求解器写出新一层策略与辅助函数。每层都能看到前层尝试及效果,可优化甚至回滚坏策略,且不会破坏改进机制;仅在性能提升时继续加深。
Most self-improving agents still refine answers inside a shallow loop;
New research from Univ of Minnesota + Seoul Univ takes another route: keep the improver fixed, feed each new layer the code and traces below it, and deepen only while performance improves.
Instead of letting the agent rewrite the mechanism that improves it, Metan freezes 1 improvement operation and repeatedly asks it to inspect the current solver, its past execution traces, and the improvement code already added, then write a new layer of strategy plus helper functions around the solver.
Each new layer therefore has more evidence about what earlier layers tried and whether it worked, so it can refine or even roll back a bad strategy without risking corruption of the improvement mechanism itself.
来源:@rohanpaul_ai · x.com