跳到正文
@omarsar0· @omarsar0 · X·· 25 天前AI 评分30
AI 导读

Elvis Saravia 表示并不完全认同"模型会自己搞定 harness"的观点:动态工作流虽能体现部分能力,但模型在高度专业化、依赖大量先验知识与数据的场景中表现很差。他认为 harness 依然极其重要,需要能随新模型和新能力持续自我改进的流动式 harness,最好的 harness 是极简且自适应的,包含强上下文、工具、记忆、验证器和 evals,并为模型留出推理空间。

正文

To be clear, I don't necessarily agree with the post I am quoting. I see a growing trend of people saying that the models will figure out harnesses on their own. To some extent, yes. Just look into dynamic workflows, and you will see it. If you use them extensively, you will also notice how terrible models are at this. And it makes sense because models are generalized and fail miserably on highly specialized contexts or where a lot of prior knowledge and data is used. My point is that harnesses still matter enormously. We need more fluid harnesses that self-improve or continually improve as new models and capabilities land. This is indeed part of your intelligence stack as it stands. The best harnesses are minimal and adaptive: strong context, tools, memory, verifiers, and evals, with room for the model to reason.

来源:@omarsar0 · x.com