Meta 的 ProPerAgent 框架在不改动模型权重的情况下,将主动式智能体的准确率从标准记忆基线的最高 15% 提升至 38%。该框架通过检索模块在图谱中查找过往经验与偏好,再由独立的 LLM 调用判断记忆是否值得此刻介入,去掉该过滤步骤后准确率从 37.3% 降至 24.0%。
Recommended work from Meta on harnesses for proactive agents.
The ProPerAgent harness raises accuracy from at most 15% with standard memory baselines to 38%, without changing the model's weights.
But this success requires both a useful response and correct timing.
The harness controls how personal memories reach the model as it observes the user's surroundings.
First, the model identifies objects in view. A retrieval module uses those objects to search a graph of past experiences, preferences, and constraints.
A separate LLM call then checks whether the retrieved memories justify offering help now. It filters out distracting or already resolved information and returns one concise piece of evidence, or nothing. The model uses that evidence and the current view to decide whether to speak or stay silent.
That filtering step matters. Removing it drops accuracy from 37.3% to 24.0% in an ablation. Across the full harness, unnecessary interventions on clips that require silence fall to 15.3%, compared with 77.3% or 84.0% for standard RAG in the two evaluation modes.
The harness also reaches 37.5% with Qwen3.8-27B without training. Additional RL training on that model raises accuracy to 42.4% by penalizing premature and repeated interventions.
For proactive assistants, the harness needs to check whether a memory warrants an interruption before passing it to the model.
Paper: https://arxiv.org/abs/2610.22671
Chat with Paper: https://academy.dair.ai/papers/properagent-toward-memory-driven-proactive-assistance-2610.22671
来源:DAIR.AI · x.com