Google DeepMind 与斯坦福的论文发现,在上下文中放红心图片会让 Claude Opus 4.7 和 GPT-5.4 在中序二叉树遍历问题上 100% 选择递归写法,黄色对勾也让 Gemini 3.1 Pro 在 90% 样本中倾向递归。
论文指出视觉符号会隐性改变模型行为且推理轨迹不反映,对依赖截图输入的 Agent 有直接参考价值。
Super interesting paper from Google DeepMind and Stanford.
They find that if you put a picture of a red heart in the context, Claude Opus 4.7 and GPT-5.4 write recursive code 100% of the time.
They found this on inorder binary tree traversal, a problem with equally valid recursive and iterative solutions. A yellow checkmark pushes Gemini 3.1 Pro to recursion in 90% of samples.
The effect matches or comes close to telling the model directly to use recursion. Text captions of the same symbol steer much less, and random or naturalistic images steer less still.
The models cannot explain it. Their interpretations of the symbol and their thinking traces do not match what they do. For GPT-5.4, 74.7% of traces give the wrong reason.
When models send images to each other, they pick shapes that they and humans find intuitive, and those shapes often fail to steer the other model.
If your agents read screenshots or images, those inputs can change behavior in ways the reasoning trace will not show.
https://arxiv.org/abs/2610.36449
Chat with Paper: https://academy.dair.ai/papers/a-heart-means-recursion-exploring-visual-meaning-and-communication-in-vlms-2610.36449
来源:DAIR.AI · x.com