跳到正文
Yuchen Jin· @Yuchenj_UW · X·· 2 小时前AI 评分31
AI 导读

这也太酷了! 想象一下,用一个大语言模型直接编辑一个小模型的权重,大幅提升它的能力。 这就像给神经网络做基因编辑。比知识蒸馏还酷! (引用推文:我们让 GPT-6 Astra 编辑 Qwen3.5-0.8B 的权重以提升数学能力。它仅直接改动了 0.016% 的权重,就修复了 0.8B 的推理循环,数学能力最高提升 6 倍,指令遵循甚至提升 3 倍,全程无需梯度或训练。我们称之为 Weight-Space Programming:前沿 LLM 现在可以原生读写神经网络权重了!🧵 博客:https://rikiyat.github.io/blog/weight-space-programming/)

正文

This is cool as heck!

Imagine using a large LLM to directly edit a smaller model's weights and dramatically improve its capabilities.

It's like gene editing for neural networks. Even cooler than distillation!

引用Rikiya Takehi@rikiyatakehi
We asked GPT-6 Astra to edit Qwen3.5-0.8B weights to improve math. It directly changed only 0.016% of weights, fixing 0.8B's reasoning loops & improving math up to 6x and even instruction following 3x, without gradients or training. We call this Weight-Space Programming: frontier LLMs can now natively read/write neural network weights! 🧵 Blog: https://rikiyat.github.io/blog/weight-space-programming/
在 X 查看被引用的帖子

来源:Yuchen Jin · x.com