跳到正文
dex· @dexhorthy · X·· 3 小时前AI 评分57
AI 导读

Dex Horthy 提出一种判断模型权重里已包含哪些知识的方法:让模型以极轻的引导为某任务生成详细的 skill,提示词就是平时会激活该 skill 的自然语言消息。然后阅读生成的 skill 内容,主要来自权重及 harness 提供的少量上下文(如代码库信息),若内容看起来正确就删掉该 skill,因为说明它已在权重中。这是对其引用的提问「如何知道权重里已有什么」的替代回答。

正文

Alternative - ask the model to make a detailed skill for some task, with very light steering. Basically just the natural language message you would normally expect to activate the skill.

Read the created skill contents (primarily from the weights and whatever light harness-supplied context it may have eg about your codebase)

If the skill contents look correct, delete the skill. It’s in the weights.

引用Carlos E. Perez@IntuitMachine
@dexhorthy How does one know what is already in the weights?
在 X 查看被引用的帖子

来源:dex · x.com