AI 导读
Sam Altman 称 token 是"一种虚假的单位"：你可以数它们，但 token 数量并不能告诉企业它花的钱换来了什么。 为 token 辩护的唯一理由是信息论层面的：模型在输出信号的同时仍会输出噪声，一旦这些浪费被消除，token 数量就会接近香农下限，即承载实际信息所需的最小值。 ---- 完整视频见"Cheeky Pint"YouTube 频道，（链接在评论中）
正文
Sam Altman calls tokens “a kind of fake unit”: you can count them, but a token count does not tell a business what it got for the money.
The one defense of tokens is information-theoretic: models still stream noise along with signal, and once that waste is removed, token counts approach Shannon’s floor, the minimum needed to carry the actual information.
----
Full video on "Cheeky Pint" YouTube channel, (link in comment)
来源：Rohan Paul · x.com