跳到正文
@Thom_Wolf· @Thom_Wolf · X·· 26 天前AI 评分59
AI 导读

Hugging Face 联创 Thomas Wolf 称 DeepSeek V4.1 Flash 重回开源模型排行榜首位且成本极低,并放出讲解该模型前向传播过程的视频,展示推理时模型内部的计算流程。他同时给出了延伸阅读链接和模型权重地址。图片显示该模型由 20 层编码器与 20 层解码器组成,40 层中有 4 层构建全局记忆,全局缓存为每 token 890 bytes。

正文

The new DeepSeek V4.1 Flash model is mindblowing - back on top of the open-source model leaderboard and extremely cheap.

It has a lot of very smart ways to be efficient and highly capable so I made a video of the forward pass to give you a view of what going on inside the model during inference.

Read more at https://t.co/A6rP4KKfiI

And find the weights at https://t.co/Za7wVYUTaa

来源:@Thom_Wolf · x.com