AI 导读
DeepSeek 宣布将自研推理框架 DeepInfer 完全开源，该框架以高吞吐、低延迟支撑 DeepSeek-V4.1-Flash 的生产服务，代码在 github.com/deepseek-ai/DeepInfer。作者指出仅有模型权重不足以让 AI 便宜地跑起来，分享生产推理栈有助于社区降低算力与能耗成本，并提到 DeepInfer 可运行在华为芯片上而不仅限于 Nvidia。
推荐理由
作者补充了生产环境和华为芯片适配这一背景，读者可以据此评估开源推理框架对降低部署成本的意义。
正文
Let’s go: DeepSeek just open-sourced DeepInfer, the inference engine behind its production services.
Sharing this makes open models efficient at scale is a big deal: model weights alone don’t make AI cheap to run. But *this* helps.
Also notable: it runs on Huawei chips, not just Nvidia.
🚀 Introducing DeepInfer, our in-house inference framework, now fully open source! Powering DeepSeek-V4.1-Flash at scale with high throughput and low latency. We’re sharing our production stack to help the community lower compute costs, reduce energy use, and make AI more affordable. 🔗 http://github.com/deepseek-ai/DeepInfer 1/4在 X 查看被引用的帖子
来源：Chubby♨️ · x.com