跳到正文
Qwen· @Alibaba_Qwen · X·· 4 小时前AI 评分41
AI 导读

恭喜 @lightseekorg 取得令人印象深刻的 TokenSpeed 成果!🚀 很高兴看到 Qwen3.8-Flash-Next 在 Nvida GPU 上达到每用户 685 output tokens/s。期待社区释放 Qwen 更多的推理潜力!

正文

Congrats to @lightseekorg on the impressive TokenSpeed results! 🚀 Great to see Qwen3.8-Flash-Next reaching 685 output tokens/s per user on Nvida GPUs. Excited to see the community unlock more of Qwen’s inference potential!

引用LightSeek Foundation@lightseekorg
685 output tokens/s per user on @Alibaba_Qwen Qwen3.8-Flash-Next. Running TokenSpeed on 4× NVIDIA GB300 with NVFP4. A look at the kernel and serving optimizations behind the results: 👉 https://lightseek.org/blog/tokenspeed-qwen3-8-flash-next.html ⭐ https://github.com/lightseekorg/tokenspeed
在 X 查看被引用的帖子

来源:Qwen · x.com