跳到正文
Rohan Paul· @rohanpaul_ai · X·· 3 小时前精选AI 评分76
AI 导读

Moonshot AI 在 Huggingface 开源 Kimi K3.1 Pro 权重,共 2.8T 参数。模型以 4-bit 权重训练并按该精度发布,避免 16-bit 版本所需的 5.6TB 存储;每 token 仅激活 104B 参数,93 层中 69 层使用线性注意力,支持 1M token 上下文。

推荐理由

原文汇总了 Kimi K3.1 Pro 的权重精度、Terminal-Bench 成绩和许可条款,可帮助读者评估其实际部署与商用约束。

正文

Moonshot AI released the massive 2.8T-parameter Kimi K3.1 Pro weights on Huggingface.

On Terminal-Bench, its head-to-head with Claude 5.5

> Trained with 4-bit weights, it also ships at that precision, avoiding the 5.6TB a 16-bit copy would need.

> Moonshot traced steadily rising exploit skill to cyber content buried in its general mid-training corpus and RL environments, and removed both before opening the weights.

> In Moonshot’s own tests the model scores 65.7% on Terminal-Bench 4.0, near Claude Opus 5.5’s 66.4%, but without tools reaches only 39.4% on HLE-Diamond, against GPT-6 Astra’s 65.8%.

> Only 104B of its parameters fire per token, and 69 of its 93 layers use linear attention, which makes a 1M-token context cheaper to process.

> Its modified MIT license exempts internal use but makes model-hosting firms earning over $20M a year negotiate, reining in resellers that could undercut the company’s own API.

引用Kimi.ai@Kimi_Moonshot
Releasing the model weights of Kimi K3.1 Pro: https://huggingface.co/moonshotai/Kimi-K3.1-Pro We'll keep advancing open intelligence.
在 X 查看被引用的帖子

来源:Rohan Paul · x.com