Meta 在 Hugging Face 发布 Muse Spark Open 权重,为 816B 参数模型,面向编码和智能体任务,与 Muse Spark 1.3 共享同一基座并附加安全后训练。
原文给出 816B 模型的 MoE 结构、内存需求和实测 3-bit 量化运行数据,读者可据此评估本地部署可行性。
Meta released the weights of Muse Spark Open, on Huggingface, an 816B-parameter model built for coding and agentic work.
The open version shares the same base model as Muse Spark 1.3, with additional safety post-training to resist misuse as a standalone model without system guardrails, reversing Meta’s first proprietary, closed-weight frontier model strategy from April.
Each of its 62 layers holds 256 expert networks and routes every token through 8, so deployment needs the memory of an 816B-parameter model but runs at the speed of a 42B model.
That storage bill explains the Apple tie-up, because the M5 Ultra pushes 1.2 TB/s of unified memory and a Mac Studio can carry up to 512GB.
A 3-bit quant tested on a 512GB M3 Ultra took about 344 GB and ran at about 21 tok/s generation on a short prompt.
Muse Spark Open -- weights releasing today -- runs great on new Mac Studios thanks to work with @johnternus and Apple.在 X 查看被引用的帖子
来源:Rohan Paul · x.com