跳到正文
swyx· @swyx · X·· 2 小时前AI 评分64
AI 导读

Ricursive AI 发布 Ripple-65B Preview,一款从零预训练的 65B dense 模型,在 agentic coding 任务上超越 Muse Spark Open-816B、Beam-501B、Inkling-975B、Nemotron 3 Ultra-550B 等更大模型。swyx 引用其说明称全 R&D 成本仅 $32M,约为此前开源权重 SOTA 的十分之一,含预训练阶梯、数据混合、评测、合成数据与后训练等全部环节。详情见 https://www.ricursive.com/ripple。

正文

> we developed and trained Ripple-65B Preview for only $32M, which is one-tenth the cost of the previous open-weight SOTA on agentic coding¹

this is like the avengers of open model SOTA

¹ "Note that $32M is our full R&D cost starting from scratch, including pretraining ladder development, data mixing, evals, debugging, synthetic data generation, posttraining recipe development, and the final hero pretraining and posttraining run."

引用Ricursive Intelligence@RicursiveAI
Today we release Ripple-65B Preview, our 65B dense LLM we pretrained from scratch. Ripple sets a new state-of-the-art for U.S. open-weight models in agentic coding tasks, surpassing significantly larger models including Muse Spark Open-816B, Beam-501B, Inkling-975B, and Nemotron 3 Ultra-550B. Learn more: https://www.ricursive.com/ripple
在 X 查看被引用的帖子

来源:swyx · x.com