Mark Zuckerberg 刚刚透露,Meta 已经在训练 Watermelon 之后的模型。 背景:Watermelon 是 Avocado/Spark 尚未发布的继任者,将是 Meta 迄今构建的最大模型。据报道,其训练所用算力约为 10 倍。 “我们正在用 Prometheus(Meta 的 1 吉瓦 AI 算力集群)来扩展 Watermelon 之后的模型。嗯,我们已经过了 Watermelon 阶段。” ---- 来自“Sources Podcast 和 @alexeheath YouTube 频道(完整视频链接见评论)”
Mark Zuckerberg just revealed that Meta is already training post-Watermelon models.
for context, Watermelon is the unreleased successor to Avocado/Spark, and will be the biggest model Meta has built so far. It’s reportedly being trained with roughly 10X more compute.
“We're using Prometheus (Meta’s 1-gigawatt AI compute cluster) to now scale the post-watermelon models. Um we're past watermelon.”
----
From "Sources Podcast and @alexeheath YouTube channel, (full video link in comment)
来源:@rohanpaul_ai · x.com