AI 导读
很高兴看到这些真实世界的对比!💙 感谢你在测试中包含 MiniCPM5。看到小模型进步如此之大,令人兴奋!🚀
正文
Love seeing these real-world comparisons! 💙 Thanks for including MiniCPM5 in your tests. Exciting to see how far small models have come! 🚀
Small models are going through a real growth spurt right now. On my personal-agent tests (PA Core, reasoning on, RTX 3080), three models at 2B and under now land within 21 points of each other, and rubbing shoulders with older 4B/9B weights. Newest on the bench: Spark X2.6 1.7B from @SparkLLM - PA total: 172.3/300 - Tool calls: 30/30 in every run - Context recall: 9.3 at 8K, 8.7 at 16K, best of the three! - Schedule and draft (PA2): 98 and 100 in two runs, one 54 pulled the mean to 84 - Daily organization (PA1): 35.7, the weak spot Under 2B, three different strengths. @liquidai LFM3 plans, @SparkLLM Spark reads, @OpenBMB MiniCPM5 is the balanced one. Leave thinking on. With it off, Spark is a much weaker model on these tasks.在 X 查看被引用的帖子
来源:OpenBMB · x.com