Mistral 的 Mistral Large 4(Le Chonk,1T 参数、49B 激活、原生多模态)已上线 Arena。用户可在 Agent Arena 中用网络搜索、文件系统和终端工具测试其长程智能体任务表现,票数将参与评测,分数随后公布;该模型也可在 Code Arena 的 WebDev、Text 和 Vision 中使用。
Arena 上线 Mistral Large 4 并说明其评测方法,读者可以据此了解在真实智能体任务上如何投票和对比。
Mistral Large 4 by @MistralAI is now in the Arena!
Head to Agent Arena to test it out, and your votes will shape its evaluation. Scores coming soon.
In Agent Arena, we measure models on millions of real-world, long-horizon agentic tasks. Models can access web search, filesystem, and terminal tools to complete complex workflows. The leaderboard measures model performance on outcomes relative to the average model using a causal tracing methodology.
Mistral Large 4 is also available in Code Arena: WebDev, Text, and Vision.
Meet Mistral Large 4, aka Le Chonk. • 1T parameters, natively multimodal. 49B active. It is the best open weights model from US or Europe on aggregated benchmarks. • State-of-the-art on critical workloads, including cyber defense, manufacturing and finance and it surpasses closed frontier models on visual grounding. • Forged in Europe end-to-end and is deployable from Europe via our own Mistral Cloud infrastructure. • Available to all via API today. Working with cybersecurity partners privately. Open weights release end of October.在 X 查看被引用的帖子
来源:Arena.ai · x.com