AI 导读
警报🚨 GB300 NVL72 的 NVLINK 背板在智能体推理上实现每美元性能比 Hopper 高 13 倍 通过极致的协同设计，GB300 NVL72 采用创新的铜背板，将 scale-up 域扩展到 72，而 Hopper 仅为 8。这使得 @vllm_project 的宽专家并行等优化成为可能，让每块 GPU 只需承载一部分专家。
正文
ALERT🚨 GB300 NVL72 NVLINK BACKPLANE ENABLES 13x BETTER PERF PER DOLLAR THAN HOPPER ON AGENTIC INFERENCE
Through extreme co-design, GB300 NVL72 uses an innovative copper backplane to expand the scale-up domain to 72 versus 8 on Hopper. This allows optimizations like @vllm_project wide expert parallelism, which allows each GPU to have only a subset of experts.
来源：@SemiAnalysis_ · x.com