AI 导读
前者受 FLOPs 限制，后者受集合通信限制（除非你在 NVL72 上）。所以，后者能让网络出问题时一目了然。(3/3) https://t.co/XRi7LX1EHn
正文
The former is FLOPs bound, the latter is collective bound (unless you’re on NVL72). So, the latter makes it plain to see when something is wrong with the network. (3/3) https://t.co/XRi7LX1EHn
来源：@SemiAnalysis_ · x.com