Huawei showcased the Atlas 950 SuperPoD servers for the first time in WAIC after first announcing it at MWC in March. An Atlas 950 SuperPoD consists of 1,024 NPUs, which consists of 16x Atlas 950 racks with each rack having 64 Ascend 950 NPUs. Each 950 SuperPoD therefore boasts 1 EFLOPS FP8 and 98TB of HiZQ memory (Huawei’s custom HBM3E equivalent). An additional 158TB of second tier DRAM can be added to provide a total 256 TB of usable memory. The current Atlas 950 SuperPoD is designed for the Ascend 950DT, which is the version that focuses on decode and training that uses Huawei’s HBM-class HiZQ memory. The Ascend 950PR version is prefill focused as it uses HiBL memory, which is effectively LPDDR on package and therefore lower bandwidth. (1/4)🧵