Supermicro NVIDIA GB200 NVL72

Liquid Cooled Rack-Scale Solution with 72 NVIDIA B200 GPUs and 36 Grace CPUs

Key Applications

  • AI/Deep Learning Training and Inference

Key Features

  1. Rack-scale solution with NVIDIA GB200 Grace™ Blackwell Superchip providing 72 NVIDIA B200 GPUs and 36 Grace CPUs per rack
  2. Direct Liquid-Cooling for up to 40% reduction in electricity cost for the data center
  3. Comprehensive Service from consultation to full-scale deployment, providing all necessary parts, networking solutions, and onsite installation services
  4. Advanced Networking Ready supporting NVIDIA Quantum-2 InfiniBand or Spectrum-X Ethernet
Configure & Buy Specifications
Rack-Level Specifications
GPUs

72 NVIDIA B200 GPUs via NVIDIA GB200 Grace Blackwell Superchips 

CPUs36 NVIDIA Grace CPUs via NVIDIA GB200 Grace Blackwell Superchips
GPU memoryUp to 13.4 TB HBM3e
System MemoryUp to 17 TB LPDDR5X
Storage144 E1.S PCIe 5.0 drive bays
Rack Configuration
Nodes18x 1U ARS-121GL-NBO
Networking9x NVLink Switch, 4-ports per compute tray connecting 72 GPUs to provide 1.8TB/s GPU-to-GPU interconnect
Power8x 1U 33kW (6x 5.5kW PSUs), total power 132kW
Liquid Cooling1x in-rack Supermicro 250kW capacity CDU with redundant PSU and dual hot-swap pumps
Enclosure
Rack Enclosure48U, 19”-width
DimensionsW 600 x D 1068 x H 2236
Networking
  Compute FabricUp to 400Gb/s NVIDIA Quantum-2 InfiniBand or Spectrum-X Ethernet with NVIDIA ConnectX®-7 adapters or BlueField®-3 SuperNICs
   In-Band Network    Up to 200Gb/s In-Band Management speeds with NVIDIA BlueField-3 DPUs
   Out-of-band Network1G/10G Ethernet out-of-band management
Liquid Cooling
 Liquid Cooling Options

1x in-rack Supermicro 250kW capacity CDU with redundant PSU and dual hot-swap pumps

1.3MW capacity in-row CDU

180kW/240kW capacity liquid-to-air solutions for facilities without cooling tower and water supply

OPERATING SYSTEM
NTS AI Stack See what's inside each NTS AI package
Call for pricing