NVIDIA L40S data center GPU, Ada

Part#: NVL40STCGPU-KIT
  • 48 GB GDDR6 GPU memory with ECC

  • 18,176 CUDA cores & 568 Tensor Cores

  • High-performance AI, graphics, and rendering

  • Enterprise-ready, 24/7 data center design

  • Supports vGPU, NVENC/NVDEC, and AV1

Specifications
GPU ArchitectureNVIDIA Ada Lovelace Architecture 
GPU Memory48GB GDDR6 with ECC 
Memory Bandwidth864 GB/s 
CUDA® Cores18,176 
RT Cores142 
Tensor Cores568 
RT Core Performance212 TFLOPS 
FP3291.6 TFLOPS 
 TF32 Tensor Core366 TFLOPS 
BFLOAT16 Tensor Core366 I 7332 TFLOPS 
FP16 Tensor Core366 I 7332 TFLOPS 
  FP8 Tensor Core733 I 14662 TFLOPS 
Peak INT8 Tensor733 I 14662 TOPS 
Peak INT4 Tensor733 I 14662 TOPS 
Form Factor4.4" (H) x 10.5" (L), dual slot 
Display Ports4 x DisplayPort 1.4a 
Max Power Consumption350W 
Power Connector16-pin 
ThermalPassive 
Virtual GPU (vGPU) Software SupportYes 
NVENC I NVDEC3x l 3x (Includes AV1 Encode and Decode) 
Secure Boot with Root of TrustYes 
NEBS ReadyLevel 3 
MIG SupportNo 
$7,122.00