FP32

30.3 teraFLOPs

TF32 Tensor Core

120 teraFLOPS*

FP16 Tensor Core

242 teraFLOPS*

BFLOAT16 Tensor Core

242 teraFLOPS*

FP8 Tensor Core

485 teraFLOPs*

INT8 Tensor Core

485 TOPs*

GPU memory

24GB

GPU memory bandwidth

300GB/s

NVENC | NVDEC | JPEG decoders

2 | 4 | 4

Max thermal design power (TDP)

72W

Form factor

1-slot low-profile, PCIe

Interconnect

PCIe Gen4 x16 64GB/s

Server options

Partner and NVIDIA-Certified Systems with 1–8 GPUs