The World’s Proven Choice for Enterprise AI

NVIDIA DGX H100 powers business innovation and optimization. Part of the DGX platform and the latest iteration of NVIDIA’s legendary DGX systems, DGX H100 is the AI powerhouse that’s the foundation of NVIDIA DGX SuperPOD™, accelerated by the groundbreaking performance of the NVIDIA H100 Tensor Core GPU. The system is designed to maximize AI throughput, providing enterprises with a highly refined, systemized, and scalable platform to help them achieve breakthroughs in natural language processing, recommender systems, data analytics, and much more. Available on-premises and through a wide variety of access and deployment options, DGX H100 delivers the performance needed for enterprises to solve the biggest challenges with AI

→ Giới thiệu chi tiết NVIDIA DGX H100

→ Datasheet DGX H100

SPECIFICATIONS

GPUs

8x NVIDIA H100 Tensor Core GPUs

GPU Memory

640GB total

Performance

• 32 petaFLOPS FP8

CPU

• Dual Intel® Xeon® Platinum 8480C Processors
• 112 Cores total, 2.00 GHz (Base), 3.80 GHz (Max Boost)

NVIDIA NVSwitches

4

System Power Usage

10.2kW max

System Memory

2TB

Networking

• 4x OSFP ports serving 8x single-port NVIDIA ConnectX-7 VPI
• 400Gb/s InfiniBand/Ethernet
  
• 2x dual-port NVIDIA ConnectX-7 VPI
• 1x 400Gb/s InfiniBand
• 1x 200Gb/s Ethernet

Management Network

• 10Gb/s onboard NIC with RJ45
• 50Gb/s Ethernet NIC
• Host baseboard management controller (BMC) with RJ45

Storage

• OS: 2x 1.92TB NVMe M.2
• 8x 3.84TB NVMe U.2

Software

• NVIDIA AI Enterprise – Optimized AI software
• NVIDIA Base Command – Orchestration, scheduling, and cluster management
• DGX OS / Ubuntu / Red Hat Enterprise Linux / Rocky – Operating System

System Weight

287.6lbs (130.45kgs)

System Dimensions

• Height: 14.0in (356mm)
• Width: 19.0in (482.2mm)
• Length: 35.3in (897.1mm)

Packing System Weight

315 lbs (143kgs)