NVIDIA DGX GH200 Grace Hopper Superchip Server
Servers

NVIDIA DGX GH200 Grace Hopper Superchip Server

Viperatech

Overview

NVIDIA DGX GH200 Grace Hopper Superchip Server is an AI server sold by Viperatech, built around H200.

Key Features

  • GPU: H200
  • 480GB system memory
  • Form factor: rack-server

Ideal For

teams who want a complete configured machine with published retail pricing

Specification

Details

Processor

NVIDIA GH200 Grace™ Hopper™ Superchip

Processor Family

NVIDIA Grace™ 72 Arm® Neoverse V2 cores

Max. TDP Support

1000W

Number of Processors

1 Processor

Internal Interconnect

NVIDIA® NVLink®-C2C 900GB/s

Form Factor

2U Rackmount

Dimensions (W x H x D)

17.24″ x 3.44″ x 35.43″ (inches) / 438 x 87.5 x 900 (mm)

Storage

4 E1.S NVMe SSDs

Memory

Up to 480GB LPDDRX embedded, 96GB HBM3 GPU memory

Expansion Slot

3 PCIe 5.0 x16 FHFL Dual Width slots (includes PCIE CX7 ADP NIC 2P 200G QSFP112)

Front I/O

Power/ID/Reset Buttons, Power/ID/Status LEDs, 2 USB 3.0 ports, 1 VGA port

Storage Controller

Broadcom HBA 9500 Series Storage Adaptor (includes 9500-16i HBA)

Power Supply

1+1 High efficiency hot-plug 2000W PSU, 80 Plus Titanium

Onboard Storage

2 22110/2280 PCIe M.2 (includes E1.S 1.92TB + M.2 960GB SSD)

Fan

5 6056 dual rotor fans (N+1 redundant)

Rear I/O

1 USB 3.0, 1 Mini display port, 1 ID LED, 1 PWR Button/PWR LED, 1 COM Port (micro USB type-B), 1 RJ45 mgmt port

Operating Environment

Operating temperature: 5°C to 35°C (41°F to 95°F), Non-operating temperature: -40°C to 70°C, Operating relative humidity: 20% to 85%RH, Non-operating relative humidity: 10% to 95%RH

TPM

TPM 2.0 SPI module (optional)

CPU and GPU

256x NVIDIA Grace Hopper Superchips

CPU Cores

18,432 Arm® Neoverse V2 Cores with SVE2 4X 128b

GPU Memory

144TB

Performance

1 exaFLOPS

Networking

256x OSFP single-port NVIDIA ConnectX®-7 VPI with 400Gb/s InfiniBand, 256x dual-port NVIDIA BlueField®-3 VPI with 200Gb/s InfiniBand and Ethernet, 24x NVIDIA Quantum-2 QM9700 InfiniBand Switches, 20x NVIDIA Spectrum™ SN2201 Ethernet Switches, 22x NVIDIA Spectrum SN3700 Ethernet Switches

NVIDIA NVLink Switch System

96x L1 NVIDIA NVLink Switches, 36x L2 NVIDIA NVLink Switches

Management Network

Host baseboard management controller (BMC) with RJ45

Software

NVIDIA AI Enterprise (optimized AI software), NVIDIA Base Command (orchestration, scheduling, and cluster management), DGX OS / Ubuntu / Red Hat Enterprise Linux / Rocky (operating system)

Support

Three-year business-standard hardware and software support

Power Efficiency

Uses NVIDIA Grace Hopper architecture for super power-efficient computing. Each NVIDIA Grace Hopper Superchip is both a CPU and GPU in one unit, connected with superfast NVIDIA NVLink-C2C. The Grace™ CPU uses LPDDR5X memory, which consumes one-eighth the power of traditional DDR5 system memory while providing 50 percent more bandwidth than eight-channel DDR5.

Integration

Fully tested and integrated solution with software, compute, and networking, that includes white-glove services spanning installation and infrastructure management to expert advice on optimizing workloads.

$410,000.00

Prices may vary. Verify on vendor site.

View on Viperatech →

Quick Specs

Specification
Details
Processor
NVIDIA GH200 Grace™ Hopper™ Superchip
Processor Family
NVIDIA Grace™ 72 Arm® Neoverse V2 cores
Max. TDP Support
1000W
Number of Processors
1 Processor
Internal Interconnect
NVIDIA® NVLink®-C2C 900GB/s

Tags

llm-inferencellm-training