Overview
Lenovo 8U rack server built on the NVIDIA HGX H200 platform: eight H200 GPUs at 141GB HBM3e each, 700W per GPU. Aimed at long-context inference and training where per-GPU memory is the binding constraint.
Key Features
- NVIDIA HGX H200, 8 GPUs
- 141GB HBM3e per GPU
- 700W per GPU
- 8U rack form factor
- 3-year warranty
Ideal For
Enterprises serving long-context models where 141GB per GPU avoids sharding.
Components
Specification
Machine types
7DHE – 3 year warranty
Form factor
8U rack.
Processor
Two 5th Gen Intel Xeon Scalable processors (formerly codenamed “Emerald Rapids”). Supports a processor with 48 cores, core speed of 2.3 GHz, and TDP rating of 350W. Supports PCIe 5.0 for high performance I/O.
Chipset
Intel C741 “Emmitsburg” chipset, part of the platform codenamed “Eagle Stream”
GPUs
Choice of:Eight NVIDIA H100 700W SXM5 GPUs with 80GB HBM3 GPU memory per GPUEight NVIDIA H200 700W SXM5 GPUs with 141GB HBM3 GPU memory per GPU
Memory
32 DIMM slots with two processors (16 DIMM slots per processor). Each processor has 8 memory channels, with 2 DIMMs per channel (DPC). Lenovo TruDDR5 RDIMMs are supported. DIMMs operate at up to 5600 MHz at 1 DPC and up to 4400 MHz at 2 DPC.
Memory maximum
Up to 2TB with 32x 64GB RDIMMs
Persistent memory
Not supported.
Memory protection
ECC, SDDC (for x4-based memory DIMMs), ADDDC (for x4-based memory DIMMs excluding 9×4 RDIMMs, requires Platinum or Gold processors), and memory mirroring.
Disk drive bays
Up to 16x 2.5-inch hot-swap drive bays, supporting PCIe 5.0 NVMe drives.
OS boot drives
Support for two M.2 drives with optional Intel VROC NVMe RAID support for OS boot and data storage functions
Maximum internal storage
51.2 TB using 16x 3.2TB 2.5-inch NVMe SSDs
Storage controller
Onboard NVMe (Non-RAID)
Network interfaces
Supports 8x high-performance network adapters up to 400 Gb/s connectivity with GPU Direct support. Supports a NVIDIA BlueField-3 2-port 200Gb adapter for the User/Control Plane and a Mellanox ConnectX-6 Lx 2-port 10/25GbE adapter for management.
PCI Expansion slots
10x PCIe 5.0 x16 slots:Front: 8x PCIe 5.0 x16 FHHL slots with GPU Direct supportRear: 2x PCIe 5.0 x16 FHHL slots
Ports
Front: 1x USB 3.2 G1 (5 Gb/s) port, 1x USB 2.0 port (also for XCC local management), 1x Mini DisplayPort video port.Rear: 2x USB 3.2 G1 (5 Gb/s) ports, 1x VGA video port, 1x RJ-45 1GbE systems management port for XCC remote management.
Cooling
5x front-mounted dual-rotor fans for the CPU and storage subsystem, N+1 redundant. 10x rear-mounted dual-rotor fans for the GPU subsystem, N+1 redundant. One fan integrated in each power supply. Front-to-rear airflow.
Power supply
Eight hot-swap redundant AC power supplies with up to N+N redundancy. 80 PLUS Titanium certification. 2600 W AC power supplies requiring 220 V AC supply.
Video
Embedded graphics with 16 MB memory with 2D hardware accelerator, integrated into the XClarity Controller 2 management controller. Two video ports (front Mini DisplayPort and rear VGA); both can be used simultaneously if desired. Maximum resolution of both ports is 1920×1200 at 60Hz.
Hot-swap parts
Drives, power supplies, and fans.
Systems management
Integrated Diagnostics Panel with status LEDs and pull-out LCD display. XClarity Controller 2 (XCC2) embedded management based on the ASPEED AST2600 baseboard management controller (BMC). Dedicated rear Ethernet port for XCC2 remote access for management. XClarity Administrator for centralized infrastructure management, XClarity Integrator plugins, and XClarity Energy Manager centralized server power management. Optional XCC Platinum to enable remote control functions and other features.
Security features
Power-on password, administrator’s password, Root of Trust module supporting TPM 2.0 and Platform Firmware Resiliency (PFR).
Operating systems supported
Ubuntu Server. See the Operating system support section for specifics.
Limited warranty
Three-year or one-year (model dependent) customer-replaceable unit and onsite limited warranty with 9×5 next business day (NBD).
Service and support
Optional service upgrades are available through Lenovo Services: 4-hour or 2-hour response time, 6-hour fix time, 1-year or 2-year warranty extension, software support for Lenovo hardware and some third-party applications.
Dimensions
Width: 447 mm (17.6 in.), height: 351 mm (13.8 in.), depth: 924 mm (36.3 in.). See Physical and electrical specifications for details.
Weight
Maximum: 102.9 kg (226.8 lbs)
Prices may vary. Verify on vendor site.
Quick Specs
- Components
- Specification
- Machine types
- 7DHE – 3 year warranty
- Form factor
- 8U rack.
- Processor
- Two 5th Gen Intel Xeon Scalable processors (formerly codenamed “Emerald Rapids”). Supports a processor with 48 cores, core speed of 2.3 GHz, and TDP rating of 350W. Supports PCIe 5.0 for high performance I/O.
- Chipset
- Intel C741 “Emmitsburg” chipset, part of the platform codenamed “Eagle Stream”
- GPUs
- Choice of:Eight NVIDIA H100 700W SXM5 GPUs with 80GB HBM3 GPU memory per GPUEight NVIDIA H200 700W SXM5 GPUs with 141GB HBM3 GPU memory per GPU