Overview
4u rackmount server with dual AMD EPYC processors and 8x H200 141GB GPUs. Designed for large-scale AI training and multi-GPU deep learning workloads.
Key Features
- Dual AMD EPYC processors
- 8x H200 with 141GB VRAM
- NVIDIA NVLink GPU interconnect
- PCIe 5.0 expansion support
- 4u rackmount form factor
Ideal For
enterprise teams and research institutions running large-scale AI training, multi-GPU workloads, and enterprise inference deployments.
Processor & Chipset
- Number of Processors Supported: 2
- Processor Socket: Socket SP5 LGA-6096
- Processor Type: EPYC
- Processor Supported: 9005-Series, 9004-Series
- Thermal Design Power (TDP): 500 W
- GPU: 8x NVIDIA H200 SXM
- Chipset Manufacturer: N/A
- Chipset Model: SoC
Memory
- Memory Technology: DDR5 SDRAM
- Memory Standard: DDR5-6000/PC4-48000
- Number of Total Memory Slots: 24
Controllers
- NVMe: Via SoC/PCIe Switch Board
Display & Graphics
- Graphics Controller Manufacturer: ASPEED
- Graphics Controller Model: AST2600
Network & Communication
- Ethernet Technology: 2x 1000BASE-T (1GbE, front or rear)
I/O Expansions
- PCI Express: 8x PCI-E 5.0 x16 HHHL slots, 1x PCI-E 5.0 x16 FHHL slot, 1x PCI-E 3.0 x2 or SATA M.2 slot (2280/22110), 1x PCI-E 3.0 x4 or SATA M.2 slot (2280/22110)
Drive Bays
- Hot-swap: 12x 2.5 hot-swap drive bays, Supports NVMe drives
Interfaces/Ports
- Total Number of USB 3.2 Gen1 Ports: 6 (4x Front, 2x Rear)
- Number of NVMe Interfaces: 12x U.2, 2x M.2
- LAN: 2x RJ45 1000BASE-T Ports (Shared with front and rear I/O), 1x RJ45 Dedicated IPMI Port (Shared with front and rear I/O)
- Onboard Video: 1x VGA Connector (Shared with front and rear I/O)
Power Description
- Number of Power Supplies: 8
- Redundant Power Supplies: Yes (4+4)
- Maximum Power Supply Wattage: 3002.4 W
- Certification: 80 Plus Titanium
Physical Characteristics
- Color: Black
- Form Factor: Rack-mountable
- Rack Height: 6U
- Height: 10.4"
- Width: 17.6"
- Depth: 36.6"
$251,416.00
Prices may vary. Verify on vendor site.
Quick Specs
- Processor & Chipset
- 2
- Memory
- DDR5 SDRAM
- Controllers
- Via SoC/PCIe Switch Board
- Display & Graphics
- ASPEED
- Network & Communication
- 2x 1000BASE-T (1GbE, front or rear)
- I/O Expansions
- 8x PCI-E 5.0 x16 HHHL slots
Tags
llm-traininggenerative-aihpcsimulation
