Overview
4u rackmount server with dual AMD EPYC processors. Optimized for AI inference and enterprise compute workloads.
Key Features
- Dual AMD EPYC processors
- H200 with 141GB VRAM
- PCIe 5.0 expansion support
- 4u rackmount form factor
Ideal For
enterprise teams and research institutions and startups running large-scale AI training, multi-GPU workloads, and enterprise inference deployments.
Processor & Chipset
- Number of Processors Supported: 2
- Processor Socket: Socket SP5 LGA-6096
- Processor Type: EPYC
- Processor Supported: 9005-Series, 9004-Series
- Thermal Design Power (TDP): 500 W
- Chipset Manufacturer: N/A
- Chipset Model: SoC
Memory
- Memory Technology: DDR5 SDRAM
- Memory Standard: DDR5-4800/PC5-38400
- Number of Total Memory Slots: 24
Controllers
- NVMe: Via SoC
Display & Graphics
- Graphics Controller Manufacturer: ASPEED
- Graphics Controller Model: AST2600
I/O Expansions
- PCI Express: 10x PCI-E 5.0 x16 + 2x x8 slots (Rear, Supports 10x double-wide cards), 1x PCI-E 5.0 x16 slot (Rear, Supports single-wide card), 2x PCI-E 5.0 x8 slot (Front, FHHL), 1x PCI-E 5.0 x8 OCP3.0 slot (Front), 2x PCI-E 3.0 x4 M.2 slots (22110/2280)
Drive Bays
- Hot-swap: 24x 2.5" Hot-swap drive bays, Default 16x NVMe, Optional 24x SATA/SAS, Requires additional controller card to support SATA/SAS
Interfaces/Ports
- Total Number of USB 3.2 Gen1 Ports: 6 (4x front, 2x rear)
- Number of NVMe Interfaces: 16x NVMe U.2, 2x NVMe M.2
- LAN: 2x 1000BASE-T RJ45 LAN Port (Front/Rear shared, 1GbE), 1x RJ45 IPMI dedicated LAN Port (Front/Rear shared, 1GbE)
- Onboard Video: 1x VGA Connector (Front/Rear)
Power Description
- Number of Power Supplies: 4
- Redundant Power Supplies: Yes (3+1)
- Maximum Power Supply Wattage: 3200 W
- Certification: 80 Plus Platinum
Physical Characteristics
- Color: Black
- Form Factor: Rack-mountable
- Rack Height: 4U
- Height: 6.9"
- Width: 17.2"
- Depth: 30.9"
$31,738.30
Prices may vary. Verify on vendor site.
Quick Specs
- Processor & Chipset
- 2
- Memory
- DDR5 SDRAM
- Controllers
- Via SoC
- Display & Graphics
- ASPEED
- I/O Expansions
- 10x PCI-E 5.0 x16 + 2x x8 slots (Rear, Supports 10x double-wide cards)
- Drive Bays
- 24x 2.5" Hot-swap drive bays
Tags
llm-traininggenerative-ai
