Overview
2U AMD EPYC 9005-series GPU server supporting up to 4x NVIDIA H200 NVL 141GB HBM3e or H100 NVL 94GB via PCIe 5.0 x16 with NVLink bridge pairing. Features 4x 2000W redundant power, dual 10GbE, and up to 768GB DDR5 ECC, targeting mid-scale LLM training and multi-GPU inference deployments.
Key Features
- 4x PCIe 5.0 x16 GPU slots supporting H200 NVL 141GB HBM3e, H100 NVL 94GB, or L40S 48GB
- NVLink bridge support for 2-GPU pairing
- AMD EPYC 9005 (up to 96 cores, 128MB cache) single socket
- Up to 768GB DDR5-5600 ECC RDIMM (12 DIMM slots)
- 4x 2000W power supplies; dual 10GbE RJ45
Ideal For
Research teams and enterprise AI groups scaling LLM training or multi-model inference with up to 4 high-memory datacenter GPUs in a 2U AMD EPYC chassis.
Barebone
- • 2U Server - 4 GPUs - 2x 2.5-inch NVMe - Dual-Port 10GbE (RJ45) - 4x 2000W Power
Processor
- • AMD EPYC™ 9124 Processor 16-core 3.00GHz 64MB Cache (200W)
- • AMD EPYC™ 9224 Processor 24-core 2.50GHz 64MB Cache (200W)
- • AMD EPYC™ 9254 Processor 24-core 2.90GHz 128MB Cache (200W)
- • AMD EPYC™ 9334 Processor 32-core 2.70GHz 128MB Cache (210W)
- • AMD EPYC™ 9354 Processor 32-core 3.25GHz 256MB Cache (280W)
- • AMD EPYC™ 9554 Processor 64-core 3.10GHz 256MB Cache (360W)
- • AMD EPYC™ 9654 Processor 96-core 2.40GHz 384MB Cache (360W)
- • AMD EPYC™ 9174F Processor 16-core 4.10GHz 256MB Cache (320W)
- • AMD EPYC™ 9274F Processor 24-core 4.05GHz 256MB Cache (320W)
- • AMD EPYC™ 9355P Processor 32-core 3.55GHz 256MB Cache (280W)
- • AMD EPYC™ 9455P Processor 48-core 3.15GHz 256MB Cache (300W)
- • AMD EPYC™ 9555P Processor 64-core 3.2GHz 256MB Cache (360W)
- • AMD EPYC™ 9655P Processor 96-core 2.6GHz 384MB Cache (400W)
- • AMD EPYC™ 9015 Processor 8-core 3.60GHz 64MB Cache (155W)
- • AMD EPYC™ 9115 Processor 16-core 2.60GHz 64MB Cache (155W)
- • AMD EPYC™ 9135 Processor 16-core 3.65GHz 64MB Cache (200W)
- • AMD EPYC™ 9175F Processor 16-core 4.2GHz 512MB Cache (320W)
- • AMD EPYC™ 9255 Processor 24-core 3.25GHz 128MB Cache (200W)
- • AMD EPYC™ 9275F Processor 24-core 4.1GHz 256MB Cache (320W)
- • AMD EPYC™ 9335 Processor 32-core 3.0GHz 128MB Cache (210W)
- • AMD EPYC™ 9355 Processor 32-core 3.55GHz 256MB Cache (280W)
- • AMD EPYC™ 9365 Processor 36-core 3.4GHz 192MB Cache (300W)
- • AMD EPYC™ 9375F Processor 32-core 3.8GHz 256MB Cache (320W)
- • AMD EPYC™ 9455 Processor 48-core 3.15GHz 256MB Cache (300W)
- • AMD EPYC™ 9475F Processor 48-core 3.65GHz 256MB Cache (400W)
- • AMD EPYC™ 9535 Processor 64-core 2.4GHz 256MB Cache (300W)
- • AMD EPYC™ 9555 Processor 64-core 3.2GHz 256MB Cache (360W)
- • AMD EPYC™ 9565 Processor 72-core 3.15GHz 384MB Cache (400W)
- • AMD EPYC™ 9575F Processor 64-core 3.3GHz 256MB Cache (400W)
- • AMD EPYC™ 9645 Processor 96-core 2.3GHz 256MB Cache (320W)
- • AMD EPYC™ 9655 Processor 96-core 2.6GHz 384MB Cache (400W)
- • AMD EPYC™ 9745 Processor 128-core 2.4GHz 256MB Cache (400W)
- • AMD EPYC™ 9825 Processor 144-core 2.2GHz 384MB Cache (390W)
- • AMD EPYC™ 9845 Processor 160-core 2.1GHz 320MB Cache (390W)
Memory
- • 16GB PC5-41600 5600MHz DDR5 ECC RDIMM
- • 32GB PC5-41600 5600MHz DDR5 ECC RDIMM
- • 64GB PC5-41600 5600MHz DDR5 ECC RDIMM
- • 128GB PC5-41600 5600MHz DDR5 ECC RDIMM
- • 16GB PC5-51200 6400MHz DDR5 ECC RDIMM
- • 32GB PC5-51200 6400MHz DDR5 ECC RDIMM
- • 64GB PC5-51200 6400MHz DDR5 ECC RDIMM
- • 128GB PC5-51200 6400MHz DDR5 ECC RDIMM
Server Management
- • Out of Band Server Management Software - IPMI and Redfish Compatible
Operating System
- • No Windows Operating System
- • Microsoft Windows Server 2025 Standard (16-core) (DSP)
- • Microsoft Windows Server 2025 Standard (24-core) (DSP)
- • Microsoft Windows Server 2025 Datacenter (16-core) (DSP)
- • Microsoft Windows Server 2025 Datacenter (24-core) (DSP)
- • CIQ Yearly Premium Support for Rocky Linux, Per Node, On Prem, 1-99 Nodes, 24/7 Web/Email/Slack Assist
- • CIQ Yearly Standard Support for Rocky Linux, Per Node, On Prem, 1-99 Nodes, 8-6 Web/Email HD
- • Rocky Linux 8.x (64-bit)
- • Rocky Linux 9.x (64-bit)
- • Debian Linux 12 (64-bit)
- • Fedora Linux 40 Server Edition (64-bit)
- • openSUSE Leap Linux 15.x (64-bit)
- • Ubuntu Linux 22.04 LTS Server Edition (64-bit)
- • Ubuntu Linux 24.04 LTS Server Edition (64-bit)
- • Red Hat® Enterprise Linux® 8 Server (Self Support) (1 Year)
- • Red Hat® Enterprise Linux® 8 Server (Standard) (1 Year)
- • Red Hat® Enterprise Linux® 8 Server (Premium) (1 Year)
- • Red Hat® Enterprise Linux® 9 Server (Self Support) (1 Year)
- • Red Hat® Enterprise Linux® 9 Server (Standard) (1 Year)
- • Red Hat® Enterprise Linux® 9 Server (Premium) (1 Year)
Assembly and Testing
- • System Assembly and Testing (Rackmount and Storage) (SYSBLD3)
Warranty
- • 5 Year Advanced Parts Replacement Warranty
- • 5 Year Advanced Parts Replacement Warranty with 1 Year Onsite
- • 5 Year Advanced Parts Replacement Warranty with 2 Year Onsite
- • 5 Year Advanced Parts Replacement Warranty with 3 Year Onsite
- • 5 Year Advanced Parts Replacement Warranty with 4 Year Onsite
- • 5 Year Advanced Parts Replacement Warranty with 5 Year Onsite
$25,360.00
Prices may vary. Verify on vendor site.
Quick Specs
- Barebone
- 2U Server - 4 GPUs - 2x 2.5-inch NVMe - Dual-Port 10GbE (RJ45) - 4x 2000W Power
- Processor
- AMD EPYC™ 9124 Processor 16-core 3.00GHz 64MB Cache (200W)
- Memory
- 16GB PC5-41600 5600MHz DDR5 ECC RDIMM
- Server Management
- Out of Band Server Management Software - IPMI and Redfish Compatible
- Operating System
- No Windows Operating System
- Assembly and Testing
- System Assembly and Testing (Rackmount and Storage) (SYSBLD3)
Tags
llm-trainingllm-inferencehpc