Overview
1u rackmount server with dual AMD EPYC processors and 6x L40S 48GB GPUs. Designed for large-scale AI training and multi-GPU deep learning workloads.
Key Features
- Dual AMD EPYC processors
- 6x L40S with 48GB VRAM
- PCIe 5.0 expansion support
- InfiniBand networking
- High-speed Ethernet networking
Ideal For
enterprise teams and research institutions and startups running large-scale AI training, multi-GPU workloads, and enterprise inference deployments.
Barebone
- • AMD EPYC™ 9004 Series - 1U - 10x NVMe/SATA/SAS - 1x AIOM - 1000W Redundant Power Supply
Processor
- • AMD EPYC™ 9124 Processor 16-core 3.00GHz 64MB Cache (200W)
- • AMD EPYC™ 9224 Processor 24-core 2.50GHz 64MB Cache (200W)
- • AMD EPYC™ 9254 Processor 24-core 2.90GHz 128MB Cache (200W)
- • AMD EPYC™ 9334 Processor 32-core 2.70GHz 128MB Cache (210W)
- • AMD EPYC™ 9354 Processor 32-core 3.25GHz 256MB Cache (280W)
- • AMD EPYC™ 9654 Processor 96-core 2.40GHz 384MB Cache (360W)
- • AMD EPYC™ 9355P Processor 32-core 3.55GHz 256MB Cache (280W)
- • AMD EPYC™ 9455P Processor 48-core 3.15GHz 256MB Cache (300W)
- • AMD EPYC™ 9655P Processor 96-core 2.6GHz 384MB Cache (400W)
- • AMD EPYC™ 9115 Processor 16-core 2.60GHz 64MB Cache (155W)
- • AMD EPYC™ 9135 Processor 16-core 3.65GHz 64MB Cache (200W)
- • AMD EPYC™ 9355 Processor 32-core 3.55GHz 256MB Cache (280W)
- • AMD EPYC™ 9365 Processor 36-core 3.4GHz 192MB Cache (300W)
- • AMD EPYC™ 9535 Processor 64-core 2.4GHz 256MB Cache (300W)
- • AMD EPYC™ 9655 Processor 96-core 2.6GHz 384MB Cache (400W)
- • AMD EPYC™ 9745 Processor 128-core 2.4GHz 256MB Cache (400W)
- • AMD EPYC™ 9845 Processor 160-core 2.1GHz 320MB Cache (390W)
Memory
- • 16GB PC5-41600 5600MHz DDR5 ECC RDIMM (Up To 24)
- • 32GB PC5-41600 5600MHz DDR5 ECC RDIMM (Up To 24)
- • 64GB PC5-41600 5600MHz DDR5 ECC RDIMM (Up To 24)
- • 96GB PC5-41600 5600MHz DDR5 ECC RDIMM (Up To 24)
- • 128GB PC5-41600 5600MHz DDR5 ECC RDIMM (Up To 24)
- • 16GB PC5-51200 6400MHz DDR5 ECC RDIMM (Up To 24)
- • 32GB PC5-51200 6400MHz DDR5 ECC RDIMM (Up To 24)
- • 64GB PC5-51200 6400MHz DDR5 ECC RDIMM (Up To 24)
- • 96GB PC5-51200 6400MHz DDR5 ECC RDIMM (Up To 24)
- • 128GB PC5-51200 6400MHz DDR5 ECC RDIMM (Up To 24)
- • 256GB PC5-51200 6400MHz DDR5 ECC RDIMM (Up To 24)
M.2 Drive
- • 480GB Micron 7450 PRO Series M.2 PCIe 4.0 x4 NVMe Solid State Drive (80mm) (Up To 2)
- • 960GB Micron 7450 PRO Series M.2 PCIe 4.0 x4 NVMe Solid State Drive (80mm) (Up To 2)
- • 1.92TB Micron 7450 PRO Series M.2 PCIe 4.0 x4 NVMe Solid State Drive (110mm) (Up To 2)
- • 3.84TB Micron 7450 PRO Series M.2 PCIe 4.0 x4 NVMe Solid State Drive (110mm) (Up To 2)
- • 400GB Micron 7450 MAX Series M.2 PCIe 4.0 x4 NVMe Solid State Drive (80mm) (Up To 2)
- • 800GB Micron 7450 MAX Series M.2 PCIe 4.0 x4 NVMe Solid State Drive (80mm) (Up To 2)
- • 960GB Samsung PM9A3 Series M.2 PCIe 4.0 x4 NVMe Solid State Drive (110mm) (Up To 2)
- • 1.92TB Samsung PM9A3 Series M.2 PCIe 4.0 x4 NVMe Solid State Drive (110mm) (Up To 2)
- • 3.84TB Samsung PM9A3 Series M.2 PCIe 4.0 x4 NVMe Solid State Drive (110mm) (Up To 2)
U.2/U.3 NVMe Drive
- • 1.6TB Solidigm SSD D7-P5620 Series U.2 PCIe 4.0 x4 NVMe Solid State Drive (Up To 12)
- • 3.2TB Solidigm SSD D7-P5620 Series U.2 PCIe 4.0 x4 NVMe Solid State Drive (Up To 12)
- • 6.4TB Solidigm SSD D7-P5620 Series U.2 PCIe 4.0 x4 NVMe Solid State Drive (Up To 12)
- • 12.8TB Solidigm SSD D7-P5620 Series U.2 PCIe 4.0 x4 NVMe Solid State Drive (Up To 12)
- • 960GB Micron 7450 PRO Series U.3 PCIe 4.0 x4 NVMe Solid State Drive (15mm) (Up To 12)
- • 1.92TB Micron 7450 PRO Series U.3 PCIe 4.0 x4 NVMe Solid State Drive (15mm) (Up To 12)
- • 3.84TB Micron 7450 PRO Series U.3 PCIe 4.0 x4 NVMe Solid State Drive (15mm) (Up To 12)
- • 7.68TB Micron 7450 PRO Series U.3 PCIe 4.0 x4 NVMe Solid State Drive (15mm) (Up To 12)
- • 15.36TB Micron 7450 PRO Series U.3 PCIe 4.0 x4 NVMe Solid State Drive (15mm) (Up To 12)
- • 800GB Micron 7450 MAX Series U.3 PCIe 4.0 x4 NVMe Solid State Drive (15mm) (Up To 12)
- • 1.6TB Micron 7450 MAX Series U.3 PCIe 4.0 x4 NVMe Solid State Drive (15mm) (Up To 12)
- • 3.2TB Micron 7450 MAX Series U.3 PCIe 4.0 x4 NVMe Solid State Drive (15mm) (Up To 12)
- • 6.4TB Micron 7450 MAX Series U.3 PCIe 4.0 x4 NVMe Solid State Drive (15mm) (Up To 12)
- • 12.8TB Micron 7450 MAX Series U.3 PCIe 4.0 x4 NVMe Solid State Drive (15mm) (Up To 12)
- • 7.68TB Micron 9400 PRO Series U.3 PCIe 4.0 x4 NVMe Solid State Drive (Up To 12)
- • 15.36TB Micron 9400 PRO Series U.3 PCIe 4.0 x4 NVMe Solid State Drive (Up To 12)
- • 30.72TB Micron 9400 PRO Series U.3 PCIe 4.0 x4 NVMe Solid State Drive (Up To 12)
- • 6.4TB Micron 9400 MAX Series U.3 PCIe 4.0 x4 NVMe Solid State Drive (Up To 12)
- • 12.8TB Micron 9400 MAX Series U.3 PCIe 4.0 x4 NVMe Solid State Drive (Up To 12)
- • 25.6TB Micron 9400 MAX Series U.3 PCIe 4.0 x4 NVMe Solid State Drive (Up To 12)
- • 960GB Kioxia CD6-R Series U.3 PCIe 4.0 x4 NVMe Solid State Drive (SIE) (Up To 12)
- • 1.92TB Kioxia CD6-R Series U.3 PCIe 4.0 x4 NVMe Solid State Drive (SIE) (Up To 12)
- • 3.84TB Kioxia CD6-R Series U.3 PCIe 4.0 x4 NVMe Solid State Drive (SIE) (Up To 12)
- • 7.68TB Kioxia CD6-R Series U.3 PCIe 4.0 x4 NVMe Solid State Drive (SIE) (Up To 12)
- • 15.36TB Kioxia CD6-R Series U.3 PCIe 4.0 x4 NVMe Solid State Drive (SIE) (Up To 12)
- • 800GB Kioxia CD6-V Series U.3 PCIe 4.0 x4 NVMe Solid State Drive (SIE) (Up To 12)
- • 3.2TB Kioxia CD6-V Series U.3 PCIe 4.0 x4 NVMe Solid State Drive (SIE) (Up To 12)
- • 6.4TB Kioxia CD6-V Series U.3 PCIe 4.0 x4 NVMe Solid State Drive (SIE) (Up To 12)
- • 12.8TB Kioxia CD6-V Series U.3 PCIe 4.0 x4 NVMe Solid State Drive (SIE) (Up To 12)
GPU Accelerator
- • NVIDIA® L4 ADA GPU Computing Accelerator - 24GB GDDR6X - PCIe 4.0 x16 - Passive Cooling (Up To 2)
- • NVIDIA® L40S ADA GPU Computing Accelerator - 48GB GDDR6 - PCIe 4.0 x16 - Passive Cooling (Up To 2)
- • NVIDIA® RTX 4000 Ada Generation - 20GB GDDR6 ECC - PCIe 4.0 x16 - Active Cooling (4xDP) (Up To 2)
Network Adapter
- • Broadcom NetXtreme 1-Gigabit Ethernet Network Adapter - PCIe 2.0 x1 - 2x RJ45 (Up To 3)
- • Broadcom NetXtreme 1-Gigabit Ethernet Network Adapter - PCIe 2.0 x4 - 4x RJ45 (Up To 3)
- • Broadcom NetXtreme 10-Gigabit Ethernet Network Adapter P210TP - PCIe 3.0 x8 - 2x RJ45 (Up To 3)
- • Broadcom NetXtreme 10-Gigabit Ethernet Network Adapter P210P - PCIe 3.0 x8 - 2x SFP+ (Up To 3)
- • Broadcom NetXtreme 25-Gigabit Ethernet Network Adapter P225P - PCIe 3.0 x8 - 2x SFP28 (Up To 3)
- • Broadcom NetXtreme 25-Gigabit Ethernet Network Adapter P425G - PCIe 4.0 x16 - 4x SFP28 (Up To 3)
- • Broadcom NetXtreme 50-Gigabit Ethernet Network Adapter P150P - PCIe 3.0 x8 - 1x QSFP28 (Up To 3)
- • Broadcom NetXtreme 100-Gigabit Ethernet Network Adapter P2100G - PCIe 4.0 x16 - 2x QSFP56 (Up To 3)
- • Broadcom NetXtreme 200-Gigabit Ethernet Network Adapter P1200G - PCIe 4.0 x16 - 1x QSFP56 (Up To 3)
- • Intel® 10-Gigabit Ethernet Network Adapter X710-T2L - PCIe 3.0 x8 - 2x RJ45 (Up To 3)
- • Intel® 10-Gigabit Ethernet Network Adapter X710-T4L - PCIe 3.0 x8 - 4x RJ45 (Up To 3)
- • Intel® 10-Gigabit Ethernet Network Adapter X710-DA2 - PCIe 3.0 x8 - 2x SFP+ (Up To 3)
- • Intel® 10-Gigabit Ethernet Network Adapter X710-DA4 - PCIe 3.0 x8 - 4x SFP+ (Up To 3)
- • Intel® 25-Gigabit Ethernet Network Adapter E810-XXVDA2 - PCIe 4.0 x8 - 2x SFP28 (Up To 3)
- • Intel® 25-Gigabit Ethernet Network Adapter E810-XXVDA4 - PCIe 4.0 x16 - 4x SFP28 (Up To 3)
- • Intel® 100-Gigabit Ethernet Network Adapter E810-CQDA1 - PCIe 4.0 x16 - 1x QSFP28 (Up To 3)
- • NVIDIA® ConnectX®-6 EN 200-Gigabit Ethernet Adapter - PCIe 4.0 x16 - 2x QSFP56 (Up To 3)
- • NVIDIA® ConnectX®-6 Dx EN 100-Gigabit Ethernet Adapter - PCIe 4.0 x16 - 2x QSFP56 (Up To 3)
- • NVIDIA® ConnectX®-7 200-Gigabit NDR200/HDR Adapter - PCIe 5.0 x16 - 2x QSFP112 - Crypto Disabled (Up To 3)
- • NVIDIA® ConnectX®-7 200-Gigabit Ethernet Adapter - PCIe 5.0 x16 - 2x QSFP112 - Crypto Enabled (Up To 3)
- • NVIDIA® ConnectX®-7 200-Gigabit NDR200 InfiniBand Adapter - PCIe 5.0 x16 - 1x OSFP - Crypto Disabled (Up To 3)
- • NVIDIA® ConnectX®-7 400-Gigabit NDR400 InfiniBand Adapter - PCIe 5.0 x16 - 1x OSFP - Crypto Disabled (Up To 3)
- • NVIDIA® ConnectX®-7 400-Gigabit NDR400 InfiniBand Adapter - PCIe 5.0 x16 - 1x OSFP - Crypto Enabled (Up To 3)
I/O Modules - Networking
- • Intel i350-AM2 Ethernet Adapter - Gigabit Ethernet 2x RJ45 - AIOM OCP 3.0 PCIe 2.1 x4
- • Supermicro AIOM OCP 3.0 - 2x 10GbE RJ45 - Intel X710-AT2 - PCI-E 3.0 x4 - AOC-ATGC-i2TM
- • Supermicro AIOM OCP 3.0 - 2x 10GbE RJ45 - Intel X550-AT2 - PCI-E 3.0 x4 - AOC-ATG-i2TM
- • Intel XL710-BM2 - 10 Gigabit Ethernet 2x SFP+ - AIOM OCP 3.0 PCIe 3.0 x8
- • Broadcom NetXtreme BCM57416 10-Gigabit Ethernet Adapter (2x RJ45) - AIOM PCIe 3.0 x8
- • Mellanox CX-6 LX - 2x 25GbE SFP28 - AIOM OCP 3.0 - PCIe 3.0 x8
- • Mellanox ConnectX-6 Dx - 2x 100GbE QSFP28 - AIOM OCP 3.0 - PCIe 4.0 x16
- • Broadcom BCM57508 - 2x 100GbE QSFP28 - AIOM OCP 3.0 - PCIe 4.0 x16
Trusted Platform Module
- • Trusted Platform Module - TPM 2.0 - Infineon 9670 - Not Provisioned - Vertical
Server Management
- • Thinkmate® Update Manager (OOB Management Package)
- • Thinkmate® Server Manager (Datacenter Management Package)
Cables
- • AC Power Cord (North America), C13, NEMA 5-15P, 3 ft. (Up To 99)
- • AC Power Cord (North America), C13, NEMA 5-15P, 6 ft. (Up To 99)
- • AC Power Cord (North America), C13, NEMA 5-15P, 10 ft (Up To 99)
- • IEC320 C13 to C14 Power Cable - 16AWG - 250V/13A - 1ft / 0.3M (TAA Compliant) (Up To 99)
- • IEC320 C13 to C14 Power Cable - 16AWG - 250V/13A - 2ft / 0.6M (TAA Compliant) (Up To 99)
- • IEC320 C13 to C14 Power Cable - 16AWG - 250V/13A - 3ft / 0.9M (TAA Compliant) (Up To 99)
- • IEC320 C13 to C14 Power Cable - 16AWG - 250V/13A - 4ft / 1.2M (TAA Compliant) (Up To 99)
- • IEC320 C13 to C14 Power Cable - 16AWG - 250V/13A - 6ft / 1.8M (TAA Compliant) (Up To 99)
Operating System
- • No Windows Operating System
- • Microsoft Windows Server 2022 Essentials (10-Core)
- • Microsoft Windows Server 2025 Standard (16-core) (DSP)
- • Microsoft Windows Server 2025 Standard (24-core) (DSP)
- • Microsoft Windows Server 2025 Datacenter (16-core) (DSP)
- • Microsoft Windows Server 2025 Datacenter (24-core) (DSP)
- • CIQ Yearly Premium Support for Rocky Linux, Per Node, On Prem, 1-99 Nodes, 24/7 Web/Email/Slack Assist
- • CIQ Yearly Standard Support for Rocky Linux, Per Node, On Prem, 1-99 Nodes, 8-6 Web/Email HD
- • Rocky Linux 8.x (64-bit)
- • Rocky Linux 9.x (64-bit)
- • Debian Linux 12 (64-bit)
- • Fedora Linux 40 Server Edition (64-bit)
- • openSUSE Leap Linux 15.x (64-bit)
- • Ubuntu Linux 22.04 LTS Server Edition (64-bit)
- • Ubuntu Linux 24.04 LTS Server Edition (64-bit)
- • Red Hat® Enterprise Linux® 8 Server (Self Support) (1 Year)
- • Red Hat® Enterprise Linux® 8 Server (Standard) (1 Year)
- • Red Hat® Enterprise Linux® 8 Server (Premium) (1 Year)
- • Red Hat® Enterprise Linux® 9 Server (Self Support) (1 Year)
- • Red Hat® Enterprise Linux® 9 Server (Standard) (1 Year)
- • Red Hat® Enterprise Linux® 9 Server (Premium) (1 Year)
Software
- • Downgrade Kit - Microsoft Windows Server 2025 Standard to 2022 Standard - COA and DVD Media (Up To 99)
- • 1-Device Client Access License (CAL) for Microsoft Windows Server 2025 (Up To 99)
- • 5-Device Client Access License (CAL) for Microsoft Windows Server 2025 (Up To 99)
- • 1-User Client Access License (CAL) for Microsoft Windows Server 2025 (Up To 99)
- • 5-User Client Access License (CAL) for Microsoft Windows Server 2025 (Up To 99)
- • Additional 2-core License for Microsoft Windows Server 2025 Standard (Up To 99)
- • Additional 4-core License for Microsoft Windows Server 2025 Standard (Up To 99)
- • Additional 16-core License for Microsoft Windows Server 2025 Standard (Up To 99)
- • Additional 2-core License for Microsoft Windows Server 2025 Datacenter (Up To 99)
- • Additional 4-core License for Microsoft Windows Server 2025 Datacenter (Up To 99)
- • Additional 16-core License for Microsoft Windows Server 2025 Datacenter (Up To 99)
Warranty
- • Thinkmate® 3 Year Depot Warranty (Return for Repair)
- • Thinkmate® 3 Year Advanced Parts Replacement Warranty (Zone 0)
- • Thinkmate® 3 Year Advanced Parts Replacement Warranty (Zone 1)
- • Thinkmate® 3 Year Advanced Parts Replacement Warranty (Zone 2)
- • Thinkmate® 3 Year Advanced Parts Replacement Warranty and NBD Onsite Service (Zone 0)
- • Thinkmate® 3 Year Advanced Parts Replacement Warranty and Onsite Service (Zone 1)
- • Thinkmate® 3 Year Advanced Parts Replacement Warranty and Onsite Service (Zone 2)
- • Thinkmate® 4 Year Advanced Parts Replacement Warranty (Zone 0)
- • Thinkmate® 4 Year Advanced Parts Replacement Warranty (Zone 1)
- • Thinkmate® 4 Year Advanced Parts Replacement Warranty (Zone 2)
- • Thinkmate® 4 Year Advanced Parts Replacement Warranty and NBD Onsite Service (Zone 0)
- • Thinkmate® 4 Year Advanced Parts Replacement Warranty and Onsite Service (Zone 1)
- • Thinkmate® 4 Year Advanced Parts Replacement Warranty and Onsite Service (Zone 2)
- • Thinkmate® 5 Year Advanced Parts Replacement Warranty (Zone 0)
- • Thinkmate® 5 Year Advanced Parts Replacement Warranty (Zone 1)
- • Thinkmate® 5 Year Advanced Parts Replacement Warranty (Zone 2)
- • Thinkmate® 5 Year Advanced Parts Replacement Warranty and NBD Onsite Service (Zone 0)
- • Thinkmate® 5 Year Advanced Parts Replacement Warranty and Onsite Service (Zone 1)
- • Thinkmate® 5 Year Advanced Parts Replacement Warranty and Onsite Service (Zone 2)
$12,359.00
Prices may vary. Verify on vendor site.
Quick Specs
- Barebone
- AMD EPYC™ 9004 Series - 1U - 10x NVMe/SATA/SAS - 1x AIOM - 1000W Redundant Power Supply
- Processor
- AMD EPYC™ 9124 Processor 16-core 3.00GHz 64MB Cache (200W)
- Memory
- 16GB PC5-41600 5600MHz DDR5 ECC RDIMM (Up To 24)
- M.2 Drive
- 480GB Micron 7450 PRO Series M.2 PCIe 4.0 x4 NVMe Solid State Drive (80mm) (Up To 2)
- U.2/U.3 NVMe Drive
- 1.6TB Solidigm SSD D7-P5620 Series U.2 PCIe 4.0 x4 NVMe Solid State Drive (Up To 12)
- GPU Accelerator
- NVIDIA® L4 ADA GPU Computing Accelerator - 24GB GDDR6X - PCIe 4.0 x16 - Passive Cooling (Up To 2)
Tags
llm-traininghpcsimulation
