Servers for AI
Rackmount systems built to hold multiple datacenter GPUs, from single-accelerator 1U machines to 8-GPU HGX platforms.
408 products from 17 vendors, from $449 to $795,000 (median $31,488). Most common accelerators: H200, A100, B200, H100, B300.
What to compare
The number that matters is total GPU memory, not core count: a model must fit in VRAM before anything else is relevant. Check whether the listed price includes the GPUs — many vendors quote a base chassis — and whether the interconnect is NVLink or PCIe, which decides how well training scales past one card.
Who buys these
Teams training or serving models at a scale that has outgrown a workstation, and anyone comparing the real cost of owning against renting.
408 products
Quanta S7PH H100 GPU Server | D74H-7U (pre-configured)
Viperatech • Servers
Llm InferenceLlm Training
$288,650.00
Supermicro 10U B200 (SYS-A21GE-NBRT-G1)
Viperatech • Servers
Llm InferenceLlm Training
$750,000.00
SUPERMICRO 8x A100 AI AS-4124GO-NART+ Server
Viperatech • Servers
Multi GpuLlm InferenceLlm Training
$221,900.00
Supermicro GPU Superserver ARS-111GL-NHR, NVIDIA GH200 – USED
Viperatech • Servers
Small ModelLlm InferenceLlm Training
CPU: NVIDIA GH200 Grace Hopper™ Superchip
$55,000.00
Supermicro HGX H800 SuperServer SYS-821GE-TNHR
Viperatech • Servers
Small ModelLlm InferenceLlm Training
$291,000.00
Supermicro Rack Barebone – HGX 8x A100 SXM4 GPU – PCIe 4 – SYS-420GP-TNAR 4U
Viperatech • Servers
Multi GpuLlm InferenceLlm Training
CPU: Dual Socket P+ (LGA-4189), 3rd Gen Intel Xeon Scalable processors
RAM: 32 DIMM slots, up to 8TB ECC DDR4 3200MT/s
$165,000.00
Supermicro SuperServer SYS-522GA-NRT / AS -5126GS-TNRT RTX PRO 6000 System
Viperatech • Servers
Multi GpuLlm InferenceLlm Training
$126,000.00
Supermicro SuperServer SYS-522GA-NRT (Nvidia L40s System)
Viperatech • Servers
Multi GpuLlm InferenceLlm Training
$120,000.00
Supermicro SuperServer SYS-522GA-NRT (RTX PRO 6000/L40s System)
Viperatech • Servers
Multi GpuLlm InferenceLlm Training
$263,734.36
Supermicro SuperServer SYS-741GE-TNRT HGX H100 Server
Viperatech • Servers
Llm InferenceLlm Training
CPU: 8+4 Phase-switching voltage regulatorMonitors for CPU Cores, Chipset Voltages, Memory
RAM: Memory Capacity: 16 DIMM slotsUp to 4TB: 16x 256 GB DRAMMemory Type: 4800MHz ECC DDR5 DRAM
$56,500.00
SuperMicro SuperServer SYS-821GE-TNHR SXM5 640GB HGX H100
Viperatech • Servers
Llm InferenceLlm Training
$283,000.00
NVIDIA 920-24387-2540-000 NVIDIA DGX 8x H100 80GB SXM5 - New Open box
Alta Technologies • Servers
Multi GpuHpcLlm Training
$275,000.00
SuperMicro AS-4125GS-TNRT 2X EPYC 64C/ 1TB DDR5 / 8X Nvidia A100 80GB
Alta Technologies • Servers
Multi GpuHpcLlm Training
$167,000.00
Colfax CX10860s-E9B2 Server | NVIDIA HGX B200 8-GPU & 2x AMD EPYC 9005/9004 Series Processors
Colfax • Servers
Multi GpuHpcLlm Training
GPU: Supported GPU • NVIDIA HGX™ B200 8-GPU Baseboard CPU-GPU Interconnect • PCIe 5.0 x16 CPU-to-GPU Interconnect GPU-GPU Interconnect • NVIDIA NVLink™ with NVSwitch™
CPU: • Socket SP5 (2x LGA 6096) • 2x AMD EPYC™ 9004/9005 Series Processors • Supports CPU TDP up to 500W
RAM: • 24 DIMM Sockets • Max Memory (1DPC): - Up to 9TB 6000MT/s ECC DDR5 RDIMM (AMD EPYC™ 9005) - Up to 6TB 4800MT/s ECC DDR5 RDIMM (AMD EPYC™ 9004)
$417,811.77
Colfax CX10860s-X6B2 Server | NVIDIA HGX B200 8-GPU & 2x Intel Xeon 6900 Series Processors with P-cores
Colfax • Servers
Multi GpuHpcLlm Training
GPU: Supported GPU • NVIDIA HGX™ B200 8-GPU Baseboard CPU-GPU Interconnect • PCIe 5.0 x16 CPU-to-GPU Interconnect GPU-GPU Interconnect • NVIDIA NVLink™ with NVSwitch™
CPU: • Socket BR (LGA-7529) • Dual Intel® Xeon® 6900 series processors with P-cores • Supports CPU TDP up to 500W (Air-cooled)
RAM: • 24 DIMM Sockets • Max Memory (1DPC): - Up to 6TB 6400MT/s ECC DDR5 RDIMM - Up to 6TB 8800MT/s ECC DDR5 MRDIMM
$417,313.94
Colfax CX5860g-EK9 Server | NVIDIA HGX H200 8-GPU & 2x AMD EPYC 9004/9005 Series Processors
Colfax • Servers
Multi GpuHpcLlm Training
GPU: • Integrated in ASPEED AST2600 controller • 2D Video Graphic Adapter with PCIe bus interface • Resolution - up to 1920x1200@60Hz 32bpp, DDR4 SDRAM
CPU: • Socket SP5 (2x LGA 6096) • 2x AMD EPYC™ 9004/9005 Series Processors • Dual processor, cTDP up to 400W • At 25°C ambient, cTDP up to 500W
RAM: • 24x DIMM sockets • DDR5 memory supported only • 12-Channel memory per processor architecture • Memory speed: Up to 4800 MT/s
$290,027.50
Colfax CX5860g-XH2 Server with NVIDIA HGX H200 8-GPU
Colfax • Servers
HpcLlm TrainingLlm Inference
GPU: • Integrated in ASPEED AST2600 controller • 2D Video Graphic Adapter with PCIe bus interface • Resolution - up to 1920x1200@60Hz 32bpp, DDR4 SDRAM
CPU: • Dual Socket E (LGA-4677) • Supports 4th/5th Gen Intel® Xeon® Scalable processors • TDP up to 350W
RAM: • 32x DIMM sockets • DDR5 memory supported only • 8-Channel memory per processor architecture • Supports up to 128GB RDIMM / 256GB 3DS RDIMM modules • 5th Gen Intel® Xeon®: Up to 5600 MT/s (1DPC), 4400 MT/s (2DPC) • 4th Gen Intel® Xeon®: Up to 4800 MT/s (1DPC), 4400 MT/s (2DPC)
$311,187.50
Colfax CX8860g-E9B2 Server | NVIDIA HGX B200 8-GPU & 2x AMD EPYC 9005/9004 Series Processors
Colfax • Servers
Multi GpuHpcLlm Training
GPU: • Integrated in ASPEED AST2600 controller - 1x VGA port
CPU: • Socket SP5 (2x LGA 6096) • 2x AMD EPYC™ 9004/9005 Series Processors • Supports CPU cTDP up to 500W
RAM: • 24x DIMM sockets • DDR5 memory supported only • 12-channel memory architecture • Memory speed: - RDIMM: Up to 6000 MT/s (AMD EPYC™ 9005) - RDIMM: Up to 4800 MT/s (AMD EPYC™ 9004)
$397,887.61
Colfax CX8860g-E9B3 Server | NVIDIA HGX B300 8-GPU & 2x AMD EPYC 9005/9004 Series Processors
Colfax • Servers
Multi GpuHpcLlm Training
GPU: • Integrated in ASPEED AST2600 controller - 1x VGA port
CPU: • Socket E (2x LGA 6096) • 2x AMD EPYC™ 9005/9004 Series Processors • Supports CPU TDP up to 500W
RAM: • 24x DIMM sockets • DDR5 memory supported only • 12-channel memory architecture • Memory speed: AMD EPYC™ 9005: - Up to 6400 MT/s AMD EPYC™ 9004: - Up to 4800 MT/s
$478,900.17
Colfax CX8860g-X67B2 Server | NVIDIA HGX B200 8-GPU & 2x 6700P Gen Intel Xeon Scalable Processors
Colfax • Servers
HpcLlm TrainingLlm Inference
GPU: • Integrated in ASPEED AST2600 controller - 1x VGA port
CPU: • Socket E (2x LGA 4710) • 2x 6700P Gen Intel® Xeon® Scalable Processors • Supports CPU TDP up to 350W
RAM: • 32x DIMM sockets • DDR5 memory supported only • 8-channel memory architecture • Memory speed: - RDIMM: Up to 6400 MT/s (1DPC), 5200 MT/s (2DPC) - MRDIMM: Up to 8000 MT/s
$397,887.61
Colfax CX8860g-X67B3 Server | NVIDIA HGX B300 8-GPU & 2x 6700P Gen Intel Xeon Scalable Processors
Colfax • Servers
HpcLlm TrainingLlm Inference
GPU: • Integrated in ASPEED AST2600 controller - 1x VGA port
CPU: • Socket E (2x LGA 4710) • 2x 6700P Gen Intel® Xeon® Scalable Processors • Supports CPU TDP up to 350W
RAM: • 32x DIMM sockets • DDR5 memory supported only • 8-channel memory architecture • Memory speed: - RDIMM: Up to 6400 MT/s (1DPC), 5200 MT/s (2DPC) - MRDIMM: Up to 8000 MT/s
$478,900.17
Colfax CX8860g-X69B2 Server | NVIDIA HGX B200 8-GPU & 2x 6900P Gen Intel Xeon Scalable Processors
Colfax • Servers
HpcLlm TrainingLlm Inference
GPU: • Integrated in ASPEED AST2600 controller - 1x VGA port
CPU: • Socket E (2x LGA 7529) • 2x 6700P Gen Intel® Xeon® Scalable Processors • Supports CPU TDP up to 350W
RAM: • 24x DIMM sockets • DDR5 memory supported only • 12-channel memory architecture • Memory speed: - RDIMM: Up to 6400 MT/s - MRDIMM: Up to 8000 MT/s
$397,887.61
Colfax CX8860g-XK9 Server | NVIDIA HGX H200 8-GPU & 2x 6900P Gen Intel Xeon Scalable Processors
Colfax • Servers
Multi GpuHpcLlm Training
GPU: • NVIDIA HGX™ H200 with 8 x SXM GPUs
CPU: • 2x LGA 4677 (Socket E) • 5th Generation Intel® Xeon® Scalable Processors • 4th Generation Intel® Xeon® Scalable Processors • Intel® Xeon® CPU Max Series • Dual processor, TDP up to 350W
RAM: • 32x DIMM slots • DDR5 RDIMM memory supported • 8-channel memory per processor 5th Gen Intel® Xeon®: - RDIMM: Up to 5600 MT/s (1DPC), 4400 MT/s (2DPC) 4th Gen Intel® Xeon®: - RDIMM: Up to 4800 MT/s (1DPC), 4400 MT/s (2DPC) Intel® Xeon® Max Series: - RDIMM: Up to 4800 MT/s (1DPC), 4400 MT/s (2DPC) - 5600 MT/s support under 2DPC configuration requires verified memory and BIOS setup.
$304,417.62
Colfax CX8860s-X6B3 Server | NVIDIA HGX B300 8-GPU & 2x Intel Xeon 6700 Series Processors
Colfax • Servers
Multi GpuHpcLlm Training
GPU: - 1x VGA port - 1x mini-DP port
CPU: • Socket E2 (2x LGA 4710) • 2x Intel® Xeon® 6700 Series Processors • Supports CPU TDP up to 350W
RAM: • 32x DIMM sockets • DDR5 memory supported only • 8-channel memory architecture
$515,808.58