Servers for AI

Rackmount systems built to hold multiple datacenter GPUs, from single-accelerator 1U machines to 8-GPU HGX platforms.

408 products from 17 vendors, from $449 to $795,000 (median $31,488). Most common accelerators: H200, A100, B200, H100, B300.

What to compare

The number that matters is total GPU memory, not core count: a model must fit in VRAM before anything else is relevant. Check whether the listed price includes the GPUs — many vendors quote a base chassis — and whether the interconnect is NVLink or PCIe, which decides how well training scales past one card.

Who buys these

Teams training or serving models at a scale that has outgrown a workstation, and anyone comparing the real cost of owning against renting.

408 products
Supermicro 10U B200 Gold Series GPU Server (SYS-A21GE-NBRT-G1)

Supermicro 10U B200 Gold Series GPU Server (SYS-A21GE-NBRT-G1)

Viperatech • Servers
Multi GpuHpcModel Training
$792,000.00 +61.0%
GIGABYTE G893-ZD1-AAX5 HGX™ B200 8-GPU SERVER

GIGABYTE G893-ZD1-AAX5 HGX™ B200 8-GPU SERVER

Viperatech • Servers
Generative AiLlm TrainingLlm Inference
$795,000.00
Lenovo NVIDIA HGX H200 141GB 700W 8-GPU Server

Lenovo NVIDIA HGX H200 141GB 700W 8-GPU Server

Viperatech • Servers
Small ModelHpcLlm Training
GPU: Embedded graphics with 16 MB memory with 2D hardware accelerator, integrated into the XClarity Controller 2 management controller. Two video ports (front Mini DisplayPort and rear VGA); both can be used simultaneously if desired. Maximum resolution of both ports is 1920×1200 at 60Hz.
CPU: Two 5th Gen Intel Xeon Scalable processors (formerly codenamed “Emerald Rapids”). Supports a processor with 48 cores, core speed of 2.3 GHz, and TDP rating of 350W. Supports PCIe 5.0 for high performance I/O.
RAM: 32 DIMM slots with two processors (16 DIMM slots per processor). Each processor has 8 memory channels, with 2 DIMMs per channel (DPC). Lenovo TruDDR5 RDIMMs are supported. DIMMs operate at up to 5600 MHz at 1 DPC and up to 4400 MHz at 2 DPC.
$367,000.00
Quanta S7PH H200 GPU Server D74H-7U Barebone

Quanta S7PH H200 GPU Server D74H-7U Barebone

Viperatech • Servers
HpcLlm TrainingLlm Inference
$653,000.00
Supermicro Nvidia H200 SYS-821GE-TNHR(8U X13 8GPU) AI Server Bundle

Supermicro Nvidia H200 SYS-821GE-TNHR(8U X13 8GPU) AI Server Bundle

Viperatech • Servers
Generative AiLlm TrainingLlm Inference
$609,000.00
CyberServe EPYC EP2 208G-4NVMe GPU AI G5

CyberServe EPYC EP2 208G-4NVMe GPU AI G5

Broadberry • Servers
Multi GpuLlm InferenceLlm Training
$22,896.00
CyberServe Xeon SP1-208G GPU AI G6

CyberServe Xeon SP1-208G GPU AI G6

Broadberry • Servers
Multi GpuLlm InferenceLlm Training
$17,239.00
CyberServe EPYC EP2 412G-12NVMe-G GPU AI G5

CyberServe EPYC EP2 412G-12NVMe-G GPU AI G5

Broadberry • Servers
Multi GpuLlm InferenceLlm Training
$32,365.00
CyberServe Xeon SP2-412G 12NVMe GPU AI G6

CyberServe Xeon SP2-412G 12NVMe GPU AI G6

Broadberry • Servers
Multi GpuLlm InferenceLlm Training
$20,756.00
CyberServe EPYC EP1 202-NVMe-G 4GPU G5

CyberServe EPYC EP1 202-NVMe-G 4GPU G5

Broadberry • Servers
Multi GpuLlm InferenceLlm Training
$45,539.00
CyberServe EPYC EP1 208-4NVMe 8GPU G5

CyberServe EPYC EP1 208-4NVMe 8GPU G5

Broadberry • Servers
Multi GpuLlm InferenceLlm Training
$13,946.00
CyberServe EPYC EP1 208-4NVMe 8GPU G5Q

CyberServe EPYC EP1 208-4NVMe 8GPU G5Q

Broadberry • Servers
Multi GpuLlm InferenceLlm Training
$14,596.00
CyberServe EPYC EP1 208-4NVMe GPU G5

CyberServe EPYC EP1 208-4NVMe GPU G5

Broadberry • Servers
Multi GpuLlm InferenceLlm Training
$11,927.00
CyberServe EPYC EP1 212-12NVMe GPU G5

CyberServe EPYC EP1 212-12NVMe GPU G5

Broadberry • Servers
Multi GpuLlm InferenceLlm Training
$8,950.00
CyberServe EPYC EP2 206-NVMe-G 4GPU G5

CyberServe EPYC EP2 206-NVMe-G 4GPU G5

Broadberry • Servers
Multi GpuLlm InferenceLlm Training
$18,215.00
CyberServe EPYC EP2 206-NVMe-G 4GPU G5Q

CyberServe EPYC EP2 206-NVMe-G 4GPU G5Q

Broadberry • Servers
Multi GpuLlm InferenceLlm Training
$16,061.00
CyberServe EPYC EP2 208G-4NVMe 4GPU G5

CyberServe EPYC EP2 208G-4NVMe 4GPU G5

Broadberry • Servers
Multi GpuLlm InferenceLlm Training
$16,022.00
CyberServe EPYC EP2 208G-4NVMe GPU G5

CyberServe EPYC EP2 208G-4NVMe GPU G5

Broadberry • Servers
Multi GpuLlm InferenceLlm Training
$20,313.00
CyberServe EPYC EP2 208G-4NVMe GPU G5Q

CyberServe EPYC EP2 208G-4NVMe GPU G5Q

Broadberry • Servers
Multi GpuLlm InferenceLlm Training
$22,896.00
CyberServe EPYC EP2 408A-4NVMe-G GPU G5

CyberServe EPYC EP2 408A-4NVMe-G GPU G5

Broadberry • Servers
Multi GpuLlm InferenceLlm Training
$25,398.00
CyberServe EPYC EP2-408G 8NVMe HGX B300 GPU G6

CyberServe EPYC EP2-408G 8NVMe HGX B300 GPU G6

Broadberry • Servers
Llm InferenceLlm Training
$604,320.00
CyberServe EPYC EP2 412G-12NVMe-G GPU G5

CyberServe EPYC EP2 412G-12NVMe-G GPU G5

Broadberry • Servers
Multi GpuLlm InferenceLlm Training
$32,365.00
CyberServe EPYC EP2 412G-12NVMe-G GPU G5Q

CyberServe EPYC EP2 412G-12NVMe-G GPU G5Q

Broadberry • Servers
Multi GpuLlm InferenceLlm Training
$46,189.00
CyberServe EPYC EP2 424-4NVMe-G G4

CyberServe EPYC EP2 424-4NVMe-G G4

Broadberry • Servers
Multi GpuLlm InferenceLlm Training
$19,760.00