Servers for AI

Rackmount systems built to hold multiple datacenter GPUs, from single-accelerator 1U machines to 8-GPU HGX platforms.

408 products from 17 vendors, from $449 to $795,000 (median $31,488). Most common accelerators: H200, A100, B200, H100, B300.

What to compare

The number that matters is total GPU memory, not core count: a model must fit in VRAM before anything else is relevant. Check whether the listed price includes the GPUs — many vendors quote a base chassis — and whether the interconnect is NVLink or PCIe, which decides how well training scales past one card.

Who buys these

Teams training or serving models at a scale that has outgrown a workstation, and anyone comparing the real cost of owning against renting.

408 products
ASUS ESC N8-E11 AI Server with NVIDIA HGX H200

ASUS ESC N8-E11 AI Server with NVIDIA HGX H200

Viperatech • Servers
Llm InferenceLlm Training
$348,000.00
ASUS ESC8000A-E12P Dual AMD EPYC 9004 GPU Server

ASUS ESC8000A-E12P Dual AMD EPYC 9004 GPU Server

Viperatech • Servers
Llm InferenceLlm Training
RAM: 24x - DDR5-4800 RDIMM 64GB
$235,000.00
ASUS ESC8000A-E13P 8x PCIe GPU Server

ASUS ESC8000A-E13P 8x PCIe GPU Server

Viperatech • Servers
Llm InferenceLlm Training
$795,000.00
Barebone AMD G593-ZD2-AAX1 H100 80GB with 8 x SXM5 GPUs

Barebone AMD G593-ZD2-AAX1 H100 80GB with 8 x SXM5 GPUs

Viperatech • Servers
Small ModelLlm InferenceLlm Training
$301,576.00
Barebone AMD G593-ZD2-AAX1 H200 80GB with 8 x SXM5 GPUs

Barebone AMD G593-ZD2-AAX1 H200 80GB with 8 x SXM5 GPUs

Viperatech • Servers
Small ModelLlm InferenceLlm Training
$308,142.00
Barebone Intel G593-SD2-AAX1 H100 80GB with 8 x SXM5 GPUs

Barebone Intel G593-SD2-AAX1 H100 80GB with 8 x SXM5 GPUs

Viperatech • Servers
Small ModelLlm InferenceLlm Training
$795,000.00
Dell PowerEdge XE9680 Rack Server 210-BFXH-BUNDLE with 8 x H100 GPUs

Dell PowerEdge XE9680 Rack Server 210-BFXH-BUNDLE with 8 x H100 GPUs

Viperatech • Servers
Multi GpuLlm InferenceLlm Training
$275,000.00
Exeton Quasar 640X AI Server

Exeton Quasar 640X AI Server

Viperatech • Servers
Llm InferenceLlm Training
$208,885.00
Gigabyte G492-ZD0 HPC/AI Server – AMD EPYC™ 7742 – 4U DP HGX™ A100 8-GPU (USED)

Gigabyte G492-ZD0 HPC/AI Server – AMD EPYC™ 7742 – 4U DP HGX™ A100 8-GPU (USED)

Viperatech • Servers
Llm InferenceLlm Training
GPU: Integrated in Aspeed® AST25002D Video Graphic Adapter with PCIe bus interface1920×1200@60Hz 32bpp, DDR4 SDRAM
CPU: AMD EPYC™ 7742 Series processorsDual processor, 7nm technologyUp to 64-core, 128 threads per processorcTDP up to 280WNote: If only 1 CPU is installed, some PCIe or memory functions might be unavailable
RAM: 32 x DIMM slotsDDR4 memory supported only8-Channel memory architectureTotal up to 8TB 3DS/RDIMM/LRDIMM modules supportedMemory speed: Up to 3200*/2933 MHz*Follow BIOS setting and memory QVL list if running 3200 Mhz with 2DPC
$108,000.00
Gigabyte G593-SD0 8x H100 Deep Learning Server 5U

Gigabyte G593-SD0 8x H100 Deep Learning Server 5U

Viperatech • Servers
Multi GpuLlm InferenceLlm Training
GPU: NVIDIA H100
CPU: 2 x Intel® Xeon® Platinum 8480+ Processor
RAM: 32 x Samsung DDR5 64GB 4800
$265,000.00
GIGABYTE G593-SD2-AAX1 HPC/AI Server 5U Dual Xeon HGX H100 8x 640GB

GIGABYTE G593-SD2-AAX1 HPC/AI Server 5U Dual Xeon HGX H100 8x 640GB

Viperatech • Servers
Multi GpuLlm InferenceLlm Training
GPU: NVIDIA HGX™ H100 with 8 x SXM5 GPUs
CPU: Dual 5th/4th Gen Intel® Xeon® Scalable Processors
RAM: 32 x DDR5 DIMM slots, 8-channel memory, up to 8TB DDR5 RDIMM
$265,000.00
GIGABYTE G893-SD1-AAX5 HGX™ B200 8-GPU Server

GIGABYTE G893-SD1-AAX5 HGX™ B200 8-GPU Server

Viperatech • Servers
Llm InferenceLlm Training
$790,000.00
Gigabyte HPC/AI Server - AMD EPYC™ 9004 - 5U DP NVIDIA HGX™ H200 8-GPU | G593-ZD1- AAX3

Gigabyte HPC/AI Server - AMD EPYC™ 9004 - 5U DP NVIDIA HGX™ H200 8-GPU | G593-ZD1- AAX3

Viperatech • Servers
Llm InferenceLlm Training
$648,000.00
HPE Cray XD670 HGX H100 SXM Deep Learning 3U

HPE Cray XD670 HGX H100 SXM Deep Learning 3U

Viperatech • Servers
Llm InferenceLlm Training
$288,500.00
Lenovo NVIDIA HGX H200 141GB 700W 4-GPU Board C3V2

Lenovo NVIDIA HGX H200 141GB 700W 4-GPU Board C3V2

Viperatech • Servers
Small ModelLlm InferenceLlm Training
$185,000.00
Lenovo ThinkSystem HGX H100 SR675 V3 Server

Lenovo ThinkSystem HGX H100 SR675 V3 Server

Viperatech • Servers
Multi GpuLlm InferenceLlm Training
RAM: 24x DDR5 DIMMs, 12 channels per CPU (1DPC), Maximum 3TB using 128GB RDIMMs, Up to 4800 MHz
$182,000.00
NVIDIA DELTA-NEXT HGX GPU Baseboard, 8 H100 80GB SXM5 - 935-24287-0000-000

NVIDIA DELTA-NEXT HGX GPU Baseboard, 8 H100 80GB SXM5 - 935-24287-0000-000

Viperatech • Servers
Small ModelLlm InferenceLlm Training
$199,000.00
NVIDIA DGX GH200 Grace Hopper Superchip Server

NVIDIA DGX GH200 Grace Hopper Superchip Server

Viperatech • Servers
Llm InferenceLlm Training
CPU: NVIDIA GH200 Grace™ Hopper™ Superchip
RAM: Up to 480GB LPDDRX embedded, 96GB HBM3 GPU memory
$410,000.00
NVIDIA DGX H200 AI Server

NVIDIA DGX H200 AI Server

Viperatech • Servers
Multi GpuLlm InferenceLlm Training
GPU: 8x NVIDIA H200 Tensor Core GPUs
CPU: Dual Intel® Xeon® Platinum 8480C Processors112 cores total, 2.00GHz (Base),3.80GHz (max boost)
$375,000.00
NVIDIA DGX H800 640GB SXM5 2TB

NVIDIA DGX H800 640GB SXM5 2TB

Viperatech • Servers
Llm InferenceLlm Training
$369,000.00
NVIDIA HGX A100-8 GPU Baseboard – 8 x A100 SXM4 40 GB HBM2 – 935-23587-0000-000

NVIDIA HGX A100-8 GPU Baseboard – 8 x A100 SXM4 40 GB HBM2 – 935-23587-0000-000

Viperatech • Servers
Multi GpuLlm InferenceLlm Training
$89,000.00
NVIDIA HGX GPU 8x A100 640GB 935-23587-0000-204

NVIDIA HGX GPU 8x A100 640GB 935-23587-0000-204

Viperatech • Servers
Multi GpuLlm InferenceLlm Training
$169,000.00
NVIDIA HGX H100 Delta-Next 640GB SXM5 Liquid Cooled Baseboard

NVIDIA HGX H100 Delta-Next 640GB SXM5 Liquid Cooled Baseboard

Viperatech • Servers
Llm InferenceLlm Training
$249,900.00
Nvidia HGX H20 Enterprise 96GB

Nvidia HGX H20 Enterprise 96GB

Viperatech • Servers
Small ModelLlm InferenceLlm Training
$8,160.00