Overview
Exxact TensorEX 6U HGX H200 server integrates 8x NVIDIA H200 SXM GPUs (141GB HBM3e each, 1128GB total) with dual AMD EPYC 9005/9004 processors. NVLink/NVSwitch interconnect at 900GB/s GPU-to-GPU bandwidth enables training at the 70B–405B parameter scale. Purpose-built for organizations running cutting-edge LLM training or scientific simulation.
Key Features
- 8x NVIDIA H200 SXM GPUs — 1128GB HBM3e total
- 4800 GB/s aggregate GPU memory bandwidth
- NVLink/NVSwitch 900GB/s GPU-to-GPU
- Dual AMD EPYC 9005/9004 (DDR5-6000, 24 DIMM slots)
- 3kW redundant PSU (4+4, 80 PLUS Titanium)
Ideal For
AI research institutions, model training companies, and enterprises building private GPU clusters for training or running 70B+ parameter language models and large scientific simulations.
Processor & Chipset
- Number of Processors Supported: 2
- Processor Socket: Socket SP5 LGA-6096
- Processor Type: EPYC
- Processor Supported: 9005-Series, 9004-Series
- Thermal Design Power (TDP): 500 W
- GPU: 8x NVIDIA H200 SXM
- Chipset Manufacturer: N/A
- Chipset Model: SoC
Memory
- Memory Technology: DDR5 SDRAM
- Memory Standard: DDR5-6000/PC4-48000
- Number of Total Memory Slots: 24
Controllers
- NVMe: Via SoC/PCIe Switch Board
Display & Graphics
- Graphics Controller Manufacturer: ASPEED
- Graphics Controller Model: AST2600
Network & Communication
- Ethernet Technology: 2x 1000BASE-T (1GbE, front or rear)
I/O Expansions
- PCI Express: 8x PCI-E 5.0 x16 HHHL slots, 1x PCI-E 5.0 x16 FHHL slot, 1x PCI-E 3.0 x2 or SATA M.2 slot (2280/22110), 1x PCI-E 3.0 x4 or SATA M.2 slot (2280/22110)
Drive Bays
- Hot-swap: 12x 2.5 hot-swap drive bays, Supports NVMe drives
Interfaces/Ports
- Total Number of USB 3.2 Gen1 Ports: 6 (4x Front, 2x Rear)
- Number of NVMe Interfaces: 12x U.2, 2x M.2
- LAN: 2x RJ45 1000BASE-T Ports (Shared with front and rear I/O), 1x RJ45 Dedicated IPMI Port (Shared with front and rear I/O)
- Onboard Video: 1x VGA Connector (Shared with front and rear I/O)
Power Description
- Number of Power Supplies: 8
- Redundant Power Supplies: Yes (4+4)
- Maximum Power Supply Wattage: 3002.4 W
- Certification: 80 Plus Titanium
Physical Characteristics
- Color: Black
- Form Factor: Rack-mountable
- Rack Height: 6U
- Height: 10.4"
- Width: 17.6"
- Depth: 36.6"
$300,300.00
Prices may vary. Verify on vendor site.
Quick Specs
- Processor & Chipset
- 2
- Memory
- DDR5 SDRAM
- Controllers
- Via SoC/PCIe Switch Board
- Display & Graphics
- ASPEED
- Network & Communication
- 2x 1000BASE-T (1GbE, front or rear)
- I/O Expansions
- 8x PCI-E 5.0 x16 HHHL slots
Tags
model-trainingllm-inferencehpc