BIZON G9000 – 4x 8x NVIDIA A100, H100, H200 Tensor Core AI GPU Server with AMD EPYC, Intel Xeon

Use cases

• • Artificial Intelligence
• • Big Data Analytics
• • High-performance Computing
• • Research Lab/National Lab
• • Astrophysics, Business Intelligence

Motherboard

• • AMD EPYC 9005/9004 series processors (Socket SP5).
• • System on Chip (SoC).

CPU

• • AMD EPYC 9005/9004 series processor family
• • Dual processors, 5nm
• • Up to 192-core, 384 threads per processor
• • cTDP up to 400W

Memory

• • Up to 6144 GB DDR5 ECC Buffered
• • 24 x DIMM slots
• • DDR5 memory supported only
• • 12-Channel memory per processor architecture
• • RDIMM modules up to 64GB supported
• • 3DS RDIMM modules up to 256GB supported

Expansion Slots

• • 8 x PCIe slots (Gen5 x16 link, FH, FL) for dual-slot GPU cards
• • 1 x PCIe slot (Gen5 x8 link, LP, HL) for HBA/RAID cards (front)
• • 1 x PCIe slot (Gen5 x16 link) for NIC (rear)
• • 1 x PCIe slot (Gen5 x8 link) for NIC (rear)

Storage

• Default option: 8 x 3.5"/2.5" Front Hot-swap Storage Bays, 1 x M.2 Socket, supports up to 22110 type (PCIe Gen3 x4 link)
• G9000-600W option: 8 x 2.5" Front Hot-swap Storage Bays, Up to 6 NVMe drives based on HBA/Raid card model installed

LAN

• Default option: 2 x 10GbE LAN ports (Intel X710-AT2), 1 x 10/100/1000 management LAN (Dedicated IPMI), 25 Gigabit Dual Port Ethernet (2x SFP28) (optional), 100 Gbps Dual Port InfiniBand EDR (Mellanox ConnectX VPI Adapter; 1x QSFP) (optional), 200 Gbps Dual Port InfiniBand HDR (Mellanox ConnectX-6 VPI Adapter; 2x QSFP) (optional), 400 Gbps Single Port InfiniBand NDR (Mellanox ConnectX-7 VPI Adapter; 1x OSFP) (optional)
• G9000-600W option: 1 x 10/100/1000 management LAN (Dedicated IPMI), 25 Gigabit Dual Port Ethernet (2x SFP28) (optional), 100 Gbps Dual Port InfiniBand EDR (Mellanox ConnectX VPI Adapter; 1x QSFP) (optional), 200 Gbps Dual Port InfiniBand HDR (Mellanox ConnectX-6 VPI Adapter; 2x QSFP) (optional), 400 Gbps Single Port InfiniBand NDR (Mellanox ConnectX-7 VPI Adapter; 1x OSFP) (optional)

Video

Integrated in Aspeed AST2600

Graphics Cards

• Available options: Nvidia A100 40Gb (no video outputs), Nvidia A100 80Gb (no video outputs), Nvidia H100 94Gb NVL (no video outputs), Nvidia H200 141Gb NVL (no video outputs)

Front I/O

• Default option: 2 x USB 3.2 Gen 1, 1 x VGA, 1 x Power Button w/LED, 1 x Location Button w/LED, 1 x Message LED, 1 x Q-Code/Port 80 LED, 1 x Clear CMOS Switch, 1 x Reset Switch, 1 x M.2 LED
• G9000-600W option: 2 x USB 5Gbps ports, 1 x Mini DisplayPort, 1 x Debug port, 1 x Power Button w/LED, 1 x Location Button w/LED, 1 x Message LED, 1 x Q-Code/Port 80 LED, 1 x Clear CMOS Switch, 1 x Reset Switch

Rear I/O

• Default option: 1 x COM port, 2 x RJ45, 1 x MLAN, 1 x Power Button w/LED, 1 x Location Button w/LED
• G9000-600W option: 1 x USB 5Gbps ports, 1 x MLAN, 1 x Power switch/LED, 1 x Location switch/LED, 1 x Message LED

Power Supply

• Default option: 2+2 Redundant 2600W 80 PLUS Titanium Power Supply, Rating: 220-240 Vac, 15.5A(x4), 50-60 Hz
• Power cord requirements: C19 (PSU) to 5-15P (regular US home outlet).C19 (PSU) to C20 (plug) (PDU).
• G9000-600W option: 3+1 Redundant 3200W 80 PLUS Titanium Power Supply, Rating: 220-240 Vac, 16.0A(x4), 50-60 Hz
• Power cord requirements: C19 (PSU) to 5-15P (regular US home outlet).C19 (PSU) to C20 (plug) (PDU).

Power Requirements

100-120V (standard US outlet):If you have a standard 20 A / 120V US outlet, you can connect one power supply to one dedicated power circuit (each outlet should have its dedicated circuit). In total, you need four (4) 20 A /120V outlets with a dedicated circuit.Actual power consumption is not the same as maximum power supply power. Power supply power means how much watts you can get from the power supply and your actual power consumption should not be higher than max power supply power.Actual power consumption depends on your configuration (graphics card and CPU).Power consumption example:G9000 with 8 x NVIDIA H100 = 2800W-3000W (100% load for all the GPUs).Information for reference only. Consult your electrician for more details.The system power supply is universal and will work worldwide. Compatible with 110v - 240v (50-60 Hz).

System Management

• • Remote access from anywhere (SSH/VNC)
• • Virtual machines
• • GPU sharing
• • Containers
• • One-click software updates
• • Jupyter notebooks
• • GPU/System monitoring
• • accounts, and permissions
• • Aspeed AST2600 management controller
• • Dashboard
• • HTML5 KVM
• • Sensor Monitor (Voltage, RPM, Temperature, CPU Status ...etc.)
• • Sensor Reading History Data
• • FRU Information
• • SEL Log in Linear Storage / Circular Storage Policy
• • Hardware Inventory
• • Fan Profile
• • System Firewall
• • Power Consumption
• • Power Control
• • LDAP / AD / RADIUS Support
• • Backup & Restore Configuration
• • Remote BIOS/BMC/CPLD Update
• • Event Log Filter
• • User Management
• • Media Redirection Settings
• • PAM Order Settings
• • SSL Settings
• • SMTP Settings

OS Compatibility

• • BIZON Z-Stack (Ubuntu 24.04 with preinstalled deep learning frameworks).
• • Rocky Linux 9 (optional).
• • Windows 11 Pro (optional).
• • Microsoft Windows Server 2022 Standard (optional).
• • No operating system (optional).
• • Windows Server 2022
• • Red Hat Enterprise Linux 8.6 ( x64) or later
• • SUSE Linux Enterprise Server 15 SP4 or later
• • Ubuntu 20.04.5 LTS (x64) or later
• • Ubuntu 22.04 LTS (x64) or later
• • Ubuntu 22.04.1 LTS (x64) or later
• • VMware ESXi 7.0 Update 3i later
• • VMware ESXi 8.0 Update1 or later
• • Citrix Hypervisor 8.2.1 or later

Operating Properties

• • Operating temperature: 50° to 95° F (10° to 35° C)
• • Operating humidity: 8%-80% (non-condensing)
• • Non-operating temperature: -40° to 140° F (-40°C to 60°C)
• • Non-operating humidity: 20%-95% (non-condensing)

Noise

• 8 x NVIDIA A100: Idle: 71 dBMax Load (stress test): 91 dB

Dimensions & Weight

• Case #1 (default option): Rackmountable; 4U; horizontal placement, Height: 6.85 inches (17.45 cm), Width: 17.3 inches (44.0 cm), Depth: 31.5 inches (80.0 cm)
• Shipping Package: Height: 17.3 inches (44.4 cm), Width: 31.5 inches (80.0 cm), Length: 47.2 inches (120.0 cm), Weight: 135 lbs (61.2 kg) (shipped on pallet)
• Case #2 (G9000-600W): Rackmountable; 4U; horizontal placement, Height: 6.89 inches (17.5 cm), Width: 17.28 inches (43.95 cm), Depth: 31.5 inches (80.0 cm)
• Shipping Package: Height: 17.3 inches (44.4 cm), Width: 31.5 inches (80.0 cm), Length: 47.2 inches (120.0 cm), Weight: 167.5 lbs (76.2 kg) (shipped on pallet)

In the Box

• • Bizon G9000 G2
• • 1 x Rail kit
• • 4 x power cords (USA)
• • User manual
• • Benchmark report

Part Number

bizon-g9000-0523

Use cases

• • Artificial Intelligence
• • Big Data Analytics
• • High-performance Computing
• • Research Lab/National Lab
• • Astrophysics, Business Intelligence

Motherboard

• • Intel Xeon Scalable Processors LGA 4677 (Socket E).
• • Intel C741 chipset.

CPU

• • 4th/5th Generation Intel Xeon Scalable Processors
• • Intel Xeon CPU Max Series
• • Intel Xeon Platinum Processor, Intel Xeon Gold Processor, Intel Xeon Silver Processor
• • Dual processors, 10nm
• • Up to 60-core, 120 threads per processor
• • cTDP up to 350W

Memory

• • Up to 8192 GB DDR5 ECC Buffered
• • 32 x DIMM slots
• • DDR5 memory supported only
• • 8-Channel memory per processor architecture
• • RDIMM modules up to 64GB supported
• • 3DS RDIMM modules up to 256GB supported

Expansion Slots

• • 8 x PCIe slots (Gen5 x16 link, FH,FL) for dual-slot GPU cards
• • 1 x PCIe slot (Gen5 x8 link, LP,HL) for HBA/RAID cards (front)
• • 1 x PCIe slot (Gen5 x16 link) for NIC (rear)
• • 1 x PCIe slot (Gen5 x8 link) for NIC (rear)

Storage

• Default option: 8 x 3.5"/2.5" Gen5 NVMe (front hot-swap), 1 x M.2 (2280/22110), PCIe Gen3 x4
• G9000-600W option: 8 x 2.5" Front Hot-swap Storage Bays, Up to 6 NVMe devices based on HBA/Raid card model installed, 2 x M.2 socket (Gen 5 x4 link, up to 22110)

LAN

• Default option: 2 x 10Gb/s LAN ports (Intel X710-AT2), 1 x 10/100/1000 management LAN (Dedicated IPMI), 25 Gigabit Dual Port Ethernet (2x SFP28) (optional), 100 Gbps Dual Port InfiniBand EDR (Mellanox ConnectX VPI Adapter; 1x QSFP) (optional), 200 Gbps Dual Port InfiniBand HDR (Mellanox ConnectX-6 VPI Adapter; 2x QSFP) (optional), 400 Gbps Single Port InfiniBand NDR (Mellanox ConnectX-7 VPI Adapter; 1x OSFP) (optional)
• G9000-600W option: 1 x 10/100/1000 management LAN (Dedicated IPMI), 25 Gigabit Dual Port Ethernet (2x SFP28) (optional), 100 Gbps Dual Port InfiniBand EDR (Mellanox ConnectX VPI Adapter; 1x QSFP) (optional), 200 Gbps Dual Port InfiniBand HDR (Mellanox ConnectX-6 VPI Adapter; 2x QSFP) (optional), 400 Gbps Single Port InfiniBand NDR (Mellanox ConnectX-7 VPI Adapter; 1x OSFP) (optional)

Video

Integrated in Aspeed AST2600

Graphics Cards

• Available options: Nvidia A100 40Gb (no video outputs), Nvidia A100 80Gb (no video outputs), Nvidia H100 94Gb NVL (no video outputs), Nvidia H200 141Gb NVL (no video outputs)

Front I/O

• Default option: 2 x USB 3.2 Gen1, 1 x VGA, 1 x Power button w/LED, 1 x Location Button w/LED, 1 x Message LED, 1 x Q-Code/Port 80 LED, 1 x Clear CMOS Switch, 1 x Reset Switch, 1 x M.2 LED
• G9000-600W option: 2 x USB 5Gbps ports, 1 x Mini DisplayPort, 1 x Debug port, 1 x Power Button w/LED, 1 x Location Button w/LED, 1 x Message LED, 1 x Clear CMOS Switch, 1 x Reset Switch, 2 x M.2 LEDs, 1 x Q-Code/Port 80 LED

Rear I/O

• Default option: 1 x COM port, 2 x RJ45, 1 x MLAN, 1 x Power Button w/LED, 1 x Location Button w/LED
• G9000-600W option: 1 x USB 5Gbps ports, 1 x MLAN, 1 x Power switch/LED, 1 x Location switch/LED, 1 x Message LED

Power Supply

• Default option: 2+2 Redundant 2600W 80 PLUS Titanium Power Supply, Rating: 220-240 Vac, 15.5A(x4), 50-60 Hz
• Power cord requirements: C19 (PSU) to 5-15P (regular US home outlet).C19 (PSU) to C20 (plug) (PDU).
• G9000-600W option: 3+1 Redundant 3200W 80 PLUS Titanium Power Supply, Rating: 220-240 Vac, 16.0A(x4), 50-60 Hz
• Power cord requirements: C19 (PSU) to 5-15P (regular US home outlet).C19 (PSU) to C20 (plug) (PDU).

Power Requirements

100-120V (standard US outlet):If you have a standard 20 A / 120V US outlet, you can connect one power supply to one dedicated power circuit (each outlet should have its dedicated circuit). In total, you need four (4) 20 A /120V outlets with a dedicated circuit.Actual power consumption is not the same as maximum power supply power. Power supply power means how much watts you can get from the power supply and your actual power consumption should not be higher than max power supply power.Actual power consumption depends on your configuration (graphics card and CPU).Power consumption example:G9000 with 8 x NVIDIA H100 = 2800W-3000W (100% load for all the GPUs).Information for reference only. Consult your electrician for more details.The system power supply is universal and will work worldwide. Compatible with 110v - 240v (50-60 Hz).

System Management

• • Remote access from anywhere (SSH/VNC)
• • Virtual machines
• • GPU sharing
• • Containers
• • One-click software updates
• • Jupyter notebooks
• • GPU/System monitoring
• • accounts, and permissions
• • Aspeed AST2600 management controller
• • Dashboard
• • HTML5 KVM
• • Sensor Monitor (Voltage, RPM, Temperature, CPU Status ...etc.)
• • Sensor Reading History Data
• • FRU Information
• • SEL Log in Linear Storage / Circular Storage Policy
• • Hardware Inventory
• • Fan Profile
• • System Firewall
• • Power Consumption
• • Power Control
• • LDAP / AD / RADIUS Support
• • Backup & Restore Configuration
• • Remote BIOS/BMC/CPLD Update
• • Event Log Filter
• • User Management
• • Media Redirection Settings
• • PAM Order Settings
• • SSL Settings
• • SMTP Settings

OS Compatibility

• • BIZON Z-Stack (Ubuntu 24.04 with preinstalled deep learning frameworks).
• • Rocky Linux 9 (optional).
• • Windows 11 Pro (optional).
• • Microsoft Windows Server 2022 Standard (optional).
• • No operating system (optional).
• • Windows Server 2022
• • Red Hat Enterprise Linux 8.6 ( x64) or later
• • SUSE Linux Enterprise Server 15 SP4 or later
• • Ubuntu 20.04.5 LTS (x64) or later
• • Ubuntu 22.04 LTS (x64) or later
• • Ubuntu 22.04.1 LTS (x64) or later
• • VMware ESXi 7.0 Update 3i later
• • VMware ESXi 8.0 Update1 or later
• • Citrix Hypervisor 8.2.1 or later

Operating Properties

• • Operating temperature: 50° to 95° F (10° to 35° C)
• • Operating humidity: 8%-80% (non-condensing)
• • Non-operating temperature: -40° to 140° F (-40°C to 60°C)
• • Non-operating humidity: 20%-95% (non-condensing)

Noise

• 8 x NVIDIA A100: Idle: 71 dBMax Load (stress test): 91 dB

Dimensions & Weight

• Case #1 (default option): Rackmountable; 4U; horizontal placement, Height: 6.69 inches (17.45 cm), Width: 17.3 inches (44.0 cm), Depth: 31.5 inches (80.0 cm)
• Shipping Package: Height: 17.3 inches (44.4 cm), Width: 31.5 inches (80.0 cm), Length: 47.2 inches (120.0 cm), Weight: 135 lbs (61.2 kg) (shipped on pallet)
• Case #2 (G9000-600W): Rackmountable; 4U; horizontal placement, Height: 6.89 inches (17.5 cm), Width: 17.28 inches (43.95 cm), Depth: 31.5 inches (80.0 cm)
• Shipping Package: Height: 17.3 inches (44.4 cm), Width: 31.5 inches (80.0 cm), Length: 47.2 inches (120.0 cm), Weight: 167.5 lbs (76.2 kg) (shipped on pallet)

In the Box

• • Bizon G9000 G2
• • 1 x Rail kit
• • 4 x power cords (USA)
• • User manual
• • Benchmark report

Part Number

bizon-g9000-0523