Threadripper Pro 9000 AI Training 384B Rack Workstation Overview
This Threadripper Pro 7000 AI Training 384B Rack Workstation is built around the Threadripper Pro 9975WX with 4 RTX Pro 6000 Blackwell 96GB video cards.
This combination provides a very powerful solution for machine learning training, fine-tuning, and inference with AI large language models. This machine has a total of 384GB VRAM and runs on 120V power (single 20A or two 15A circuits).
Threadripper Pro 9000 AI Training 384B Rack Workstation Upgrades/Changes
768GB of RAM is the highest we can go on Threadripper Pro, without resorting to EXTREMELY expensive 128GB or 256GB DIMMs.
This workstation uses eight-channel memory. EPYC 9004 uses twelve-channel memory, however a multi-GPU EPYC system is only available in a full-size server chassis. We do have desktop-style Dual-EPYC workstations, these are limited to 2 GPUs and are VERY loud.
We can use other GPUs as well, please let us know if you’re interested in a different GPU.
This computer does not include a Windows license and is built to run Linux. The OS choice is up to the customer however.
Threadripper Pro 9000 AI Training 384B Rack Workstation Limitations
This platform is currently limited to 192 threads, 7 GPUs, and 2TB of memory. Please let us know if you need a more robust platform.
Builds In This Set
Single-Socket AI Inference Rack Workstations
Ryzen 9 24B | Ryzen 9 32B | Ryzen 9 48B | Ryzen 9 96B
Ultra 9 24B | Ultra 9 32B | Ultra 9 48B | Ultra 9 96B
Threadripper 96B | Threadripper 192B | Threadripper Pro 96B | Threadripper Pro 192B
Xeon 2500 96B | Xeon 2500 192B | Xeon 3500 96B | Xeon 3500 192B
Single-Socket AI Training Rack Workstations
Threadripper 384B | Threadripper Pro 384B | Xeon 384B
Heavy Compute Rack Workstations
Dual EPYC 9005 Low | Dual EPYC 9005 Medium | Dual EPYC 9005 Extreme | Dual EPYC 9005 Ultimate
This product is typically faster than Xeon W.
