Core Ultra 9 AI Inference 96B Rack Workstation Overview
This Core Ultra 9 AI Inference 96B Rack Workstation is built around the Intel Core Ultra 9 285K with an RTX Pro 6000 Blackwell 96GB video card.
This combination provides a very powerful solution for development in Intel OpenVINO, Intel OneAPI, Intel openMKL, and allows for development on 96B parameter LLMs.
This workstation is designed for local secured development of agentic AI swarms.
Core Ultra 9 AI Inference 96B Rack Workstation Upgrades/Changes
This generative AI workstation can handle LLMs up to 96B parameters. We can use the RTX Pro 4000 Blackwell 24GB, RTX Pro 4500 Blackwell 32GB, RTX Pro 5000 Blackwell 48GB, and RTX Pro 6000 Blackwell 96GB (MaxQ and Workstation).
This computer does not include a Windows license and is built to run Linux. The OS choice is up to the customer however.
If you need more than 256GB of RAM, we recommend a build based on Threadripper, as it supports ECC memory. 384GB is the highest we can go on Threadripper non-Pro, without resorting to EXTREMELY expensive 128GB or 256GB DIMMs. 768GB is the highest we can normally go on Threadripper Pro, for the same reasons.
Core Ultra 9 AI Inference 96B Rack Workstation Limitations
This rack workstation is currently limited to 24 threads, 2 blower GPUs, and 256GB of memory. Please let us know if you need a more robust platform.
Builds In This Set
Single-Socket AI Inference Rack Workstations
Ryzen 9 24B | Ryzen 9 32B | Ryzen 9 48B | Ryzen 9 96B
Ultra 9 24B | Ultra 9 32B | Ultra 9 48B | Ultra 9 96B
Threadripper 96B | Threadripper 192B | Threadripper Pro 96B | Threadripper Pro 192B
Xeon 2500 96B | Xeon 2500 192B | Xeon 3500 96B | Xeon 3500 192B
Single-Socket AI Training Rack Workstations
Threadripper 384B | Threadripper Pro 384B | Xeon 384B
Heavy Compute Rack Workstations
Dual EPYC 9005 Low | Dual EPYC 9005 Medium | Dual EPYC 9005 Extreme | Dual EPYC 9005 Ultimate
