Medium AI Inference Workstation

This Medium AI Inference Workstation is built around the i7-13700K with an RTX 4090 24GB video card.

Description

Medium AI Inference Workstation Overview

This Medium AI Inference Workstation is built around the i7-13700K with an RTX 4090 24GB video card. This combination provides a very powerful solution for computation and allows for large datasets.

This system can handle models up to 30B parameters. If you need more VRAM, we recommend the RTX A6000 48GB or RTX 6000 ADA 48GB.

This computer does not include a Windows license and is built to run Linux. The OS choice is up to the customer however.

Medium AI Inference Workstation Limitations

This platform is currently limited to 32 threads, 1 GPU, and 192GB of memory. Please let us know if you need a more robust platform.

Builds In This Set

Threadripper Scientific Computing | Threadripper Pro Scientific Computing | Xeon Scientific Computing

Threadripper Data Science | Threadripper Pro Data Science | Xeon Data Science | Xeon Max Data Science

Small AI Inference | Medium AI Inference | Large AI Inference

Xeon Machine Learning/AI Training

What You Need To Know

i7-13700K
(16 core/24 thread, 5.4 GHz single-core turbo)
RTX 4090 24GB
(max render power, very high VRAM)
32GB DDR5-6000 memory
(max of 4DIMM/192GB)
1TB+2TB Gen4 NVME dual-drive setup
(OS/programs, main)
High-airflow case, 1200W Platinum power supply360mm CPU liquid cooler, extra case fans for proper airflow

Medium AI Inference Workstation

Top Flight Computers is a SolidWorks Certified Solution Partner

See some of our customer build videos and live streams on our YouTube channel!

Pricing

This Medium AI Inference Workstation is $5500 as currently designed.

Online pricing defaults to credit card payment (ACH and check are available), possible sales tax and shipping cost is extra.

Please contact us if you found one of our previous builds that you think would suit your needs well.

Example Systems

Interested In Buying This PC Build? Contact Us!

See our brief update on the status of components, including pricing and lead time