Small Generative AI Server

This Small Generative AI Server is built around the Ryzen 5 7600X with an RTX 4070Ti Super 16GB video card.

Description

Small Generative AI Server Overview

This Small Generative AI Server is built around the Ryzen 5 7600X with an RTX 4070Ti Super 16GB video card. This combination provides a very powerful solution for computation and allows for heavy datasets.

This system can handle models up to 13B parameters. If you need more GPU compute or VRAM, we recommend the RTX 4090 24GB.

This computer does not include a Windows license and is built to run Linux. The OS choice is up to the customer however.

If you need more than 192GB of RAM, we recommend a build based on Threadripper 7000, as it supports ECC memory. 384GB is the highest we can go on Threadripper non-Pro, without resorting to EXTREMELY expensive 128GB or 256GB DIMMs. 768GB is the highest we can normally go on Threadripper Pro, for the same reasons.

Small Generative AI Server Limitations

This platform is currently limited to 32 threads, 2 GPUs, and 192GB of memory. Please let us know if you need a more robust platform.

Builds In This Set

Small Generative AI | Medium Generative AI | Large Generative AI

Threadripper Pro Scientific Computing | Threadripper Pro Data Science

Xeon Scientific Computing | Xeon Data Science | Xeon Max Data Science

Xeon Machine Learning/AI Training

What You Need To Know

Ryzen 5 7600X
(6 core/12 thread, 5.3 GHz single-core turbo)
RTX 4070Ti Super 16GB
(decent compute, decent VRAM)
16GB DDR5-6000 memory
(max of 4DIMM/192GB)
1TB+4TB Gen4 NVME dual-drive setup
(OS/programs, main)
High-airflow rack (rails included), 1200W Platinum power supplyDual-tower CPU air cooler

Small Generative AI Server

Top Flight Computers is a SolidWorks Certified Solution Partner

See some of our customer build videos and live streams on our YouTube channel!

Pricing

This Small Generative AI Server is $4250 as currently designed, and includes a 1 year extended warranty.

Online pricing defaults to credit card payment (ACH and check are available), possible sales tax and shipping cost is extra.

Please contact us if you found one of our previous builds that you think would suit your needs well.

B2B financing is available up to 60 months, $5000 minimum spend.

Example Systems

Interested In Buying This PC Rack? Contact Us!

See our brief update on the status of components, including pricing and lead time