Medium AI Inference Workstation Overview
This Medium AI Inference Workstation is built around the i7-13700K with an RTX 4090 24GB video card. This combination provides a very powerful solution for computation and allows for large datasets.
This system can handle models up to 30B parameters. If you need more VRAM, we recommend the RTX A6000 48GB or RTX 6000 ADA 48GB.
This computer does not include a Windows license and is built to run Linux. The OS choice is up to the customer however.
Medium AI Inference Workstation Limitations
This platform is currently limited to 32 threads, 1 GPU, and 192GB of memory. Please let us know if you need a more robust platform.