While most GPU-enhanced servers accommodate up to eight GPUs, Supermicro introduces a more compact 3U model capable of housing 18 within its air-cooled framework. Dubbed the SYS-322GB-NR, this design includes 20 PCIe slots for various configurations, indicating a distinctive approach compared to typical AI server setups that favor Nvidia’s SXM socket or Open Accelerator Module specs for increased bandwidth.

Supermicro is not targeting extreme AI processing with this unit. Instead, it’s tailored for tasks such as edge machine learning and AI inference, particularly in environments requiring real-time data processing from cameras or sensors—ideal scenarios for automated production systems. Additionally, the server can handle multiple GPU connections for visual applications, effectively supporting up to 64 displays, which appeals to visualization specialists aiming to construct expansive, high-resolution video walls.

The server’s rear section allows for 18 single-slot GPUs or up to ten dual-slot cards, though factors like power and cooling may impose practical limitations. Supermicro has remained non-committal about specific GPU models likely because Nvidia and AMD are amid major product updates. However, it’s expected that Nvidia’s smaller L4 accelerators will be popular for edge AI tasks, with the potential for stronger configurations involving Nvidia L40S GPUs should power supplies meet demanding requirements.

Powering this robust GPU support are dual Intel 6900-series Xeon processors capable of using up to 128 cores and 256 threads, alongside 96 PCIe 5 lanes each. Despite the system’s considerable 192 PCIe lanes, questions remain about configuration when fully populated, suggesting possible use of a PCIe switch or limitations to eight lanes per slot. Supermicro’s design is otherwise straightforward, accommodating up to 6TB of DDR5 RAM or faster 8,800 MT/sec MRDIMMs, with multiple NVMe storage options. For those interested in dense, memory-equipped servers, Gigabyte’s recent dual-socket Epyc system offers an alternative with its vast 48 DIMM slots.