Supermicro launches highly optimised AI solutions based on AMD Instinct MI350 Series

2 mins read

Supermicro has announced that both liquid-cooled and air-cooled GPU solutions will be available with the new AMD Instinct MI350 series GPUs.

GPU-based AI server Credit: Supermicro

Optimised for performance, maximum scalability, and efficiency the Supermicro H14 generation of GPU solutions featuring dual AMD EPYC 9005 CPUs along with the AMD Instinct MI350 series GPUs, are designed for customers looking for performance at scale, while reducing the total cost of ownership for AI-driven data centres.

According to Charles Liang, president and CEO of Supermicro, "Our Data Center Building Block Solutions enable us to quickly deploy end-to-end data centre solutions to market, bringing the latest technologies for the most demanding applications. The addition of the new AMD Instinct MI350 series GPUs to our GPU server lineup strengthens and expands our AI solutions and gives customers greater choice and better performance as they design and build the next generation of data centres."

Supermicro's H14 solutions offer significantly improved levels of performance and flexibility for a wide range of AI, HPC, Cloud, and Enterprise workloads. These systems are built on Supermicro's building-block architecture to help enterprise customers efficiently upgrade and scale their workloads.

The new Supermicro GPU servers feature both the latest AMD EPYC CPU and AMD Instinct GPUs, adding to Supermicro's data centre building block solutions (DCBBS).

"Our new AMD Instinct MI350 series delivers up to 40 percent more tokens-per-dollar relative to the competition, while retaining the industry standard form factor for OEM infrastructure compatibility," said Dr. Lisa Su, CEO and Chair, AMD. "By combining these GPUs with Supermicro's proven platforms, their customers can deploy fully integrated, air- or liquid-cooled racks built entirely on AMD technology, giving them the flexibility and efficiency they need to deploy robust AI solutions at any scale."

Supermicro is expanding its liquid-cooled and air-cooled high-performance fabric 8-GPU system, leveraging the open multi-architecture industry standard OCP Accelerator Module (OAM) to support the latest AMD Instinct MI350 series GPUs.

For higher-density environments, the 4U liquid-cooled system with AMD Instinct MI355X GPUs features Supermicro's new Direct Liquid Cooling (DLC) architecture incorporating new technologies for cooling various server components and reducing power consumption by up to 40%, helping to unlock higher performance per rack and to support advanced cooling infrastructure at scale.

Customers can choose Supermicro's 4U liquid-cooled option for higher- density rack-scale deployments as well as the 8U option for air-cooled environments.

Designed to maximise computational throughput, memory bandwidth utilisation, and energy efficiency to enable more power-efficient AI inference. these accelerated GPU servers with AMD Instinct MI350 series will offer 288GB HBM3e per GPU, boosting 1.5x memory capacity compared to previous generations of AMD Instinct accelerator, 8TB/s bandwidth, and 1.8x petaflops of FP16 / FP8 compared to the previous generation Instinct MI325X, so customers can process more data faster for their AI workloads.

The AMD MI350 series will also feature new FP6 and FP4 data types to provide exceptional AI capabilities, handling larger models for AI deployments.