AMD EPYC Verano CPUs to Support LPDDR5X SOCAMM2 Memory for Optimized AI Rack Scale Solutions with Enhanced Performance/Watt

AMD EPYC Verano CPUs to Support LPDDR5X SOCAMM2 Memory for Optimized AI Rack Scale Solutions with Enhanced Performance/Watt

AMD has announced that its upcoming 6th Generation EPYC Verano CPUs will be the pioneering processors to utilize SOCAMM2 memory, further solidifying its position in delivering performance-per-watt solutions tailored for artificial intelligence.

AMD Introduces SOCAMM2 Memory in 6th Gen EPYC Verano CPUs

Last year marked a significant development for AMD with the unveiling of its next-generation EPYC Verano CPUs, designed for AI application at a rack scale. These processors will work in conjunction with the innovative MI500 accelerators, interconnected through the advanced Vulcano technology. Initial expectations hinted at a potential use of Zen 7 cores; however, AMD has clarified that Verano falls under the umbrella of the 6th Gen EPYC family, sharing characteristics with the Venice processors that utilize Zen 6 cores.

Micron has begun shipping 256 GB LPDDR5X SOCAMM2 memory modules.(Source: Micron)

One of the critical revelations surrounding the EPYC Verano CPUs is their first-to-market support for SOCAMM2 memory. This newer memory format leverages LPDDR5X DRAM modules, promising enhanced bandwidth, larger capacities, and superior energy efficiency—all within a compact design that maximizes memory density.

Micron has recently started delivering SOCAMM2 modules equipped with 256 GB densities, specifically aimed at bolstering AI infrastructures. For instance, NVIDIA’s Vera CPU solution integrates 16 SOCAMM2 modules, comprised of four LPDDR5X modules each, resulting in a total of 64 DRAM packages for heightened performance.

A close-up view of NVIDIA's dual-GPU design highlighting the SOCAMM2 memory module placement.
NVIDIA’s Vera CPX module incorporates multiple SOCAMM2 memory solutions.(Source: NVIDIA)

The 6th generation AMD EPYC Server CPU family will support industry-standard DDR5 RDIMM and MRDIMMs based memory. It will also offer WeUs supporting the new LPDDR5X SOCAMM2-based memory.

In the server market, AMD plans to first support LPDDR5X SOCAMM2 memory with the 6th Generation AMD EPYC Server CPU code-named “Verano” available in 2027. Verano will be the optimized host CPU for future generations of AMD Instinct GPUs and leverage LPDDR5X SOCAMM2 to deliver optimized Perf/System-Watt in AI Rack Scale Solutions from AMD. This combination of bandwidth, power efficiency, and serviceability is expected to make LPDDR5X SOCAMM2 components a valuable, complementary component of next-generation AI and data center infrastructure.

via AMD

Moreover, AMD has confirmed that the EPYC Verano will launch in 2027, serving as the ideal host CPU for the next generation of AMD’s Instinct accelerators—including the MI500 series previously mentioned. Notably, AMD isn’t the only tech giant integrating SOCAMM2 memory into their platforms.

AMD's strategic roadmap showcasing AI infrastructure advancements from 2025 to 2027.
AMD’s official roadmap positions EPYC Verano for the AI racks in 2027.(Source: AMD)

In tandem with AMD, NVIDIA’s next-gen Vera Rubin and Vera CPX platforms are also set to utilize SOCAMM2 LPDDR5X memory. This trend is anticipated across various upcoming AI accelerators, including Tesla’s recently unveiled A15 and several Intel GPU solutions optimized for inference.

The increasing adoption of SOCAMM2 memory exacerbates the existing challenges within the tight memory supply chain. As demand surges, this could impact not only server and PC markets but also the smartphone industry, where low-power DDR memory is crucial. This trend towards concentrated resources for AI solutions may lead to significant disruptions across the technology landscape.

Source & Images

Leave a Reply

Your email address will not be published. Required fields are marked *