NVIDIA Teams Up With Kioxia to Create AI-Optimized SSDs Promising Speed Up to 100x Faster Than Traditional Models

NVIDIA, alongside its strategic partners, is heralding a new era in the realm of ‘AI memory.’ According to recent announcements, Kioxia is set to innovate commercial SSDs that could operate up to 100 times faster than traditional solid-state drives, reshaping the landscape of high-performance computing.

NVIDIA Explores Future Beyond HBM with Partnered SSD Technology

In a significant shift, NVIDIA appears ready to transition from High Bandwidth Memory (HBM), turning its focus towards advanced SSD technology that promises enhanced performance metrics exceeding those of current HBM options. A report from Nikkei reveals a collaboration between NVIDIA and Kioxia aimed at developing next-generation AI SSDs. These innovative drives could achieve speeds that are 100 times faster than standard alternatives, thus positioning themselves as a superior substitute for HBM by providing both greater capacity and the potential for direct mounting on graphics processing units (GPUs).

NVIDIA’s ambitious goal for this new solution is to reach a staggering 200 million Input/Output Operations Per Second (IOPS).To accomplish this, Kioxia plans to utilize two distinct SSDs, each targeting 100 million IOPS, enabling the envisioned performance. The forthcoming SSDs are expected to leverage PCIe 7.0 connectivity, which is necessary to fulfill NVIDIA’s speed aspirations. Moreover, Kioxia indicated that a substantial redesign would be required to replace HBM functionality with SSD-like attributes, potentially marking the introduction of High-Bandwidth Flash (HBF) technology by the company.

Performance comparison chart of HBF against HBM — Image Credits: SanDisk

HBF addresses the inherent limitations of traditional NAND memory, a standard initially pioneered by SanDisk. The notable advantage of HBF lies in its ability to deliver vast storage capacities, reaching up to terabytes per device. This capability allows data centers to tap into substantial memory reserves for demanding inferencing tasks. Yet, Kioxia’s strategy may extend beyond HBF, as the company is also investing in innovative solutions like XL-Flash, a high-performance NAND technology designed for optimized efficiency and speed.

It is truly fascinating to observe how the industry is navigating around the constraints of HBM, transitioning towards cutting-edge solutions. The implications for NAND technology are profound, suggesting it will play a pivotal role in the advancing field of AI memory.

Source & Images