Huawei Develops ‘AI Memory’ Technology Aiming to Replace HBM and Decrease Dependence on Western Technologies

Huawei is currently spearheading the development of a specialized memory solution tailored for AI applications, which aims to provide a viable alternative to High Bandwidth Memory (HBM) with enhanced capacity and efficiency.

Huawei’s AI SSD: A Potential Game Changer Without Capacity Constraints

Within the landscape of China’s advancements in AI hardware, a significant challenge persists—the scarcity of robust high-bandwidth memory options. Although local players like CXMT have achieved notable milestones, there remains a disparity compared to the more advanced memory technologies available in the West. Recent reports from Chinese media outlets suggest that Huawei is in the process of creating a dedicated AI memory solution, envisioned as a solid-state drive specifically optimized for data centers.

Details regarding this innovative memory solution are still under wraps, but it is believed that Huawei’s offering will mitigate the domestic industry’s dependency on HBM, which has been heavily impacted by geopolitical tensions affecting its supply chain. The report indicates that this AI SSD will eliminate capacity limitations while significantly enhancing computational efficiencies. However, as specific implementation details remain undisclosed, these claims should be approached with cautious optimism.

Huawei has developed its own EDA tools to mass produce the Kirin 9020

In addition to this development, Huawei has introduced a Unified Cache Manager (UCM) software suite designed to expedite the training of large language models (LLMs) across various memory types, including HBM, conventional DRAM, and SSDs. This innovative software allows Huawei to leverage existing memory infrastructures without requiring the most advanced hardware, presenting a strategic workaround to the constraints imposed by HBM shortages. This proactive approach underscores the company’s commitment to overcoming barriers created by external pressures and positions its next-generation AI SSD as a promising solution.

As Huawei continues to aggressively enhance its AI computing toolkit for tasks like inference and training, it is important to note that, although the company still lags behind industry leaders like NVIDIA, its concerted efforts are steadily closing the competitive gap.

Source & Images