Microsoft enhances custom silicon lineup with security chip and DPU
Microsoft Expands Custom Silicon Portfolio at Ignite 2024
During the Ignite 2024 conference, Microsoft unveiled significant enhancements to its cloud infrastructure, showcasing the new Azure Boost DPU and Azure Integrated HSM. These innovations are part of the company’s ongoing commitment to optimizing performance and efficiency in its cloud offerings, leveraging in-house developed technologies such as the Azure Maia AI accelerators and Azure Cobalt.
Introducing Azure Boost DPU
The Azure Boost DPU represents Microsoft’s first dedicated data processing unit (DPU), stemming from its strategic acquisition of Fungible last year. This advanced solution is engineered to handle data-intensive workloads, providing exceptional efficiency while minimizing power consumption. Microsoft asserts that the Azure Boost DPU can consolidate various server components into a single, purpose-built silicon chip, thereby enhancing overall system performance.
With the implementation of DPUs in its cloud servers, Microsoft aims to significantly reduce power usage for storage workloads—achieving performance levels up to four times higher than traditional servers while consuming three times less power.
Enhancing Security with Azure Integrated HSM
Alongside the DPU, Microsoft introduced the Azure Integrated HSM, a newly developed security chip designed to bolster key management systems. This hardware-based solution ensures that encryption and signing keys remain securely within the HSM, enhancing operational inefficiency without introducing latency challenges.
Similar to the Boost DPU, the Azure Integrated HSM will be integrated into all new servers deployed within Microsoft’s data centers starting next year. This chip will cater to both confidential and general-purpose cloud workloads on the Azure platform.
Innovative Cooling Solutions for Enhanced Performance
In addition to hardware advancements, Microsoft is also innovating in cooling technologies. The company has developed a next-generation liquid cooling solution, termed the “sidekick” rack, which can be retrofitted into existing Azure data centers. This system is designed to effectively cool AI infrastructures, including those utilizing the latest NVIDIA GB200 technologies.
New AI-Optimized Virtual Machines
Furthermore, Microsoft announced the preview of its new Azure ND GB200 v6 AI-optimized Virtual Machines series. This series incorporates NVIDIA’s latest GB200 NVL 72 rackscale design alongside Quantum InfiniBand networking, aimed at delivering superior AI performance.
Advanced CPU Offerings with Azure HBv5
On the CPU front, the company introduced the Azure HBv5 virtual machines, which are powered by custom AMD EPYC 9V64H processors. These machines support a remarkable 7 TB/s of memory bandwidth, marking a significant improvement in computational capabilities. The Azure HBv5 virtual machine preview is set to launch in 2025.
These advancements reflect Microsoft’s dedication to pushing the boundaries of cloud technology, ensuring that its infrastructure remains at the forefront of innovation in the tech industry.
Leave a Reply