Microsoft is already the use of in-house evolved Azure Maia AI accelerators and Azure Cobalt for its cloud infrastructure wishes. At Ignite 2024, Microsoft introduced the growth of its customized silicon portfolio with the brand new Azure Boost DPU and the Azure Integrated HSM.

Azure Boost DPU is Microsoft’s first in-house DPU in line with the purchase of Fungible ultimate yr. Azure Boost DPU is focused against data-centric workloads to ship top potency and coffee energy intake. Microsoft claims that Azure Boost DPU can soak up a couple of elements of a conventional server right into a unmarried devoted silicon.

Microsoft is making plans to make use of DPUs in its cloud servers to run garage workloads at 3 times much less energy and 4 occasions the efficiency in comparison to conventional servers.

Azure Integrated HSM is a brand new in-house evolved safety chip to harden key control. This lets in encryption and signing keys to stay throughout the bounds of the HSM. This hardware-based way will enhance efficiency with out affecting latency.

Similar to Azure Boost DPU, Microsoft is making plans to make use of Azure Integrated HSM in each and every new server in Microsoft’s records facilities beginning subsequent yr. This new chip will beef up each confidential and general-purpose cloud workloads operating on Azure.

When it involves cloud infrastructure, Microsoft isn’t just operating on silicon. They also are operating on new cooling applied sciences. Microsoft’s next-generation liquid cooling ‘sidekick’ rack (warmth exchanger unit) may also be retrofitted into current Azure records facilities to beef up the cooling of AI infrastructure involving the newest NVIDIA GB200 and others.

Today, Microsoft additionally introduced the preview of the brand new Azure ND GB200 v6 AI-optimized Virtual Machines sequence. This new VM sequence options the newest NVIDIA GB200 NVL 72 rackscale design with Quantum InfiniBand networking to ship advanced AI efficiency.

On the CPU aspect, Microsoft introduced the brand new Azure HBv5 digital machines powered by means of customized AMD EPYC 9V64H processors with beef up for as much as 7 TB/s of reminiscence bandwidth. The Azure HBv5 digital machines preview will likely be to be had in 2025.