Microsoft and NVIDIA deepen AI collaboration at GTC AI conference

Microsoft and NVIDIA deepen AI collaboration at GTC AI conference

Home » News » Microsoft and NVIDIA deepen AI collaboration at GTC AI conference
Table of Contents

On the NVIDIA GTC AI Convention, Microsoft and NVIDIA made a number of bulletins throughout the complete know-how stack, focusing on builders, startups, and organizations.

Microsoft introduced as we speak that Azure AI Foundry now gives NVIDIA NIM microservices. NIM microservices are pre-built containers powered by NVIDIA inference software program. They’re designed to optimize inference for greater than two dozen fashionable basis fashions, enabling builders to simply deploy Gen AI purposes. Microsoft additionally revealed plans to combine the NVIDIA Llama Nemotron Cause open reasoning mannequin.

Moreover, Microsoft is working with NVIDIA to optimize inference efficiency for open-source language fashions on Azure AI Foundry. For instance, they labored with NVIDIA on efficiency optimization for Meta Llama fashions utilizing TensorRT-LLM. Builders will have the ability to expertise improved efficiency when utilizing these fashions with none further steps.

Microsoft as we speak introduced the overall availability of the next companies:

  • Azure Container Apps serverless GPUs with help for NVIDIA NIM that can permit anybody to run AI workloads on-demand with computerized scaling, optimized chilly begin, and per-second billing with scale right down to zero when not in use.
  • Azure ND GB200 V6 digital machine (VM) sequence accelerated by NVIDIA GB200 NVL72 and NVIDIA Quantum InfiniBand networking.

Microsoft additionally confirmed that the upcoming NVIDIA Blackwell Extremely GPUs and the NVIDIA RTX PRO 6000 Blackwell Server Version will likely be out there on Azure. The NVIDIA Blackwell Extremely GPU-based VMs will likely be out there later in 2025.

Omar Khan, Vice President, Azure Infrastructure Advertising and marketing, wrote the next relating to the brand new bulletins at GTC 2025:

At the moment’s bulletins on the NVIDIA GTC AI Convention underscore Azure’s dedication to pushing the boundaries of AI improvements. With state-of-the-art merchandise, deep collaboration, and seamless integrations, we proceed to ship the know-how that helps and empowers builders and prospects in designing, customizing, and deploying their AI options effectively.

Lastly, Microsoft and NVIDIA have launched preconfigured NVIDIA Omniverse and NVIDIA Isaac Sim digital desktop workstations, and Omniverse Equipment App Streaming, on the Azure market. These VMs will allow builders to shortly begin growing and deploying digital twin and robotics simulation purposes and companies.

author avatar
roosho Senior Engineer (Technical Services)
I am Rakib Raihan RooSho, Jack of all IT Trades. You got it right. Good for nothing. I try a lot of things and fail more than that. That's how I learn. Whenever I succeed, I note that in my cookbook. Eventually, that became my blog. 
share this article.

Enjoying my articles?

Sign up to get new content delivered straight to your inbox.

Please enable JavaScript in your browser to complete this form.
Name