Microsoft launches latest Azure virtual machines optimized for AI supercomputing
Organizations training and deploying large AI models need infrastructure that won't slow them down. This blog post highlights Microsoft's latest AI-optimized Azure virtual machines — including new ND H200 v5 instances powered by NVIDIA H100 Tensor Core GPUs — and explains how they support compute-intensive workloads for faster innovation. Read the blog to understand the performance breakthroughs. Contact Gelom Technologies for help planning your next AI deployment on Azure.
What are Azure ND H200 v5 Virtual Machines?
The Azure ND H200 v5 series virtual machines are cloud-based AI-supercomputing clusters designed to support advanced AI workloads. They are optimized for tasks such as foundational model training and generative inferencing, providing scalable and high-performance infrastructure to help businesses develop innovative AI-driven solutions.
What improvements do the ND H200 v5 VMs offer?
The ND H200 v5 VMs feature an increase of 76% in High Bandwidth Memory (HBM) to 141GB and a 43% increase in HBM Bandwidth to 4.8 TB/s compared to the ND H100 v5 series. These enhancements allow for faster access to model parameters, reducing application latency, and enabling the handling of more complex Large Language Models (LLMs) within a single VM.
How do ND H200 v5 VMs support AI workloads?
The ND H200 v5 VMs are designed to manage GPU memory more efficiently for model weights and batch sizes, which directly impacts throughput and latency in generative AI inference workloads. Early tests have shown up to a 35% increase in throughput for inference tasks compared to the ND H100 v5 series, making them suitable for both small and large language models.
.jpg)
Microsoft launches latest Azure virtual machines optimized for AI supercomputing
published by Gelom Technologies
Gelom Technologies Limited is a Kenyan company established since 2019. Gelom Technologies core business is Value-Added Distributor (VAD), Value-Added Reseller (VAR) and Systems Integration (SI).
We specialize in cyber security, digital transformation and drones technology.
- Our cyber security products and services are for both information technology (IT) & operational technology (OT). In this business segment we cover the following areas: strategy & risk management, digital trust, threat management and cloud security through partnership with leading global players and manufacturers.
- Our digital transformation products and services include the following solutions: electronic documents signing, contract lifecycle management, document generation, contract negotiation, e-learning softwares, supply & blockchain solutions.
- Our Unmanned Aerial Vehicles (Drones) solutions are for construction, mining, survey, mapping, utilities inspection, precision agriculture and logistics.
We have strong business alliances with major technology companies most of whom are leaders in noticeable market research organizations like Gartner Magic Quadrant. They include but not limited to IBM, Kaspersky, BlackBerry, DocuSign, Radware, Sophos, Inspira Enterprises, SMART Technologies and Microdrones.
With the global technology trends towards IT/OT Security, Digital Transformation and Unmanned Aerial Vehicles over the last few years, Gelom Technologies Ltd has developed skills to enable the integration of these and other technologies to provide unique and innovative solutions that meet the specific customer’s needs.
We have selected best of breed products that integrates seamlessly to deliver the reliability, performance, security and scalability that business demands. In making the choices, we always consider our technical support strengths and are certain that Gelom Technologies will be able to fully support the deployed solutions.
Sign in with LinkedIn