Years ago, we built clusters of MI50 and MI100 at Microsoft to optimize the training and inferencing of large models with ROCm on AMD GPUs. ND MI300X v5 is the culmination of a long-term partnership between Microsoft and AMD. Microsoft and AMD’s Long-Term Partnership In the end, you save power, cost, and time to solution. This lets customers run the largest, most advanced AI models faster, and with fewer GPUs. ND MI300X v5 has the most HBM capacity available, 1.5 TB per VM or 192 GB of HBM per GPU, the highest HBM capacity available in the cloud. It is ideal for AI applications that need to quickly process vast amounts of data. HBM is essential for AI applications due to its high bandwidth, low power consumption, and compact size. PCIE Gen5 host-to-GPU interconnect with 64GB/s bandwidth per GPUġ.5 TB of HBM Means Processing Bigger AI Models.400 Gb/s NVIDIA Quantum-2 CX7 InfiniBand per GPU with 3.2Tb/s per VM.On top of this, these virtual machines use the same winning platform as our other ND-series VMs, which includes the latest technologies like: With greater capacity and more bandwidth customers can process larger models faster, using fewer GPUs. MI300X offers industry leading HBM capacity and bandwidth, 192 GB of HBM3 memory per GPU capable of speeds up to 5.2 TB/s. What differentiates a ND MI300X v5 VM from our existing family of ND-series VMs is the inclusion of 8 x AMD Instinct MI300X GPUs interconnected via Infinity Fabric 3.0 in each VM. ND MI300X v5, Azure’s AI-focused virtual machine series with largest HBM capacity Our Azure VMs powered with the MI300X GPU give customers even more choices for AI optimized VMs. We’ve created a virtual machine (VM) with an unprecedented 1.5 TB of high bandwidth memory (HBM) that leverages the power of AMD’s flagship MI300X GPU. Today, we're excited to announce the latest milestone in our journey. At Microsoft, we've amassed a decade of experience in supercomputing and have consistently supported the most demanding AI training and generative inferencing workloads. In our relentless pursuit of pushing the boundaries of artificial intelligence, we understand that cutting-edge infrastructure and expertise is needed to harness the full potential of advanced AI.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |