Microsoft announces availability of cost-effective AMD MI300X accelerator-based VMs on Azure

Home » News

Reading time icon 1 min. read

Calendar icon Updated on

by Pradeep Viswav 

updated on

Share this article

Readers help support MSpoweruser. We may get a commission if you buy through our links. Tooltip Icon

Read our disclosure page to find out how can you help MSPoweruser sustain the editorial team Read more

Key notes

  • Microsoft claims that this new AMD accelerator is the most cost-effective GPU out there right now for Azure OpenAI.
AMD Azure MIX3000 VMs

At Build 2024, Microsoft today announced the general availability of AMD MI300X accelerator-based VMs on Azure. The new ND MI300X VM series makes Azure the first cloud platform to bring AMD’s Instinct MI300X Accelerator for customers. The ND MI300X VM combines eight AMD MI300X Instinct accelerators delivering great cost-performance for inferencing. Microsoft claims that this new AMD accelerator is the most cost-effective GPU out there right now for Azure OpenAI.

AMD MI300X is based on the next-gen AMD CDNA 3 accelerator architecture and supports up to 192 GB of HBM3 memory. With the large memory, customers can fit a large language model up to 40B on a single, MI300X accelerator. The AMD Instinct Platform brings together eight MI300X.

Pradeep Viswav

Pradeep Viswav Shield

Software and Services Expert

Pradeep is a Computer Science and Engineering Graduate. He was also a Microsoft Student Partner. He is currently working in a leading IT company.

User forum

0 messages