What is Microsoft Maia?

"With AI taking over the tech world, Microsoft is doubling down on cloud-scale AI infrastructure by building its own silicon, starting with the Azure Maia 100. Unveiled in November 2023, Maia is Microsoft's custom AI accelerator, designed from the ground up, to power the next generation of large-language models, generative AI, and other demanding machine-learning workloads inside its Azure cloud."

"With more than 100 billion transistors, Maia represents Microsoft's intention to break reliance on external GPUs and offer hyperscale AI computing on its own terms. The Maia 100 chip is Microsoft's custom-designed AI accelerator built for large-scale, cloud-based artificial intelligence workloads, including training and inferencing for generative AI models, powering services like Azure OpenAI and Copilot, with goals to improve performance, reduce costs, and lessen reliance on third-party GPU vendors like Nvidia by optimizing the entire hardware-software"

Microsoft unveiled the Azure Maia 100 in November 2023 as a custom AI accelerator built for large-scale cloud AI workloads. Maia contains more than 100 billion transistors and targets training and inference for generative AI and large-language models at hyperscale. The design aims to improve performance and reduce operating costs while decreasing dependence on third-party GPU vendors such as Nvidia. Maia integrates hardware and software co-optimization to serve services like Azure OpenAI and Copilot and to enable Microsoft's control over AI infrastructure at Azure cloud scale. The chip prioritizes efficiency, scalability, and tight integration with Azure services.

Read at IT Pro