"According to Microsoft, MAI-1-preview uses an in-house mixture-of-experts model that was pre-trained and post-trained on 15,000 Nvidia H100 GPUs, a more modest infrastructure than the 100,000 H100 cluster sizes reportedly used for model development by some rivals. However, with an eye to ramping up performance, Microsoft AI is now running MAI-1-preview on Nvidia's more powerful GB200 cluster, the company said."
"Hitherto, the company has relied on models from OpenAI, a company it has invested a reported $13 billion in since 2019 and which uses the Azure cloud platform to host its models and services. However, in 2024 Microsoft surprised the industry by hiring former DeepMind founder Mustafa Suleyman and his Inflection AI startup team to develop AI models for Microsoft AI, independent of OpenAI."
MAI-1-preview uses an in-house mixture-of-experts model pre-trained and post-trained on 15,000 Nvidia H100 GPUs, a smaller infrastructure than rivals' reported 100,000 H100 clusters. Microsoft AI is now running MAI-1-preview on Nvidia's more powerful GB200 cluster to boost performance. Historically, Microsoft relied on OpenAI models, having invested a reported $13 billion since 2019 and hosting those models on the Azure cloud platform. In 2024, Microsoft hired former DeepMind founder Mustafa Suleyman and his Inflection AI startup team to develop AI models for Microsoft AI independently of OpenAI. Inflection AI continues developing its own enterprise AI under a new CEO while the founders and core team work on Microsoft's Copilot products.
Read at InfoWorld
Unable to calculate read time
Collection
[
|
...
]