"According to Microsoft, MAI-1-preview uses an in-house mixture-of-experts model that was pre-trained and post-trained on 15,000 Nvidia H100 GPUs, a more modest infrastructure than the 100,000 H100 cluster sizes reportedly used for model development by some rivals. However, with an eye to ramping up performance, Microsoft AI is now running MAI-1-preview on Nvidia's more powerful GB200 cluster, the company said."
"Hitherto, the company has relied on models from OpenAI, a company it has invested a reported $13 billion in since 2019 and which uses the Azure cloud platform to host its models and services. However, in 2024 Microsoft surprised the industry by hiring former DeepMind founder Mustafa Suleyman and his Inflection AI startup team to develop AI models for Microsoft AI, independent of OpenAI."
MAI-1-preview uses an in-house mixture-of-experts model pre-trained and post-trained on 15,000 Nvidia H100 GPUs, compared with rivals' reportedly 100,000 H100 clusters. Microsoft AI is running MAI-1-preview on Nvidia's GB200 cluster to improve performance. Microsoft had relied on OpenAI models after investing a reported $13 billion since 2019, with OpenAI using Azure to host models and services. In 2024 Microsoft hired former DeepMind founder Mustafa Suleyman and his Inflection AI startup team to develop AI models for Microsoft AI independent of OpenAI. Inflection AI continues developing enterprise AI with a new CEO while the founders and core team work on Microsoft's Copilot.
Read at InfoWorld
Unable to calculate read time
Collection
[
|
...
]