"At an international summit co-hosted by the U.K. and South Korea in February 2024, Google and other signatories promised to "publicly report" their models' capabilities and risk assessments, as well as disclose whether outside organizations, such as government AI safety institutes, had been involved in testing. However, when the company released Gemini 2.5 Pro in March 2025, the company failed to publish a model card, the document that details key information about how models are tested and built."
"The letter called Google's delay a 'failure to honour' the company's commitment at the summit and 'a troubling breach of trust with governments and the public.' The letter also took issue with what it called a 'minimal 'model card'' that lacked 'any substantive detail about external evaluations,' as well as Google's refusal to confirm whether government agencies like the U.K. AI Security Institute participated in testing."
"This was despite the company's assertions that the new model outperformed competitors on industry benchmarks by 'meaningful margins.' Instead, the AI lab released a simplified six-page model card three weeks after it first made the model publicly available as a 'preview' version. At the time, one AI governance expert called this report 'meager' and 'worrisome.' A spokesperson for Google DeepMind previously told Fortune that any suggestion that the company had reneged on its commitments was 'inaccurate.'"
Sixty U.K. lawmakers accused Google DeepMind of violating its Frontier AI Safety Commitments after releasing Gemini 2.5 Pro without providing key safety information. At a February 2024 summit co-hosted by the U.K. and South Korea, signatories promised to publicly report model capabilities, risk assessments, and whether external organizations participated in testing. Gemini 2.5 Pro launched in March 2025 without a full model card; DeepMind released a simplified six-page model card three weeks later. Critics called the delayed, minimal documentation a failure to honor commitments and a breach of trust, while DeepMind denied reneging and said a more detailed technical report would follow.
Read at Fortune
Unable to calculate read time
Collection
[
|
...
]