Google puts users at risk by downplaying health disclaimers under AI Overviews

"Google is putting people at risk of harm by downplaying safety warnings that its AI-generated medical advice may be wrong. When answering queries about sensitive topics such as health, the company says its AI Overviews, which appear above search results, prompt users to seek professional help, rather than relying solely on its summaries. AI Overviews will inform people when it's important to seek out expert advice or to verify the information presented, Google has said."

"But the Guardian found the company does not include any such disclaimers when users are first presented with medical advice. Google only issues a warning if users choose to request additional health information and click on a button called Show more. Even then, safety labels only appear below all of the extra medical advice assembled using generative AI, and in a smaller, lighter font."

"For medical advice or a diagnosis, consult a professional. AI responses may include mistakes. Google did not deny its disclaimers fail to appear when users are first served medical advice, or that they appear below AI Overviews and in a smaller, lighter font. AI Overviews encourage people to seek professional medical advice, and frequently mention seeking medical attention within the summary itself when appropriate, a spokesperson said."

Google's AI Overviews appear above search results and are intended to prompt users to seek professional help rather than rely solely on summaries. Disclaimers that advise seeking expert advice or verifying information do not appear when users are first presented with medical advice. Warnings only show after users click a 'Show more' button, and safety labels are placed below additional AI-generated medical content in smaller, lighter font. The disclaimer states: 'For medical advice or a diagnosis, consult a professional. AI responses may include mistakes.' Google did not deny the placement and visibility issues. AI experts and patient advocates said disclaimers should appear prominently.

Read at www.theguardian.com