OpenAI Launches ChatGPT Health, Which Ingests Your Entire Medical Records, But Warns Not to Use It for "Diagnosis or Treatment"

"A recent investigation by The Guardian, for instance, found that Google's AI Overviews, which accompany most search results pages, doled out plenty of inaccurate health information that could lead to grave health risks if followed. But seemingly unperturbed by experts' repeated warnings that AI's health advice shouldn't be trusted, OpenAI is doubling down by launching a new feature called ChatGPT Health, which will ingest your medical records to generate responses "more relevant and useful to you.""

"Yet despite being "designed in close collaboration with physicians" and built on "strong privacy, security, and data controls," the feature is "designed to support, not replace, medical care." In fact, it's shipping with a ludicrously self-defeating caveat: that the bespoke health feature is "not intended for diagnosis or treatment." "ChatGPT Health helps people take a more active role in understanding and managing their health and wellness - while supporting, not replacing, care from clinicians," the company's website reads."

"In reality, users are certain to use it for exactly the type of health advice that OpenAI is warning against in the fine print, which is likely to bring fresh new embarrassments for the company. It'll only be heightening existing problems for the company. As Business Insider reports, ChatGPT is "making amateur lawyers and doctors out of everyone," to the dismay of legal and medical professionals."

AI chatbots are widely used but frequently provide inaccurate and potentially dangerous health guidance, generating a flood of easily accessible misinformation. Many users become informal experts who rely on obsolete, misattributed, or fabricated advice. An investigation found Google's AI Overviews supplied inaccurate health information that could cause grave harm if followed. OpenAI is introducing ChatGPT Health to ingest medical records and personalize responses while claiming physician collaboration and strong privacy controls, yet explicitly stating the tool is not intended for diagnosis or treatment. Experts warn users will nonetheless seek medical guidance from such tools, increasing legal, safety, and reputational risks.

Read at Futurism