"An audit by the auditor general of Ontario found that AI scribes recommended by the provincial government regularly generated incorrect, incomplete and hallucinated information that could "potentially result in inadequate or harmful treatment plans that may potentially impact patient health outcomes.""
"The auditor general reviewed transcription tests of two simulated patient-doctor conversations performed across 20 AI scribe vendors that were approved and pre-qualified by the provincial government for purchase by healthcare providers. All 20 of those vendors showed some issue with accuracy or completeness in at least one of these simple tests, including nine that hallucinated patient information, 12 that recorded information incorrectly, and 17 that missed key details about discussed mental health issues."
"In the report, the auditor general points out multiple concerning examples of mistakes in those summaries that could have a direct and negative impact on a patient's subsequent care. That includes situations where an AI scribe hallucinated nonexistent referrals for blood tests or therapy, incorrectly transcribed the names of prescription medication, and/or missed "key details" of mental health issues discussed in the simulated conversations."
Overworked doctors have used AI medical scribes to convert patient conversations, diagnoses, and care decisions into structured notes for health records. An audit by the auditor general of Ontario found that AI scribes recommended by the provincial government regularly generated incorrect, incomplete, and hallucinated information. Transcription tests used two simulated patient-doctor conversations across 20 pre-qualified AI scribe vendors. Every vendor showed accuracy or completeness problems in at least one test. Nine vendors hallucinated patient information, 12 recorded information incorrectly, and 17 missed key details about mental health issues. Examples included hallucinated referrals for blood tests or therapy, incorrect transcription of prescription medication names, and omission of key mental health details.
Read at Ars Technica
Unable to calculate read time
Collection
[
|
...
]