"AI tools are making potentially harmful errors in social work records, from bogus warnings of suicidal ideation to simple gibberish, frontline workers have said. Keir Starmer last year championed what he called incredible time-saving social work transcription technology. But research across 17 English and Scottish councils shared with the Guardian has now found AI-generated hallucinations are slipping in. As scores of local authorities begin to use AI note-takers to accelerate recording and summarisation of meetings with adult and child"
"The independent thinktank found that one social worker who had used an AI transcription tool to create a summary said the technology had incorrectly indicated that there was suicidal ideation, but at no point did the client actually talk about suicidal ideation or planning, or anything. Another said that the AI's notes might refer to fishfingers or flies or trees when in fact a child was talking about their parents fighting."
"Dozens of councils from Croydon to Redcar and Cleveland have given social workers access to AI transcription tools, which record and summarise case conversations. The potential time savings are appealing to town halls with chronic staff shortages. One popular system, called Magic Notes, is sold to councils at a cost of between 1.50 and 5 for each hour of transcription."
AI note-taking and transcription tools deployed across multiple English and Scottish local authorities are producing erroneous and potentially harmful entries in official care records. Examples include AI falsely indicating suicidal ideation when clients did not mention it, converting child descriptions of parental fighting into references to fishfingers, flies or trees, and producing gibberish especially with regional accents. Dozens of councils have adopted these tools to save time amid chronic staffing shortages, and some pay services such as Magic Notes around 1.50 to 5 per hour. Such inaccuracies risk missing or misrepresenting patterns of risky behaviour in service users.
Read at www.theguardian.com
Unable to calculate read time
Collection
[
|
...
]