"These days, AI surveillance systems are everywhere. They're watching our roads, tracking our purchases at the grocery store, and even monitoring school bathrooms. Yet those systems come with a harmful catch - they're a little too good at flagging bad behavior, leading to a staggering number of arrests and involuntary detentions. New reporting by the Milwaukee Independent found that schools deploying surveillance systems to watch for online chatter referencing violence have logged an astonishing number of positive hits."
"In one school district in Lawrence, Kansas, for example, an online safety monitoring tool called Gaggle flagged over 1,200 online incidents over a 10-month period. Yet two thirds of those alerts were nonissues. While many false positives can be waved away, schools in states with zero-tolerance reporting laws like Tennessee or Florida are required to inform police officials about cases where students hint at violence in any form."
AI-driven monitoring systems in schools generate large numbers of alerts for online chatter referencing violence, many of which are not actionable threats. Some districts report thousands of flagged incidents, with substantial portions categorized as nonissues. States with zero-tolerance reporting laws require schools to notify police about any student hints of violence, which can lead to arrests or involuntary hospitalizations under laws like the Baker Act. Many students are unaware that emails, chats, and searches on school equipment are monitored. Involuntary examinations and detentions can be experienced as traumatic and damaging rather than helpful for mental health care.
Read at Futurism
Unable to calculate read time
Collection
[
|
...
]