US student handcuffed after AI system apparently mistook bag of chips for firearm

"An artificial intelligence system (AI) apparently mistook a high school student's bag of Doritos for a firearm and called local police to tell them the pupil was armed. Taki Allen was sitting with friends on Monday night outside Kenwood high school in Baltimore and eating a snack when police officers with guns approached him. At first, I didn't know where they were going until they started walking toward me with guns, talking about, Get on the ground,' and I was like, What?' Allen told the WBAL-TV 11 News television station."

"They made him get on his knees, handcuffed and searched him finding nothing. They then showed him a copy of the picture that had triggered the alert. I was just holding a Doritos bag it was two hands and one finger out, and they said it looked like a gun, Allen said. Baltimore county high schools last year began using a gun detection system using school cameras and AI to detect potential weapons. If it spots something it believes to be suspicious, it sends an alert to the school and law enforcement."

"We understand how upsetting this was for the individual that was searched as well as the other students who witnessed the incident. Our counselors will provide direct support to the students who were involved in this incident and are also available to speak with any student who may need support. Officers assigned to Precinct 11-Essex responded to Kenwood High School following a report of a suspicious person with a weapon. Once on scene, the person was searched and it was determined the subject was not in possession of any weapons. Nobody wants this to happen to their child. No one wants this to happen."

An AI gun-detection system used by Baltimore County high schools flagged a student as armed after a camera image matched a suspected weapon. Taki Allen was sitting outside Kenwood High School eating Doritos when officers approached, ordered him onto the ground, had him kneel, handcuffed and searched him, and found nothing. The school receives automated alerts from cameras when AI detects potential weapons and notifies law enforcement. The school offered counseling support for involved students, and police confirmed the subject was not in possession of weapons. Family members expressed distress over the incident.

Read at www.theguardian.com