Concerns over AI surveillance in schools are intensifying after armed officers swarmed a 16-year-old student outside Kenwood High School in Baltimore when an AI gun detection system falsely flagged a Doritos bag as a firearm.
Allen was handcuffed at gunpoint. Police later showed him the AI-captured image that triggered the alert. The crumpled Doritos bag in his pocket had been mistaken for a gun.
“yeah this time it wasn’t a gun, but the kid is black for Christ’s sake, what did you expect us to do? So obviously its functioning as intended.”
This is pretty much my takeaway as well
It successfully got a false positive that resulted in a black kid getting swarmed by police. Job well done, amirite?
The purpose of a system is what it does, indeed.