β¨ Read this insightful post from Hacker News π
π Category:
π‘ Key idea:
Concerns over AI surveillance in schools are intensifying after armed officers swarmed a 16-year-old student outside Kenwood High School in Baltimore when an AI gun detection system falsely flagged a Doritos bag as a firearm.
Taki Allen was hanging out with friends after football practice on October 20 when multiple police cars suddenly pulled up.
βIt was like eight cop cars that came pulling up for us,β Allen told WBAL-TV 11 News. βThey started walking toward me with guns, talking about βGet on the ground,β and I was like, βWhat?ββ
βThey made me get on my knees, put my hands behind my back, and cuff me. Then they searched me and found nothing,β he said.
Allen was handcuffed at gunpoint. Police later showed him the AI-captured image that triggered the alert. The crumpled Doritos bag in his pocket had been mistaken for a gun.
βIt was mainly like, am I gonna die? Are they going to kill me? βThey showed me the picture, said that looks like a gun, I said, βno, itβs chips.ββ
Fox/screenshotTaki Allen doesnβt want to return to school after the incident.
Student afraid to return to school after AI sends police after him
The AI system behind the incident is part of Omnilertβs gun detection technology, introduced in Baltimore County Public Schools last year. It scans existing surveillance footage and alerts police in real time when it detects what it believes to be a weapon.
Omnilert later admitted the incident was a βfalse positiveβ but claimed the system βfunctioned as intended,β saying its purpose is to βprioritize safety and awareness through rapid human verification.β
Baltimore County Public Schools echoed the companyβs statement in a letter to parents, offering counseling services to students impacted by the incident.
OmnilertOmnilert says it βdelivers instant gun detectionβ and βnear-zero false positives.β
βWe understand how upsetting this was for the individual that was searched as well as the other students who witnessed the incident,β the principal wrote. βOur counselors will provide direct support to the students who were involved.β
Allen says no one from the school has reached out to him personally.
βThey didnβt apologize. They just told me it was protocol,β he said. βI was expecting at least somebody to talk to me about it.β
The teen now says he no longer feels safe going to school.
βIf I eat another bag of chips or drink something, I feel like theyβre going to come again,β Allen said.
The case has sparked fresh debate over the reliability of AI surveillance tools and their real-world consequences, especially in schools.
This incident comes as more institutions implement AI technology. Earlier this month, Major General William βHankβ Taylor, one of the top officers in the US Army, admitted to using ChatGPT to make key military decisions.
Meanwhile, the UK introduced strict age verification measures for mature content, requiring users to pass a facial scan to prove theyβre over 18. This has left some adults unable to access content, such as Britainβs most tattooed man, who said the age check system told him to βremove his faceβ because it interpreted his tattoos as a mask.
β‘ What do you think?
#οΈβ£ #Armed #police #swarm #student #mistakes #bag #Doritos #weapon
π Posted on 1761252749
