Instagram self-harm alert brings Satna police to a 17-year-old

AI system

System: Instagram self-harm content detection and alert routing
Model: Not assessed
Release: Not assessed
Application developer: Meta Platforms (Instagram)
Role: Not assessed
Configuration: Not assessed
Inputs and outputs: Not assessed
Autonomy: Not assessed
Workflow: Instagram's self-harm detection and alert routing, which per the police flags non-graphic self-harm content and emails state cyber police with account information. A state cyber police unit (Bhopal headquarters and Indore unit) able to trace the account's location from the emailed information, here in about an hour. District police able to reach the person and hold a counseling session with a parent present.
Human oversight: Not assessed
Relation to AI: Police say the alert came by email from Instagram's US office after the videos were posted. An ASP described the platform's AI algorithms as flagging non-graphic self-harm content such as scars, search words and hashtags. No source says whether a classifier or a user report started the alert, or whether Instagram staff reviewed it. Everything after the email was human work. Bhopal and Indore technical teams traced the location in about an hour. Satna police found and counseled her.
AI contribution: Police say the alert came by email from Instagram's US office after the videos were posted. An ASP described the platform's AI algorithms as flagging non-graphic self-harm content such as scars, search words and hashtags. No source says whether a classifier or a user report started the alert, or whether Instagram staff reviewed it. Everything after the email was human work. Bhopal and Indore technical teams traced the location in about an hour. Satna police found and counseled her.

Benefits

Outcome identifiers: Not assessed
Benefit: 3 November 2022, about 5 pm: Instagram emailed MP cyber police a self-harm alert; Bhopal and Indore teams traced a 17-year-old to Satna in about an hour; she was counseled and sent home.
Category: Improved Physical Health
Status: Not assessed
Beneficiary groups: People.
Beneficiaries: Not assessed
Reach: Not assessed
Distribution and access: Not assessed
Duration: Not assessed
Expected?: Yes
Costs and harms: Not assessed

Measurement

Studies: Not assessed
Study design: Not assessed
Measurement: Not assessed
Setting and sample: Not assessed
Measures: Not assessed
Comparison: Not assessed
Results: Not assessed
Additional value from AI: Not assessed
Limitations: Not assessed
Denominators: Not assessed
Materials for replication: Not assessed

Money

Kind of value: Not assessed
Amount: Not assessed
Currency and prices: Not assessed
Period and unit: Not assessed
Realization: Not assessed
Recipients and payers: Not assessed
Gross or net: Not assessed
Included costs: Not assessed
Comparison: Not assessed
Method: Not assessed
Return and payback: Not assessed

People and places

Participants: Developer: Meta Platforms (Instagram). Operator: Instagram; alert acted on by the Madhya Pradesh State Cyber Police (Bhopal headquarters and Indore unit) and Satna Police.
Jurisdictions: Benefit: Satna, India. Developer: United States.
Ownership and control: Not assessed
Dependencies: Not assessed
Cross-border connections: Not assessed
Geopolitical implications: Not assessed

Follow-up

Conditions for replication: The account's IP or other details resolve to a reachable district. The person is found before any act. Here she was found with a small cut on her wrist. A standing channel exists between Instagram and the state cyber police. This was the unit's second such alert.
Replication attempts: 1 follow-up entries. Benefit recurred: 1.
Later findings: Not assessed
Availability: Not assessed
Institutional decision: Not assessed
Grounds: Not assessed
Action and result: Not assessed
Success criterion: Not assessed

Evidence

Source numbers: AIBD-0368-source-0001–0004
Citations: Numbered references below.
Language: Not assessed
Source relationships: Independent
Original evidence: Not assessed
Access and versions: Not assessed
Supported findings: Not assessed
Evidence links: Not assessed
Evidence strength: Not assessed
Missing evidence: Not assessed

Grades

Assessed benefits: People.
Depth: People: 2.
Reasons: People: A 17-year-old had posted videos with poison and an apparent cut. She was reached and counseled within about an hour of the alert and sent home with a small cut on her wrist. By her own account she wanted to scare her boyfriend. An averted suicide rests on the police's framing and is not established.
Observed or intended: Not assessed
Rubric: Not assessed
Assessor and date: Not assessed
Alternative assessments: Not assessed
Fill: Independently reported

Entry details

Kind: Not assessed
Related entries: Not assessed
Field: Suicide prevention / online safety. Social media platforms and police.
Purpose: Instagram's self-harm detection was built to flag content indicating self-harm or suicide risk and route alerts to agencies that can intervene. An alert that brought police to a girl posting self-harm videos was that purpose.
Dates: Date basis unassessed: 2022 (precision unassessed). Updated: 22 October 2026.
Stage: Not assessed
Version: SHA-256: df724059f4e0…

References

Other identifiers: oecd_aim: 2022-11-04-76c5.
Category mappings: Not assessed
Brief: Not assessed
Revisions: 5 revisions. Latest: 22 October 2026.

Sources

News report Independent author

TNN (2022). Instagram alert helps cops prevent a suicide in Madhya Pradesh. The Times of India (Bhopal), 4 November 2022.
News report Independent author

ANI (2022). Madhya Pradesh: Instagram's timely alert to cyber police helps save minor girl's life in Satna. Asian News International, 5 November 2022.
News report Independent author

Team Latestly (2022). Madhya Pradesh: Instagram Timely Alert to Indore Cyber Cops Saves Satna Girl From Ending Life. LatestLY, 4 November 2022.
Registry label Independent author

OECD.AI (2022). Instagram AI Alert Enables Police to Prevent Teen Suicide in Madhya Pradesh. OECD AI Incidents and Hazards Monitor, entry 2022-11-04-76c5.