AI system
- System
-
Meta suicide and self-injury detection on Facebook and Instagram, with red-flag tags shared with Kota police and Abhay Command Centre
- Model
-
Not assessed
- Release
-
Not assessed
- Application developer
-
Meta Platforms - Role
-
Not assessed
- Configuration
-
Not assessed
- Inputs and outputs
-
Not assessed
- Autonomy
-
Not assessed
- Workflow
-
Meta's detection-and-review pipeline flagging suicide or self-harm posts by students on Facebook and Instagram. A standing arrangement under which Meta shares account information with Kota police. For students outside Kota it goes to Abhay Command Centre or a district control room. A police team monitoring the flags round the clock in eight-hour shifts.
- Human oversight
-
Not assessed
- Relation to AI
-
PTI's report says the chain starts with a red-flag tag on Meta's system when a student posts suicide or self-harm content. Account information is then shared with police. It does not say whether Meta's classifier or a user report raised the flag in the Jhunjhunu case, nor what happened on arrival. Meta's own description (2018, updated 2021) says machine-learning detection is followed by human review before authorities are contacted. The intervention itself was police work. PTI also notes that no red-flag tags had been reported in Kota city since the launch.
- AI contribution
-
PTI's report says the chain starts with a red-flag tag on Meta's system when a student posts suicide or self-harm content. Account information is then shared with police. It does not say whether Meta's classifier or a user report raised the flag in the Jhunjhunu case, nor what happened on arrival. Meta's own description (2018, updated 2021) says machine-learning detection is followed by human review before authorities are contacted. The intervention itself was police work. PTI also notes that no red-flag tags had been reported in Kota city since the launch.
Benefits
- Outcome identifiers
-
Not assessed
- Benefit
-
Kota City SP Amrita Duhan said Meta's red-flag tags for suicidal posts go to a round-the-clock police team; within a week, police prevented a possible suicide by a student from Jhunjhunu (PTI).
- Category
-
Improved Physical Health
- Status
-
Not assessed
- Beneficiary groups
-
People.
- Beneficiaries
-
Not assessed
- Reach
-
Not assessed
- Distribution and access
-
Not assessed
- Duration
-
Not assessed
- Expected?
-
Yes
- Costs and harms
-
Not assessed
Measurement
- Studies
-
Not assessed
- Study design
-
Not assessed
- Measurement
-
Not assessed
- Setting and sample
-
Not assessed
- Measures
-
Not assessed
- Comparison
-
Not assessed
- Results
-
Not assessed
- Additional value from AI
-
Not assessed
- Limitations
-
Not assessed
- Denominators
-
Not assessed
- Materials for replication
-
Not assessed
Money
- Kind of value
-
Not assessed
- Amount
-
Not assessed
- Currency and prices
-
Not assessed
- Period and unit
-
Not assessed
- Realization
-
Not assessed
- Recipients and payers
-
Not assessed
- Gross or net
-
Not assessed
- Included costs
-
Not assessed
- Comparison
-
Not assessed
- Method
-
Not assessed
- Return and payback
-
Not assessed
People and places
- Participants
-
Developer:
Meta Platforms. Operator: Kota City Police (Rajasthan Police), Abhay Command Centre. - Jurisdictions
-
Benefit: Kota,
India. Developer:
United States. Operator:
India. - Ownership and control
-
Not assessed
- Dependencies
-
Not assessed
- Cross-border connections
-
Not assessed
- Geopolitical implications
-
Not assessed
Follow-up
- Conditions for replication
-
The student must post on Facebook or Instagram in a way the pipeline recognizes. Account details must resolve to a reachable location in time. Police must be able to reach the student quickly.
- Replication attempts
-
Not assessed
- Later findings
-
Not assessed
- Availability
-
Not assessed
- Institutional decision
-
Not assessed
- Grounds
-
Not assessed
- Action and result
-
Not assessed
- Success criterion
-
Not assessed
Evidence
- Source numbers
-
AIBD-0371-source-0001–0004
- Citations
-
Numbered references below.
- Language
-
Not assessed
- Source relationships
-
Independent, Developer
- Original evidence
-
Not assessed
- Access and versions
-
Not assessed
- Supported findings
-
Not assessed
- Evidence links
-
Not assessed
- Evidence strength
-
Not assessed
- Missing evidence
-
Not assessed
Grades
- Assessed benefits
-
People.
- Depth
-
Not assessed
- Reasons
-
People: PTI reports only that police “prevented a possible suicide by a student hailing from the Jhunjhunu district” within a week of the launch. The sources give no account of what the student posted, their condition when reached or what officers did. So the outcome is not established.
- Observed or intended
-
Not assessed
- Rubric
-
Not assessed
- Assessor and date
-
Not assessed
- Alternative assessments
-
Not assessed
- Fill
-
Independently reported
Entry details
- Kind
-
Not assessed
- Related entries
-
Not assessed
- Field
-
Suicide prevention / online safety. Social media platforms and police.
- Purpose
-
Meta's pipeline is built to find posts indicating suicide or self-injury risk and route them to trained reviewers. In imminent cases it contacts local authorities (Meta Newsroom). The Kota arrangement routes those flags to police to intervene. This case is that purpose.
- Dates
-
Date basis unassessed: 2024 (precision unassessed). Updated: 22 October 2026.
- Stage
-
Not assessed
- Version
-
SHA-256: fde9db963ea3…
References
- Other identifiers
-
oecd_aim: 2024-05-28-2dfd.
- Category mappings
-
Not assessed
- Brief
-
Not assessed
- Revisions
-
5 revisions. Latest: 22 October 2026.
Sources
-
News report Independent author
the police have prevented a possible suicide by a student hailing from the Jhunjhunu district
A dedicated team, working round the clock on eight-hour shifts, has been deputed at Abhay Command Centre
-
Press release Developer
Card, C. (2018). How Facebook AI Helps Suicide Prevention. Meta Newsroom, 10 September 2018 (updated 29 September 2021).
Since these efforts began last year, we've worked with first responders on over 1,000 wellness checks based on reports we've received from our proactive detection efforts.
-
Registry label Independent author
OECD AI Incidents and Hazards Monitor (2024). Kota Police and Meta Use AI Monitoring to Prevent Student Suicides. OECD.AI, 28 May 2024.
Within a week, officers intervened to avert a suicide attempt from a student in Jhunjhunu.
Collections: Cross-border cases, Safeguards, Security and threat-watching.