Kota police act on a Meta self-harm flag within a week of tie-up

Kota City SP Amrita Duhan said Meta's red-flag tags for suicidal posts go to a round-the-clock police team; within a week, police prevented a possible suicide by a student from Jhunjhunu (PTI).

AI system

System

Meta suicide and self-injury detection on Facebook and Instagram, with red-flag tags shared with Kota police and Abhay Command Centre

Model

Not assessed

Release

Not assessed

Application developer

Meta Platforms

Role

Not assessed

Configuration

Not assessed

Inputs and outputs

Not assessed

Autonomy

Not assessed

Workflow

Meta's detection-and-review pipeline flagging suicide or self-harm posts by students on Facebook and Instagram. A standing arrangement under which Meta shares account information with Kota police. For students outside Kota it goes to Abhay Command Centre or a district control room. A police team monitoring the flags round the clock in eight-hour shifts.

Human oversight

Not assessed

Relation to AI

PTI's report says the chain starts with a red-flag tag on Meta's system when a student posts suicide or self-harm content. Account information is then shared with police. It does not say whether Meta's classifier or a user report raised the flag in the Jhunjhunu case, nor what happened on arrival. Meta's own description (2018, updated 2021) says machine-learning detection is followed by human review before authorities are contacted. The intervention itself was police work. PTI also notes that no red-flag tags had been reported in Kota city since the launch.

AI contribution

PTI's report says the chain starts with a red-flag tag on Meta's system when a student posts suicide or self-harm content. Account information is then shared with police. It does not say whether Meta's classifier or a user report raised the flag in the Jhunjhunu case, nor what happened on arrival. Meta's own description (2018, updated 2021) says machine-learning detection is followed by human review before authorities are contacted. The intervention itself was police work. PTI also notes that no red-flag tags had been reported in Kota city since the launch.

Benefits

Outcome identifiers

Not assessed

Benefit

Kota City SP Amrita Duhan said Meta's red-flag tags for suicidal posts go to a round-the-clock police team; within a week, police prevented a possible suicide by a student from Jhunjhunu (PTI).

Category

Improved Physical Health

Status

Not assessed

Beneficiary groups

People.

Beneficiaries

Not assessed

Reach

Not assessed

Distribution and access

Not assessed

Duration

Not assessed

Expected?

Yes

Costs and harms

Not assessed

Measurement

Studies

Not assessed

Study design

Not assessed

Measurement

Not assessed

Setting and sample

Not assessed

Measures

Not assessed

Comparison

Not assessed

Results

Not assessed

Additional value from AI

Not assessed

Limitations

Not assessed

Denominators

Not assessed

Materials for replication

Not assessed

Money

Kind of value

Not assessed

Amount

Not assessed

Currency and prices

Not assessed

Period and unit

Not assessed

Realization

Not assessed

Recipients and payers

Not assessed

Gross or net

Not assessed

Included costs

Not assessed

Comparison

Not assessed

Method

Not assessed

Return and payback

Not assessed

People and places

Participants

Developer: Meta Platforms. Operator: Kota City Police (Rajasthan Police), Abhay Command Centre.

Jurisdictions

Benefit: Kota, India. Developer: United States. Operator: India.

Ownership and control

Not assessed

Dependencies

Not assessed

Cross-border connections

Not assessed

Geopolitical implications

Not assessed

Follow-up

Conditions for replication

The student must post on Facebook or Instagram in a way the pipeline recognizes. Account details must resolve to a reachable location in time. Police must be able to reach the student quickly.

Replication attempts

Not assessed

Later findings

Not assessed

Availability

Not assessed

Institutional decision

Not assessed

Grounds

Not assessed

Action and result

Not assessed

Success criterion

Not assessed

Evidence

Source numbers

AIBD-0371-source-0001–0004

Citations

Numbered references below.

Language

Not assessed

Source relationships

Independent, Developer

Original evidence

Not assessed

Access and versions

Not assessed

Supported findings

Not assessed

Evidence strength

Not assessed

Missing evidence

Not assessed

Grades

Assessed benefits

People.

Depth

Not assessed

Reasons

People: PTI reports only that police “prevented a possible suicide by a student hailing from the Jhunjhunu district” within a week of the launch. The sources give no account of what the student posted, their condition when reached or what officers did. So the outcome is not established.

Observed or intended

Not assessed

Rubric

Not assessed

Assessor and date

Not assessed

Alternative assessments

Not assessed

Fill

Independently reported

Entry details

Kind

Not assessed

Field

Suicide prevention / online safety. Social media platforms and police.

Purpose

Meta's pipeline is built to find posts indicating suicide or self-injury risk and route them to trained reviewers. In imminent cases it contacts local authorities (Meta Newsroom). The Kota arrangement routes those flags to police to intervene. This case is that purpose.

Dates

Date basis unassessed: 2024 (precision unassessed). Updated: 22 October 2026.

Stage

Not assessed

Version

SHA-256: fde9db963ea3…

References

Other identifiers

oecd_aim: 2024-05-28-2dfd.

Category mappings

Not assessed

Brief

Not assessed

Revisions

5 revisions. Latest: 22 October 2026.

Sources

  1. News report Independent author

    PTI (2024). Kota Police Ropes in Meta to Prevent Suicides Among Coaching Students. LatestLY, 28 May 2024.

  2. Press release Developer

    Card, C. (2018). How Facebook AI Helps Suicide Prevention. Meta Newsroom, 10 September 2018 (updated 29 September 2021).

  3. Registry label Independent author

    OECD AI Incidents and Hazards Monitor (2024). Kota Police and Meta Use AI Monitoring to Prevent Student Suicides. OECD.AI, 28 May 2024.