AI system
- System
-
ChatGPT with OpenAI's safety-monitoring pipeline (automated classifiers plus human review and law-enforcement referral)
- Application developer
-
OpenAI
- Configuration
-
Not assessed
- Workflow
-
The user typed explicit, dated threats against an identifiable child into ChatGPT over about two months, naming means and a hired killer. OpenAI's moderation process, automated classifiers plus human review, flagged the account. The company chose to refer it to the FBI under its policy on imminent threats to others. A standing FBI-to-Brazil channel through the Ministry of Justice CyberLab relayed the file to the state police within days. The Polícia Civil do Espírito Santo prioritized the case, identified the user, confirmed the child existed and obtained warrants before the stated date.
- Human oversight
-
Not assessed
- Relation to AI
-
OpenAI's automated classifiers and human reviewers flagged the user's messages, and the company chose to refer the account to the FBI. The system did not predict a crime or act on its own. The warrants, the arrest and the evidence-gathering were police and court actions. OpenAI sent only the user's prompts, not ChatGPT's replies. What the assistant said to the user, and whether it helped or hindered him, is unknown.
- AI contribution
-
OpenAI's automated classifiers and human reviewers flagged the user's messages, and the company chose to refer the account to the FBI. The system did not predict a crime or act on its own. The warrants, the arrest and the evidence-gathering were police and court actions. OpenAI sent only the user's prompts, not ChatGPT's replies. What the assistant said to the user, and whether it helped or hindered him, is unknown.
Benefits
- Outcome identifiers
-
Not assessed
- Benefit
-
held him a day before his stated date
- Category
-
Reduced Violence
- Beneficiary groups
-
People. Organizations.
- Beneficiaries
-
Not assessed
- Distribution and access
-
Not assessed
- Costs and harms
-
Not assessed
Measurement
- Study design
-
Not assessed
- Setting and sample
-
Not assessed
- Measures
-
held him a day before his stated date
- Results
-
held him a day before his stated date
- Additional value from AI
-
Not assessed
- Denominators
-
Not assessed
- Materials for replication
-
Not assessed
Money
- Kind of value
-
Not assessed
- Currency and prices
-
Not assessed
- Period and unit
-
Not assessed
- Recipients and payers
-
Not assessed
- Gross or net
-
Not assessed
- Included costs
-
Not assessed
- Return and payback
-
Not assessed
People and places
- Participants
-
Developer:
OpenAI. Operator:
OpenAI.
- Ownership and control
-
Not assessed
- Dependencies
-
Not assessed
- Cross-border connections
-
Not assessed
- Geopolitical implications
-
Not assessed
Follow-up
- Conditions for replication
-
The user discloses the plan to the assistant rather than keeping it offline. The vendor's reviewers judge the threat credible and imminent and choose referral rather than only an account ban. A cross-border law-enforcement channel exists and acts within days. Local police can identify the user from the vendor's data and secure judicial warrants before the stated date.
- Replication attempts
-
Not assessed
- Later findings
-
13 August 2026. He was released on 13 August 2026 after a court granted habeas corpus, under an ankle monitor and a no-contact order, with the inquiry continuing.
- Availability
-
Not assessed
- Institutional decision
-
Not assessed
- Action and result
-
Not assessed
- Success criterion
-
Not assessed
Evidence
- Source numbers
-
AIBD-0239-source-0001–0007
- Citations
-
Numbered references below.
- Source relationships
-
Beneficiary, Independent, Developer
- Original evidence
-
Not assessed
- Access and versions
-
Not assessed
- Supported findings
-
Not assessed
- Evidence links
-
Not assessed
- Evidence strength
-
Not assessed
- Missing evidence
-
Not assessed
Grades
- Assessed benefits
-
People. Organizations.
- Depth
-
People: 3. Organizations: 2.
- Reasons
-
People: The 8-year-old, and his mother who was placed under a no-contact order, were shielded from a plan the father had dated to 20 June. Police say the platform's information was corroborated when they arrived. He denies intent and no charge has been filed, so a life-saving effect is not established. Organizations: The Polícia Civil do Espírito Santo obtained a lead through the FBI and the Ministry of Justice CyberLab. It says it had no other way to get it. Its cybercrime chief called the alert another path for police work. The Ministry rated it the gravest of three such alerts in Brazil.
- Observed or intended
-
Not assessed
- Assessor and date
-
Not assessed
- Alternative assessments
-
Not assessed
- Fill
-
Independently reported
Entry details
- Related entries
-
Not assessed
- Field
-
Public safety. Law enforcement and child protection.
- Purpose
-
ChatGPT is a general-purpose conversational assistant. OpenAI's moderation layer is built to route conversations that indicate plans to harm others to human reviewers. Those reviewers may refer an imminent threat to law enforcement, under a policy published 26 August 2025. The referral that triggered the arrest was that layer doing what it was built to do, not an emergent use of the assistant.
- Dates
-
Date basis unassessed: 2026 (precision unassessed). Updated: 21 October 2026.
- Version
-
SHA-256: 40a6b91f6da1…
References
- Other identifiers
-
oecd_aim: 2026-09-16-2a33.
- Category mappings
-
Not assessed
- Revisions
-
5 revisions. Latest: 21 October 2026.
Collections: Scrutiny and findings, Cross-border cases, Safeguards, Security and threat-watching.