AI system
- System
-
Waymo driverless ride-hail vehicle (Waymo Driver) with the company's in-ride monitoring and terms-of-service enforcement
- Model
-
Not assessed
- Release
-
Not assessed
- Application developer
-
Waymo LLC - Role
-
Not assessed
- Configuration
-
Not assessed
- Inputs and outputs
-
Not assessed
- Autonomy
-
Not assessed
- Workflow
-
Interior cameras recording the ride, which Waymo says it may review to check rule compliance and respond to emergencies (Xataka). A company process that pulls the car over and calls emergency services on a firearm violation. Police able to reach the stopped car quickly before 4 a.m.
- Human oversight
-
Not assessed
- Relation to AI
-
What the system did is established only at the level of the company. Waymo says it detected a terms-of-service violation involving a firearm, pulled the driverless car over and alerted emergency services. The Independent says it is not clear how the firearm was detected. Xataka says Waymo has not explained whether detection was automatic or human. The Monitor's statement that the vehicle's AI detected the gun is not supported by any cited source. The driverless car's ability to stop on command is the only system function the accounts describe.
- AI contribution
-
What the system did is established only at the level of the company. Waymo says it detected a terms-of-service violation involving a firearm, pulled the driverless car over and alerted emergency services. The Independent says it is not clear how the firearm was detected. Xataka says Waymo has not explained whether detection was automatic or human. The Monitor's statement that the vehicle's AI detected the gun is not supported by any cited source. The driverless car's ability to stop on command is the only system function the accounts describe.
Benefits
- Outcome identifiers
-
Not assessed
- Benefit
-
LA Times (12 September 2026): before 4 a.m. on 3 Sep Waymo pulled a robotaxi over in the Richmond District after detecting a firearm violation; SFPD found a loaded ghost gun and booked two minors.
- Category
-
Reduced Violence
- Status
-
Not assessed
- Beneficiary groups
-
Organizations. Society.
- Beneficiaries
-
Not assessed
- Reach
-
Not assessed
- Distribution and access
-
Not assessed
- Duration
-
Not assessed
- Expected?
-
Yes
- Costs and harms
-
Not assessed
Measurement
- Studies
-
Not assessed
- Study design
-
Not assessed
- Measurement
-
Not assessed
- Setting and sample
-
Not assessed
- Measures
-
Not assessed
- Comparison
-
Not assessed
- Results
-
Not assessed
- Additional value from AI
-
Not assessed
- Limitations
-
Not assessed
- Denominators
-
Not assessed
- Materials for replication
-
Not assessed
Money
- Kind of value
-
Not assessed
- Amount
-
Not assessed
- Currency and prices
-
Not assessed
- Period and unit
-
Not assessed
- Realization
-
Not assessed
- Recipients and payers
-
Not assessed
- Gross or net
-
Not assessed
- Included costs
-
Not assessed
- Comparison
-
Not assessed
- Method
-
Not assessed
- Return and payback
-
Not assessed
People and places
- Participants
-
Developer:
Waymo LLC. Operator:
Waymo LLC. - Jurisdictions
-
Benefit: San Francisco,
United States. Developer:
United States. Operator:
United States. - Ownership and control
-
Not assessed
- Dependencies
-
Not assessed
- Cross-border connections
-
Not assessed
- Geopolitical implications
-
Not assessed
Follow-up
- Conditions for replication
-
The weapon is visible or otherwise detectable inside the cabin. Waymo staff or systems act on the detection in time. Riders stay in the car until police arrive. The Independent notes the doors were not locked in the July San Mateo case.
- Replication attempts
-
Not assessed
- Later findings
-
Not assessed
- Availability
-
Not assessed
- Institutional decision
-
Not assessed
- Grounds
-
Not assessed
- Action and result
-
Not assessed
- Success criterion
-
Not assessed
Evidence
- Source numbers
-
AIBD-0377-source-0001–0005
- Citations
-
Numbered references below.
- Language
-
Not assessed
- Source relationships
-
Independent
- Original evidence
-
Not assessed
- Access and versions
-
Not assessed
- Supported findings
-
Not assessed
- Evidence links
-
Not assessed
- Evidence strength
-
Not assessed
- Missing evidence
-
Not assessed
Grades
- Assessed benefits
-
Organizations. Society.
- Depth
-
Organizations: 2. Society: 1.
- Reasons
-
Organizations: SFPD took a loaded AR-style ghost gun, suspected marijuana and mace from two juveniles. It booked both on firearm-possession charges after the company's alert, per the Los Angeles Times and The Independent. Society: A loaded unserialized rifle was taken out of circulation, and two minors were charged. No report shows a harm that was about to occur, so the public benefit is the seizure itself.
- Observed or intended
-
Not assessed
- Rubric
-
Not assessed
- Assessor and date
-
Not assessed
- Alternative assessments
-
Not assessed
- Fill
-
Independently reported
Entry details
- Kind
-
Not assessed
- Related entries
-
Not assessed
- Field
-
Mobility / rider safety. Robotaxi in-ride monitoring.
- Purpose
-
The Waymo Driver is built to provide driverless rides. The service's rider rules prohibit weapons, and Xataka says interior cameras record rides so that the company can check compliance and respond to emergencies. Pulling over and calling police on a firearm violation is that safeguard working, not a driving function.
- Dates
-
Date basis unassessed: 2026 (precision unassessed). Updated: 21 October 2026.
- Stage
-
Not assessed
- Version
-
SHA-256: 7f2a79c8b929…
References
- Other identifiers
-
oecd_aim: 2026-09-10-4b01.
- Category mappings
-
Not assessed
- Brief
-
Not assessed
- Revisions
-
4 revisions. Latest: 21 October 2026.
Sources
-
News report Independent author
Kwok I (2026). Waymo pulls over, calls police on juvenile riders who had 'ghost gun,' authorities say. Los Angeles Times, 12 September 2026, syndicated by The Spokesman-Review.
The company pulled the car over after detecting a "violation of our terms of service involving a firearm," the spokesperson said.
-
News report Independent author
The Independent (2026). Waymo pulls over robotaxi after detecting riders were carrying assault rifle. The Independent, 12 September 2026.
It's not clear exactly how the Waymo detected the firearm, especially one described as a "ghost gun" by the SFPD.
-
News report Independent author
Peña M (2026). Waymo calls cops on teen riders after detecting loaded AR-style 'ghost gun'. The California Post, via Yahoo News, 13 September 2026.
Both juveniles were arrested on charges related to illegal firearm possession. They were taken into custody and booked into San Francisco's Juvenile Justice Center.
-
News report Independent author
Marquez J (2026). Subirse armado a un robotaxi puede acabar mal: dos menores lo comprobaron cuando apareció la policía. Xataka, 14 September 2026.
no sabemos si hubo detección automática, revisión humana o algún otro mecanismo que desencadenara la alerta
-
Registry label Independent author
OECD AI Incidents and Hazards Monitor (2026). Waymo Robotaxi AI Detects Firearm, Alerts Police Leading to Juvenile Arrests in San Francisco. OECD.AI, 10 September 2026.
Waymo's autonomous vehicle AI detected a firearm violation involving two minors in San Francisco, pulled over, and alerted police.
Collections: Safeguards.