{ "id": "AIBD-0377", "title": "A Waymo robotaxi is pulled over in San Francisco's Richmond District after the company detects a firearm violation; police find a loaded AR-style “ghost gun” and book two juveniles", "summary": "LA Times (12 September 2026): before 4 a.m. on 3 Sep Waymo pulled a robotaxi over in the Richmond District after detecting a firearm violation; SFPD found a loaded ghost gun and booked two minors.", "date_observed": "2026-09-03", "date_basis": "unassessed", "date_precision": "unassessed", "benefit_status": null, "source_collection": null, "source_entry": null, "account": "Shortly before 4 a.m. on Thursday 3 September 2026, Waymo pulled one of its driverless cars over in San Francisco's Richmond District. It had detected “a violation of our terms of service involving a firearm”. Waymo alerted emergency services and “cooperated fully” with police, a Waymo spokesperson told the Los Angeles Times (12 September). The San Francisco Police Department said officers made a “high-risk vehicle stop” and detained the two juvenile passengers. They found a loaded AR-style assault rifle, suspected marijuana and mace spray, and the two were taken to juvenile hall. The Independent, citing SFGATE, quotes SFPD spokesperson Allison Maxie calling the weapon an “AR-styled assault rifle also known as a ghost gun”. It says the boy and girl were booked into the Juvenile Justice Center on firearm-possession charges. The California Post puts the stop at 40th Avenue and Cabrillo Street. No source says how the firearm was detected; The Independent and Xataka both say this is unclear.", "category": "protective response", "unexpected": false, "purpose": "The Waymo Driver is built to provide driverless rides. The service's rider rules prohibit weapons, and Xataka says interior cameras record rides so that the company can check compliance and respond to emergencies. Pulling over and calling police on a firearm violation is that safeguard working, not a driving function.", "system": "Waymo driverless ride-hail vehicle (Waymo Driver) with the company's in-ride monitoring and terms-of-service enforcement", "model_version": null, "developer": "Waymo LLC", "deployer": "Waymo LLC", "location": "San Francisco, United States", "domain": "Mobility / rider safety", "segment": "Robotaxi in-ride monitoring", "benefit_type": "Reduced Violence", "taxonomy_note": null, "registry_ids": { "oecd_aim": "2026-09-10-4b01" }, "ratings": [ { "group": "organizational", "depth": 2, "reason": "SFPD took a loaded AR-style ghost gun, suspected marijuana and mace from two juveniles. It booked both on firearm-possession charges after the company's alert, per the Los Angeles Times and The Independent." }, { "group": "societal", "depth": 1, "reason": "A loaded unserialized rifle was taken out of circulation, and two minors were charged. No report shows a harm that was about to occur, so the public benefit is the seizure itself." } ], "ai_role": { "status": "assessed", "statement": "What the system did is established only at the level of the company. Waymo says it detected a terms-of-service violation involving a firearm, pulled the driverless car over and alerted emergency services. The Independent says it is not clear how the firearm was detected. Xataka says Waymo has not explained whether detection was automatic or human. The Monitor's statement that the vehicle's AI detected the gun is not supported by any cited source. The driverless car's ability to stop on command is the only system function the accounts describe." }, "evidence": [ { "kind": "news report", "citation": "Kwok I (2026). Waymo pulls over, calls police on juvenile riders who had 'ghost gun,' authorities say. Los Angeles Times, 12 September 2026, syndicated by The Spokesman-Review.", "title": "Waymo pulls over, calls police on juvenile riders who had 'ghost gun,' authorities say", "url": "https://www.spokesman.com/stories/2026/sep/12/waymo-pulls-over-calls-police-on-juvenile-riders-w/", "date": "2026-09-12", "written_by": "independent", "quote": "The company pulled the car over after detecting a \"violation of our terms of service involving a firearm,\" the spokesperson said." }, { "kind": "news report", "citation": "The Independent (2026). Waymo pulls over robotaxi after detecting riders were carrying assault rifle. The Independent, 12 September 2026.", "title": "Waymo pulls over robotaxi after detecting riders were carrying assault rifle", "url": "https://www.independent.co.uk/news/world/americas/crime/waymo-assault-rifle-passengers-b3049133.html", "date": "2026-09-12", "written_by": "independent", "quote": "It's not clear exactly how the Waymo detected the firearm, especially one described as a \"ghost gun\" by the SFPD." }, { "kind": "news report", "citation": "Peña M (2026). Waymo calls cops on teen riders after detecting loaded AR-style 'ghost gun'. The California Post, via Yahoo News, 13 September 2026.", "title": "Waymo calls cops on teen riders after detecting loaded AR-style 'ghost gun'", "url": "https://www.yahoo.com/news/us/articles/waymo-calls-cops-teen-riders-001306046.html", "date": "2026-09-13", "written_by": "independent", "quote": "Both juveniles were arrested on charges related to illegal firearm possession. They were taken into custody and booked into San Francisco's Juvenile Justice Center." }, { "kind": "news report", "citation": "Marquez J (2026). Subirse armado a un robotaxi puede acabar mal: dos menores lo comprobaron cuando apareció la policía. Xataka, 14 September 2026.", "title": "Subirse armado a un robotaxi puede acabar mal: dos menores lo comprobaron cuando apareció la policía", "url": "https://www.xataka.com/movilidad/subirse-armado-a-robotaxi-puede-acabar-mal-dos-menores-comprobaron-cuando-aparecio-policia", "date": "2026-09-14", "written_by": "independent", "quote": "no sabemos si hubo detección automática, revisión humana o algún otro mecanismo que desencadenara la alerta" }, { "kind": "registry label", "citation": "OECD AI Incidents and Hazards Monitor (2026). Waymo Robotaxi AI Detects Firearm, Alerts Police Leading to Juvenile Arrests in San Francisco. OECD.AI, 10 September 2026.", "title": "Waymo Robotaxi AI Detects Firearm, Alerts Police Leading to Juvenile Arrests in San Francisco", "url": "https://oecd.ai/en/incidents/2026-09-10-4b01", "date": "2026-09-10", "written_by": "independent", "quote": "Waymo's autonomous vehicle AI detected a firearm violation involving two minors in San Francisco, pulled over, and alerted police." } ], "replication": { "produced_by": [ "Interior cameras recording the ride, which Waymo says it may review to check rule compliance and respond to emergencies (Xataka)", "A company process that pulls the car over and calls emergency services on a firearm violation", "Police able to reach the stopped car quickly before 4 a.m." ], "must_hold": [ "The weapon is visible or otherwise detectable inside the cabin", "Waymo staff or systems act on the detection in time", "Riders stay in the car until police arrive. The Independent notes the doors were not locked in the July San Mateo case" ], "echoes": [] }, "paired_incident": null, "headline": "Waymo pulls a car over; police find a loaded ghost gun with two minors", "metric": null, "comparator": null, "later": null, "value": null, "developer_country": "United States", "deployer_country": "United States", "unrated_because": null, "brief_notes": null, "brief": null, "revisions": [ { "date": "2026-10-21", "change": "Record drafted from the OECD Monitor entry and the cited sources.", "source": "https://oecd.ai/en/incidents/2026-09-10-4b01", "editor": "AIBD" }, { "date": "2026-10-21", "change": "Benefit type set to Reduced Violence under Trustible's full taxonomy of 23 types; it was Improved Organizational Efficiency among the six first used.", "source": "https://trustible.ai/post/a-framework-for-measuring-the-benefits-of-ai/", "editor": "AIBD" }, { "date": "2026-10-21", "change": "Country of the developer and the deployer added from the organization's own site or a registry.", "source": "https://en.wikipedia.org/wiki/Waymo; https://en.wikipedia.org/wiki/Waymo", "editor": "AIBD" }, { "date": "2026-10-21", "change": "Prose pass: a rating reason, account, purpose, the replication conditions, the system's part rewritten in shorter sentences with abbreviations expanded; facts, figures and quotations unchanged.", "source": null, "editor": "AIBD" } ], "confidence": "reported", "shade": "medium", "claim_status": "Independently reported", "claim_basis": "Sources: four independent news reports and a registry entry. The cited evidence includes no independent study or report and no finding by a regulator or court.", "profile": { "case_id": "AIBD-0377", "catalog_version": "1.0.0", "source_fingerprint": "7f2a79c8b929f473a713655466f3ce80d16f4090bad88be71a75ef0b00da5a91", "collection_refs": [ { "collection_id": "aibd", "version": "snapshot-8bf7cfec9cb185aa" }, { "collection_id": "aibd", "version": "2026-10-25" }, { "collection_id": "adyt", "version": "2026-10-25" } ], "source_ids": [ "AIBD-0377-source-0001", "AIBD-0377-source-0002", "AIBD-0377-source-0003", "AIBD-0377-source-0004", "AIBD-0377-source-0005" ], "families": { "strategic assessments": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial", "record_ids": [] }, "evaluations": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial", "record_ids": [] }, "monetary observations": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial", "record_ids": [] }, "institutional decisions": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial", "record_ids": [] } }, "fields": { "actors[]": { "state": "value_present", "value": { "kind": "record_fields", "fields": { "developer": "Waymo LLC", "deployer": "Waymo LLC" } }, "provenance": { "kind": "legacy_record", "basis": "Preserved from the existing AIBD record; external sources were not rechecked.", "record_fields": [ "developer", "deployer" ], "source_refs": [] }, "review_state": "record_mapped", "coverage": "partial" }, "actors[].ownership_control": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial" }, "ai_contribution": { "state": "value_present", "value": { "kind": "record_fields", "fields": { "ai_role": { "status": "assessed", "statement": "What the system did is established only at the level of the company. Waymo says it detected a terms-of-service violation involving a firearm, pulled the driverless car over and alerted emergency services. The Independent says it is not clear how the firearm was detected. Xataka says Waymo has not explained whether detection was automatic or human. The Monitor's statement that the vehicle's AI detected the gun is not supported by any cited source. The driverless car's ability to stop on command is the only system function the accounts describe." } } }, "provenance": { "kind": "legacy_record", "basis": "Preserved from the existing AIBD record; external sources were not rechecked.", "record_fields": [ "ai_role" ], "source_refs": [] }, "review_state": "record_mapped", "coverage": "partial" }, "ai_relationship": { "state": "value_present", "value": { "kind": "record_fields", "fields": { "category": "protective response", "ai_role": { "status": "assessed", "statement": "What the system did is established only at the level of the company. Waymo says it detected a terms-of-service violation involving a firearm, pulled the driverless car over and alerted emergency services. The Independent says it is not clear how the firearm was detected. Xataka says Waymo has not explained whether detection was automatic or human. The Monitor's statement that the vehicle's AI detected the gun is not supported by any cited source. The driverless car's ability to stop on command is the only system function the accounts describe." } } }, "provenance": { "kind": "legacy_record", "basis": "Preserved from the existing AIBD record; external sources were not rechecked.", "record_fields": [ "ai_role", "category" ], "source_refs": [] }, "review_state": "record_mapped", "coverage": "partial" }, "assessments[].alternatives": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial" }, "assessments[].assessor_date": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial" }, "assessments[].depth": { "state": "value_present", "value": { "kind": "record_fields", "fields": { "ratings": [ { "group": "organizational", "depth": 2, "reason": "SFPD took a loaded AR-style ghost gun, suspected marijuana and mace from two juveniles. It booked both on firearm-possession charges after the company's alert, per the Los Angeles Times and The Independent." }, { "group": "societal", "depth": 1, "reason": "A loaded unserialized rifle was taken out of circulation, and two minors were charged. No report shows a harm that was about to occur, so the public benefit is the seizure itself." } ] } }, "provenance": { "kind": "legacy_record", "basis": "Preserved from the existing AIBD record; external sources were not rechecked.", "record_fields": [ "ratings" ], "source_refs": [] }, "review_state": "record_mapped", "coverage": "partial" }, "assessments[].display_confidence": { "state": "value_present", "value": { "kind": "structured", "data": { "confidence": "medium", "evidence_word": "reported", "claim_status": "Independently reported", "basis": "Sources: four independent news reports and a registry entry. The cited evidence includes no independent study or report and no finding by a regulator or court.", "interpretation": "Existing display rule preserved; the richer outcome-specific confidence question still needs review." } }, "provenance": { "kind": "curatorial", "basis": "Derived from the existing case display properties; not a new evidentiary judgment.", "record_fields": [], "source_refs": [] }, "review_state": "record_mapped", "coverage": "partial" }, "assessments[].rationale": { "state": "value_present", "value": { "kind": "record_fields", "fields": { "ratings": [ { "group": "organizational", "depth": 2, "reason": "SFPD took a loaded AR-style ghost gun, suspected marijuana and mace from two juveniles. It booked both on firearm-possession charges after the company's alert, per the Los Angeles Times and The Independent." }, { "group": "societal", "depth": 1, "reason": "A loaded unserialized rifle was taken out of circulation, and two minors were charged. No report shows a harm that was about to occur, so the public benefit is the seizure itself." } ] } }, "provenance": { "kind": "legacy_record", "basis": "Preserved from the existing AIBD record; external sources were not rechecked.", "record_fields": [ "ratings" ], "source_refs": [] }, "review_state": "record_mapped", "coverage": "partial" }, "assessments[].rubric_version": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial" }, "assessments[].status_basis": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial" }, "assessments[].target": { "state": "value_present", "value": { "kind": "record_fields", "fields": { "ratings": [ { "group": "organizational", "depth": 2, "reason": "SFPD took a loaded AR-style ghost gun, suspected marijuana and mace from two juveniles. It booked both on firearm-possession charges after the company's alert, per the Los Angeles Times and The Independent." }, { "group": "societal", "depth": 1, "reason": "A loaded unserialized rifle was taken out of circulation, and two minors were charged. No report shows a harm that was about to occur, so the public benefit is the seizure itself." } ] } }, "provenance": { "kind": "legacy_record", "basis": "Preserved from the existing AIBD record; external sources were not rechecked.", "record_fields": [ "ratings" ], "source_refs": [] }, "review_state": "record_mapped", "coverage": "partial" }, "availability": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial" }, "brief": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial" }, "case_kind": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial" }, "case_links[]": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial" }, "claims[].evidence_links": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial" }, "claims[].evidence_strength": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial" }, "claims[].missingness": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial" }, "claims[].proposition": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial" }, "cross_border_flows[]": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial" }, "decisions[].action_outcome": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial", "family": "institutional decisions" }, "decisions[].grounds": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial", "family": "institutional decisions" }, "decisions[].institution_task": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial", "family": "institutional decisions" }, "decisions[].success_criterion": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial", "family": "institutional decisions" }, "deployment_stage": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial" }, "economics[].amount": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial", "family": "monetary observations" }, "economics[].costs[]": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial", "family": "monetary observations" }, "economics[].counterfactual": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial", "family": "monetary observations" }, "economics[].currency_price_basis": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial", "family": "monetary observations" }, "economics[].gross_net": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial", "family": "monetary observations" }, "economics[].measure_type": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial", "family": "monetary observations" }, "economics[].period_unit": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial", "family": "monetary observations" }, "economics[].realization": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial", "family": "monetary observations" }, "economics[].recipient_payer": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial", "family": "monetary observations" }, "economics[].return_payback": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial", "family": "monetary observations" }, "economics[].valuation_method": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial", "family": "monetary observations" }, "evaluations[].ai_uplift": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial", "family": "evaluations" }, "evaluations[].comparator": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial", "family": "evaluations" }, "evaluations[].design": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial", "family": "evaluations" }, "evaluations[].effect": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial", "family": "evaluations" }, "evaluations[].exposure": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial", "family": "evaluations" }, "evaluations[].id": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial", "family": "evaluations" }, "evaluations[].measurement_method": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial", "family": "evaluations" }, "evaluations[].metric": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial", "family": "evaluations" }, "evaluations[].reproduction_materials": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial", "family": "evaluations" }, "evaluations[].setting_sample": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial", "family": "evaluations" }, "evaluations[].uncertainty_limitations": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial", "family": "evaluations" }, "external_references[]": { "state": "value_present", "value": { "kind": "record_fields", "fields": { "registry_ids": { "oecd_aim": "2026-09-10-4b01" } } }, "provenance": { "kind": "legacy_record", "basis": "Preserved from the existing AIBD record; external sources were not rechecked.", "record_fields": [ "registry_ids" ], "source_refs": [] }, "review_state": "record_mapped", "coverage": "partial" }, "follow_up[]": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial" }, "human_oversight": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial" }, "id": { "state": "value_present", "value": { "kind": "record_fields", "fields": { "id": "AIBD-0377" } }, "provenance": { "kind": "legacy_record", "basis": "Preserved from the existing AIBD record; external sources were not rechecked.", "record_fields": [ "id" ], "source_refs": [] }, "review_state": "record_mapped", "coverage": "partial" }, "infrastructure_dependencies[]": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial" }, "outcomes[].beneficiaries": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial" }, "outcomes[].beneficiary_count": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial" }, "outcomes[].benefit_type": { "state": "value_present", "value": { "kind": "record_fields", "fields": { "benefit_type": "Reduced Violence" } }, "provenance": { "kind": "legacy_record", "basis": "Preserved from the existing AIBD record; external sources were not rechecked.", "record_fields": [ "benefit_type" ], "source_refs": [] }, "review_state": "record_mapped", "coverage": "partial" }, "outcomes[].claim": { "state": "value_present", "value": { "kind": "record_fields", "fields": { "account": "Shortly before 4 a.m. on Thursday 3 September 2026, Waymo pulled one of its driverless cars over in San Francisco's Richmond District. It had detected “a violation of our terms of service involving a firearm”. Waymo alerted emergency services and “cooperated fully” with police, a Waymo spokesperson told the Los Angeles Times (12 September). The San Francisco Police Department said officers made a “high-risk vehicle stop” and detained the two juvenile passengers. They found a loaded AR-style assault rifle, suspected marijuana and mace spray, and the two were taken to juvenile hall. The Independent, citing SFGATE, quotes SFPD spokesperson Allison Maxie calling the weapon an “AR-styled assault rifle also known as a ghost gun”. It says the boy and girl were booked into the Juvenile Justice Center on firearm-possession charges. The California Post puts the stop at 40th Avenue and Cabrillo Street. No source says how the firearm was detected; The Independent and Xataka both say this is unclear.", "benefit_type": "Reduced Violence" } }, "provenance": { "kind": "legacy_record", "basis": "Preserved from the existing AIBD record; external sources were not rechecked.", "record_fields": [ "account", "benefit_type" ], "source_refs": [] }, "review_state": "record_mapped", "coverage": "partial" }, "outcomes[].distribution": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial" }, "outcomes[].duration": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial" }, "outcomes[].id": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial" }, "outcomes[].stakeholder_group": { "state": "value_present", "value": { "kind": "record_fields", "fields": { "ratings": [ { "group": "organizational", "depth": 2, "reason": "SFPD took a loaded AR-style ghost gun, suspected marijuana and mace from two juveniles. It booked both on firearm-possession charges after the company's alert, per the Los Angeles Times and The Independent." }, { "group": "societal", "depth": 1, "reason": "A loaded unserialized rifle was taken out of circulation, and two minors were charged. No report shows a harm that was about to occur, so the public benefit is the seizure itself." } ] } }, "provenance": { "kind": "legacy_record", "basis": "Preserved from the existing AIBD record; external sources were not rechecked.", "record_fields": [ "ratings" ], "source_refs": [] }, "review_state": "record_mapped", "coverage": "partial" }, "outcomes[].status": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial" }, "outcomes[].tradeoffs": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial" }, "outcomes[].unexpected": { "state": "value_present", "value": { "kind": "record_fields", "fields": { "unexpected": false, "purpose": "The Waymo Driver is built to provide driverless rides. The service's rider rules prohibit weapons, and Xataka says interior cameras record rides so that the company can check compliance and respond to emergencies. Pulling over and calling police on a firearm violation is that safeguard working, not a driving function." } }, "provenance": { "kind": "legacy_record", "basis": "Preserved from the existing AIBD record; external sources were not rechecked.", "record_fields": [ "unexpected", "purpose" ], "source_refs": [] }, "review_state": "record_mapped", "coverage": "partial" }, "places[]": { "state": "value_present", "value": { "kind": "record_fields", "fields": { "location": "San Francisco, United States", "developer_country": "United States", "deployer_country": "United States" } }, "provenance": { "kind": "legacy_record", "basis": "Preserved from the existing AIBD record; external sources were not rechecked.", "record_fields": [ "location", "developer_country", "deployer_country" ], "source_refs": [] }, "review_state": "record_mapped", "coverage": "partial" }, "purpose": { "state": "value_present", "value": { "kind": "record_fields", "fields": { "purpose": "The Waymo Driver is built to provide driverless rides. The service's rider rules prohibit weapons, and Xataka says interior cameras record rides so that the company can check compliance and respond to emergencies. Pulling over and calling police on a firearm violation is that safeguard working, not a driving function." } }, "provenance": { "kind": "legacy_record", "basis": "Preserved from the existing AIBD record; external sources were not rechecked.", "record_fields": [ "purpose" ], "source_refs": [] }, "review_state": "record_mapped", "coverage": "partial" }, "record_dates": { "state": "value_present", "value": { "kind": "record_fields", "fields": { "date_observed": "2026-09-03", "revisions": [ { "date": "2026-10-21", "change": "Record drafted from the OECD Monitor entry and the cited sources.", "source": "https://oecd.ai/en/incidents/2026-09-10-4b01", "editor": "AIBD" }, { "date": "2026-10-21", "change": "Benefit type set to Reduced Violence under Trustible's full taxonomy of 23 types; it was Improved Organizational Efficiency among the six first used.", "source": "https://trustible.ai/post/a-framework-for-measuring-the-benefits-of-ai/", "editor": "AIBD" }, { "date": "2026-10-21", "change": "Country of the developer and the deployer added from the organization's own site or a registry.", "source": "https://en.wikipedia.org/wiki/Waymo; https://en.wikipedia.org/wiki/Waymo", "editor": "AIBD" }, { "date": "2026-10-21", "change": "Prose pass: a rating reason, account, purpose, the replication conditions, the system's part rewritten in shorter sentences with abbreviations expanded; facts, figures and quotations unchanged.", "editor": "AIBD" } ] } }, "provenance": { "kind": "legacy_record", "basis": "Preserved from the existing AIBD record; external sources were not rechecked.", "record_fields": [ "date_observed", "revisions" ], "source_refs": [] }, "review_state": "record_mapped", "coverage": "partial" }, "replication.attempts[]": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial" }, "replication.conditions": { "state": "value_present", "value": { "kind": "record_fields", "fields": { "replication": { "produced_by": [ "Interior cameras recording the ride, which Waymo says it may review to check rule compliance and respond to emergencies (Xataka)", "A company process that pulls the car over and calls emergency services on a firearm violation", "Police able to reach the stopped car quickly before 4 a.m." ], "must_hold": [ "The weapon is visible or otherwise detectable inside the cabin", "Waymo staff or systems act on the detection in time", "Riders stay in the car until police arrive. The Independent notes the doors were not locked in the July San Mateo case" ], "echoes": [] } } }, "provenance": { "kind": "legacy_record", "basis": "Preserved from the existing AIBD record; external sources were not rechecked.", "record_fields": [ "replication" ], "source_refs": [] }, "review_state": "record_mapped", "coverage": "partial" }, "revision_history[]": { "state": "value_present", "value": { "kind": "record_fields", "fields": { "revisions": [ { "date": "2026-10-21", "change": "Record drafted from the OECD Monitor entry and the cited sources.", "source": "https://oecd.ai/en/incidents/2026-09-10-4b01", "editor": "AIBD" }, { "date": "2026-10-21", "change": "Benefit type set to Reduced Violence under Trustible's full taxonomy of 23 types; it was Improved Organizational Efficiency among the six first used.", "source": "https://trustible.ai/post/a-framework-for-measuring-the-benefits-of-ai/", "editor": "AIBD" }, { "date": "2026-10-21", "change": "Country of the developer and the deployer added from the organization's own site or a registry.", "source": "https://en.wikipedia.org/wiki/Waymo; https://en.wikipedia.org/wiki/Waymo", "editor": "AIBD" }, { "date": "2026-10-21", "change": "Prose pass: a rating reason, account, purpose, the replication conditions, the system's part rewritten in shorter sentences with abbreviations expanded; facts, figures and quotations unchanged.", "editor": "AIBD" } ] } }, "provenance": { "kind": "legacy_record", "basis": "Preserved from the existing AIBD record; external sources were not rechecked.", "record_fields": [ "revisions" ], "source_refs": [] }, "review_state": "record_mapped", "coverage": "partial" }, "sector": { "state": "value_present", "value": { "kind": "record_fields", "fields": { "domain": "Mobility / rider safety", "segment": "Robotaxi in-ride monitoring" } }, "provenance": { "kind": "legacy_record", "basis": "Preserved from the existing AIBD record; external sources were not rechecked.", "record_fields": [ "domain", "segment" ], "source_refs": [] }, "review_state": "record_mapped", "coverage": "partial" }, "sources[].access_version": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial" }, "sources[].citation_locator": { "state": "value_present", "value": { "kind": "record_fields", "fields": { "evidence": [ { "kind": "news report", "citation": "Kwok I (2026). Waymo pulls over, calls police on juvenile riders who had 'ghost gun,' authorities say. Los Angeles Times, 12 September 2026, syndicated by The Spokesman-Review.", "title": "Waymo pulls over, calls police on juvenile riders who had 'ghost gun,' authorities say", "url": "https://www.spokesman.com/stories/2026/sep/12/waymo-pulls-over-calls-police-on-juvenile-riders-w/", "date": "2026-09-12", "written_by": "independent", "quote": "The company pulled the car over after detecting a \"violation of our terms of service involving a firearm,\" the spokesperson said." }, { "kind": "news report", "citation": "The Independent (2026). Waymo pulls over robotaxi after detecting riders were carrying assault rifle. The Independent, 12 September 2026.", "title": "Waymo pulls over robotaxi after detecting riders were carrying assault rifle", "url": "https://www.independent.co.uk/news/world/americas/crime/waymo-assault-rifle-passengers-b3049133.html", "date": "2026-09-12", "written_by": "independent", "quote": "It's not clear exactly how the Waymo detected the firearm, especially one described as a \"ghost gun\" by the SFPD." }, { "kind": "news report", "citation": "Peña M (2026). Waymo calls cops on teen riders after detecting loaded AR-style 'ghost gun'. The California Post, via Yahoo News, 13 September 2026.", "title": "Waymo calls cops on teen riders after detecting loaded AR-style 'ghost gun'", "url": "https://www.yahoo.com/news/us/articles/waymo-calls-cops-teen-riders-001306046.html", "date": "2026-09-13", "written_by": "independent", "quote": "Both juveniles were arrested on charges related to illegal firearm possession. They were taken into custody and booked into San Francisco's Juvenile Justice Center." }, { "kind": "news report", "citation": "Marquez J (2026). Subirse armado a un robotaxi puede acabar mal: dos menores lo comprobaron cuando apareció la policía. Xataka, 14 September 2026.", "title": "Subirse armado a un robotaxi puede acabar mal: dos menores lo comprobaron cuando apareció la policía", "url": "https://www.xataka.com/movilidad/subirse-armado-a-robotaxi-puede-acabar-mal-dos-menores-comprobaron-cuando-aparecio-policia", "date": "2026-09-14", "written_by": "independent", "quote": "no sabemos si hubo detección automática, revisión humana o algún otro mecanismo que desencadenara la alerta" }, { "kind": "registry label", "citation": "OECD AI Incidents and Hazards Monitor (2026). Waymo Robotaxi AI Detects Firearm, Alerts Police Leading to Juvenile Arrests in San Francisco. OECD.AI, 10 September 2026.", "title": "Waymo Robotaxi AI Detects Firearm, Alerts Police Leading to Juvenile Arrests in San Francisco", "url": "https://oecd.ai/en/incidents/2026-09-10-4b01", "date": "2026-09-10", "written_by": "independent", "quote": "Waymo's autonomous vehicle AI detected a firearm violation involving two minors in San Francisco, pulled over, and alerted police." } ] } }, "provenance": { "kind": "legacy_record", "basis": "Preserved from the existing AIBD record; external sources were not rechecked.", "record_fields": [ "evidence" ], "source_refs": [] }, "review_state": "record_mapped", "coverage": "partial" }, "sources[].id": { "state": "value_present", "value": { "kind": "identifiers", "identifiers": [ "AIBD-0377-source-0001", "AIBD-0377-source-0002", "AIBD-0377-source-0003", "AIBD-0377-source-0004", "AIBD-0377-source-0005" ], "role": "Existing evidence items, in their original order" }, "provenance": { "kind": "curatorial", "basis": "Stable within the fingerprinted record version; no source content or source review has been added.", "record_fields": [], "source_refs": [] }, "review_state": "record_mapped", "coverage": "complete" }, "sources[].language": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial" }, "sources[].relationship": { "state": "value_present", "value": { "kind": "record_fields", "fields": { "evidence": [ { "kind": "news report", "citation": "Kwok I (2026). Waymo pulls over, calls police on juvenile riders who had 'ghost gun,' authorities say. Los Angeles Times, 12 September 2026, syndicated by The Spokesman-Review.", "title": "Waymo pulls over, calls police on juvenile riders who had 'ghost gun,' authorities say", "url": "https://www.spokesman.com/stories/2026/sep/12/waymo-pulls-over-calls-police-on-juvenile-riders-w/", "date": "2026-09-12", "written_by": "independent", "quote": "The company pulled the car over after detecting a \"violation of our terms of service involving a firearm,\" the spokesperson said." }, { "kind": "news report", "citation": "The Independent (2026). Waymo pulls over robotaxi after detecting riders were carrying assault rifle. The Independent, 12 September 2026.", "title": "Waymo pulls over robotaxi after detecting riders were carrying assault rifle", "url": "https://www.independent.co.uk/news/world/americas/crime/waymo-assault-rifle-passengers-b3049133.html", "date": "2026-09-12", "written_by": "independent", "quote": "It's not clear exactly how the Waymo detected the firearm, especially one described as a \"ghost gun\" by the SFPD." }, { "kind": "news report", "citation": "Peña M (2026). Waymo calls cops on teen riders after detecting loaded AR-style 'ghost gun'. The California Post, via Yahoo News, 13 September 2026.", "title": "Waymo calls cops on teen riders after detecting loaded AR-style 'ghost gun'", "url": "https://www.yahoo.com/news/us/articles/waymo-calls-cops-teen-riders-001306046.html", "date": "2026-09-13", "written_by": "independent", "quote": "Both juveniles were arrested on charges related to illegal firearm possession. They were taken into custody and booked into San Francisco's Juvenile Justice Center." }, { "kind": "news report", "citation": "Marquez J (2026). Subirse armado a un robotaxi puede acabar mal: dos menores lo comprobaron cuando apareció la policía. Xataka, 14 September 2026.", "title": "Subirse armado a un robotaxi puede acabar mal: dos menores lo comprobaron cuando apareció la policía", "url": "https://www.xataka.com/movilidad/subirse-armado-a-robotaxi-puede-acabar-mal-dos-menores-comprobaron-cuando-aparecio-policia", "date": "2026-09-14", "written_by": "independent", "quote": "no sabemos si hubo detección automática, revisión humana o algún otro mecanismo que desencadenara la alerta" }, { "kind": "registry label", "citation": "OECD AI Incidents and Hazards Monitor (2026). Waymo Robotaxi AI Detects Firearm, Alerts Police Leading to Juvenile Arrests in San Francisco. OECD.AI, 10 September 2026.", "title": "Waymo Robotaxi AI Detects Firearm, Alerts Police Leading to Juvenile Arrests in San Francisco", "url": "https://oecd.ai/en/incidents/2026-09-10-4b01", "date": "2026-09-10", "written_by": "independent", "quote": "Waymo's autonomous vehicle AI detected a firearm violation involving two minors in San Francisco, pulled over, and alerted police." } ] } }, "provenance": { "kind": "legacy_record", "basis": "Preserved from the existing AIBD record; external sources were not rechecked.", "record_fields": [ "evidence" ], "source_refs": [] }, "review_state": "record_mapped", "coverage": "partial" }, "sources[].upstream_sources": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial" }, "strategic_assessments[]": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial", "family": "strategic assessments" }, "summary": { "state": "value_present", "value": { "kind": "record_fields", "fields": { "summary": "LA Times (12 September 2026): before 4 a.m. on 3 Sep Waymo pulled a robotaxi over in the Richmond District after detecting a firearm violation; SFPD found a loaded ghost gun and booked two minors.", "account": "Shortly before 4 a.m. on Thursday 3 September 2026, Waymo pulled one of its driverless cars over in San Francisco's Richmond District. It had detected “a violation of our terms of service involving a firearm”. Waymo alerted emergency services and “cooperated fully” with police, a Waymo spokesperson told the Los Angeles Times (12 September). The San Francisco Police Department said officers made a “high-risk vehicle stop” and detained the two juvenile passengers. They found a loaded AR-style assault rifle, suspected marijuana and mace spray, and the two were taken to juvenile hall. The Independent, citing SFGATE, quotes SFPD spokesperson Allison Maxie calling the weapon an “AR-styled assault rifle also known as a ghost gun”. It says the boy and girl were booked into the Juvenile Justice Center on firearm-possession charges. The California Post puts the stop at 40th Avenue and Cabrillo Street. No source says how the firearm was detected; The Independent and Xataka both say this is unclear." } }, "provenance": { "kind": "legacy_record", "basis": "Preserved from the existing AIBD record; external sources were not rechecked.", "record_fields": [ "summary", "account" ], "source_refs": [] }, "review_state": "record_mapped", "coverage": "partial" }, "systems[].autonomy_permissions": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial" }, "systems[].component_role": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial" }, "systems[].deployment_configuration": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial" }, "systems[].inputs_outputs": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial" }, "systems[].model_name": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial" }, "systems[].model_version": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial" }, "systems[].product_name": { "state": "value_present", "value": { "kind": "record_fields", "fields": { "system": "Waymo driverless ride-hail vehicle (Waymo Driver) with the company's in-ride monitoring and terms-of-service enforcement" } }, "provenance": { "kind": "legacy_record", "basis": "Preserved from the existing AIBD record; external sources were not rechecked.", "record_fields": [ "system" ], "source_refs": [] }, "review_state": "record_mapped", "coverage": "partial" }, "systems[].provider": { "state": "value_present", "value": { "kind": "structured", "data": { "application_developer": "Waymo LLC" } }, "provenance": { "kind": "legacy_record", "basis": "Mapped from the existing case description without a new external source review.", "record_fields": [ "developer" ], "source_refs": [] }, "review_state": "record_mapped", "coverage": "partial" }, "taxonomy_crosswalks[]": { "state": "not_assessed", "review_state": "not_assessed", "coverage": "partial" }, "title": { "state": "value_present", "value": { "kind": "record_fields", "fields": { "title": "A Waymo robotaxi is pulled over in San Francisco's Richmond District after the company detects a firearm violation; police find a loaded AR-style “ghost gun” and book two juveniles", "headline": "Waymo pulls a car over; police find a loaded ghost gun with two minors" } }, "provenance": { "kind": "legacy_record", "basis": "Preserved from the existing AIBD record; external sources were not rechecked.", "record_fields": [ "title", "headline" ], "source_refs": [] }, "review_state": "record_mapped", "coverage": "partial" }, "version": { "state": "value_present", "value": { "kind": "identifiers", "identifiers": [ "7f2a79c8b929f473a713655466f3ce80d16f4090bad88be71a75ef0b00da5a91" ], "role": "SHA-256 of normalized original case data" }, "provenance": { "kind": "curatorial", "basis": "Deterministic content version assigned by the local migration.", "record_fields": [], "source_refs": [] }, "review_state": "record_mapped", "coverage": "complete" }, "workflow": { "state": "value_present", "value": { "kind": "record_fields", "fields": { "account": "Shortly before 4 a.m. on Thursday 3 September 2026, Waymo pulled one of its driverless cars over in San Francisco's Richmond District. It had detected “a violation of our terms of service involving a firearm”. Waymo alerted emergency services and “cooperated fully” with police, a Waymo spokesperson told the Los Angeles Times (12 September). The San Francisco Police Department said officers made a “high-risk vehicle stop” and detained the two juvenile passengers. They found a loaded AR-style assault rifle, suspected marijuana and mace spray, and the two were taken to juvenile hall. The Independent, citing SFGATE, quotes SFPD spokesperson Allison Maxie calling the weapon an “AR-styled assault rifle also known as a ghost gun”. It says the boy and girl were booked into the Juvenile Justice Center on firearm-possession charges. The California Post puts the stop at 40th Avenue and Cabrillo Street. No source says how the firearm was detected; The Independent and Xataka both say this is unclear.", "replication": { "produced_by": [ "Interior cameras recording the ride, which Waymo says it may review to check rule compliance and respond to emergencies (Xataka)", "A company process that pulls the car over and calls emergency services on a firearm violation", "Police able to reach the stopped car quickly before 4 a.m." ], "must_hold": [ "The weapon is visible or otherwise detectable inside the cabin", "Waymo staff or systems act on the detection in time", "Riders stay in the car until police arrive. The Independent notes the doors were not locked in the July San Mateo case" ], "echoes": [] } } }, "provenance": { "kind": "legacy_record", "basis": "Preserved from the existing AIBD record; external sources were not rechecked.", "record_fields": [ "account", "replication" ], "source_refs": [] }, "review_state": "record_mapped", "coverage": "partial" } }, "summary": { "total": 91, "addressed": 91, "known": 28, "reviewed": 0, "record_mapped": 28, "not_assessed": 63, "complete": false, "by_state": { "value_present": 28, "not_reported": 0, "unresolved": 0, "not_assessed": 63, "not_applicable": 0, "withheld": 0, "source_unavailable": 0 } } } }