{"id":"AIBD-1035","title":"EPA reports that a machine-learning model for targeting hazardous-waste inspections detected violations more efficiently in a randomized field test","summary":"EPA reports that a machine-learning model yielded a substantial increase in efficiency of detecting hazardous-waste violations in a randomized field test, with no extra operating cost.","date_observed":"2020-01-01","date_basis":"event","date_precision":"year","benefit_status":"reported","source_collection":null,"source_entry":null,"account":"From 2015, EPA worked with the University of Chicago Energy & Environment Lab to develop a machine-learning model. The model forecasts which large quantity generators of hazardous waste are likely to violate RCRA rules. EPA writes that it is based on 15 years of historical data from across EPA programs. From fiscal years 2017 to 2019, EPA coordinated its regions to field test inspection targeting with the model. In its list of program evaluations for fiscal year 2020, EPA reports that a randomized evaluation compared the model with status quo targeting. It states that the model yielded a substantial increase in efficiency of detecting violations, with no increase in operating cost. EPA calls these results preliminary. It writes that the University of Chicago would release a working paper on how the model nearly doubled the violation detection rate. On its own page, the Lab reports an 82 percent higher detection rate. EPA then released predictive scores to its regions and to states for inspection targeting in fiscal year 2021. EPA is the deployer and a co-developer of the model.","category":"aggregate result","unexpected":false,"purpose":"The University of Chicago Energy & Environment Lab built the model with EPA to forecast which large quantity generators of hazardous waste are likely to violate RCRA rules, so that inspectors can focus on them.","system":"Machine-learning model that forecasts RCRA violations by large quantity generator (LQG) hazardous waste facilities, tested in the RCRA Data Analytics Evaluation","model_version":null,"developer":"University of Chicago Energy & Environment Lab, with EPA staff","deployer":"EPA regional offices, coordinated by EPA's Office of Enforcement and Compliance Assurance","location":"United States (EPA regions)","domain":"Environmental enforcement (hazardous waste)","segment":null,"benefit_type":"Improved Task Accuracy","work_activities":["4.A.2.a.3","4.A.2.b.6"],"taxonomy_note":null,"registry_ids":{},"ratings":[{"group":"organizational","depth":2,"reason":"EPA reports that inspectors using the model found severe violations substantially more efficiently than with status quo targeting, at no extra operating cost."},{"group":"societal","depth":null,"reason":"No source measures pollution or harm avoided through the violations found."}],"ai_role":{"status":"assessed","statement":"The randomized evaluation compared inspections targeted with the model against status quo targeting across regions, which isolates the model's part. EPA calls the results preliminary and gives no figures of its own. EPA describes the model as machine learning based on 15 years of historical data."},"evidence":[{"kind":"evaluation report","citation":"U.S. Environmental Protection Agency. FY 2020 EPA Program Evaluations, Office of Enforcement and Compliance Assurance (OECA), Activity 1: RCRA Data Analytics Evaluation, p. 1. Evaluation run by EPA with the University of Chicago Energy & Environment Lab.","title":"FY 2020 EPA Program Evaluations","url":"https://www.epa.gov/system/files/documents/2023-06/fy20-epa-program-evaluations.pdf","date":null,"written_by":"evaluator","quote":"The randomized evaluation completed in FY 2020 benchmarked the ability of the model to identify facilities with severe RCRA violations detected during inspection relative to status quo practices across Regions. Preliminary results demonstrate that the model yields a substantial increase in efficiency of detecting hazardous waste violations compared to current targeting practices, with no increase in operational cost."},{"kind":"other","citation":"University of Chicago Energy & Environment Lab. AI and Inspection Targeting. Web page, read on 31 October 2026.","title":"AI and Inspection Targeting","url":"https://eelab.epic.uchicago.edu/ai-and-inspection-targeting/","date":null,"written_by":"makers","quote":"The field experiment showed that the model had an 82 percent higher detection rate than the EPA’s status-quo practices, with no increase in cost."}],"replication":{"produced_by":["The model was based on 15 years of historical data from across EPA programs.","EPA regions inspected facilities chosen with the model and with status quo practices in a randomized comparison.","Inspectors used the scores together with their own experience, skills and knowledge."],"must_hold":["Inspectors must combine the scores with their own judgment, as EPA describes.","The model must be refined with new scores each year, which EPA planned with the Lab's support."],"echoes":[]},"paired_incident":null,"headline":"*RCRA predictive targeting model* spots violations more efficiently","metric":"nearly doubled the violation detection rate","comparator":{"against":"Status quo inspection targeting practices across EPA regions","before":null,"after":"a substantial increase in efficiency of detecting hazardous waste violations","basis":"measured","quote":"Preliminary results demonstrate that the model yields a substantial increase in efficiency of detecting hazardous waste violations compared to current targeting practices, with no increase in operational cost.","url":"https://www.epa.gov/system/files/documents/2023-06/fy20-epa-program-evaluations.pdf"},"later":{"status":"scaled","date":null,"note":"EPA released a new set of predictive scores to its regions and to states for inspection targeting in fiscal year 2021.","quote":"Based on this result, EPA released a new set of predictive analytics scores to both Regions and states for their use in FY 2021 inspection plan targeting.","url":"https://www.epa.gov/system/files/documents/2023-06/fy20-epa-program-evaluations.pdf"},"value":null,"developer_country":"United States","deployer_country":"United States","unrated_because":null,"brief_notes":null,"brief":null,"revisions":[{"date":"2026-11-01","change":"Added the record from the report of the U.S. Environmental Protection Agency.","source":"https://www.epa.gov/system/files/documents/2023-06/fy20-epa-program-evaluations.pdf","editor":"AIBD"}],"confidence":"claimed","shade":"low","claim_status":"The makers' claim","claim_basis":"Sources: the makers' other source and the evaluators' evaluation report. The cited evidence includes no independent source and no finding by an external body.","case_jurisdictions":["United States"],"profile":{"case_id":"AIBD-1035","catalog_version":"1.0.0","source_fingerprint":"46bb1df905d2ca2b754e96a98aca83f8ae2528c3909a5261297ba7d9210e5b38","collection_refs":[{"collection_id":"aibd","version":"2026-10-31"},{"collection_id":"querist","version":"2026-10-25"}],"source_ids":["AIBD-1035-source-0001","AIBD-1035-source-0002"],"families":{"strategic assessments":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"evaluations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"monetary observations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"institutional decisions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]}},"fields":{"actors[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"developer":"University of Chicago Energy & Environment Lab, with EPA staff","deployer":"EPA regional offices, coordinated by EPA's Office of Enforcement and Compliance Assurance"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["developer","deployer"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"actors[].ownership_control":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"ai_contribution":{"state":"value_present","value":{"kind":"record_fields","fields":{"ai_role":{"status":"assessed","statement":"The randomized evaluation compared inspections targeted with the model against status quo targeting across regions, which isolates the model's part. EPA calls the results preliminary and gives no figures of its own. EPA describes the model as machine learning based on 15 years of historical data."}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ai_role"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"ai_relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"category":"aggregate result","ai_role":{"status":"assessed","statement":"The randomized evaluation compared inspections targeted with the model against status quo targeting across regions, which isolates the model's part. EPA calls the results preliminary and gives no figures of its own. EPA describes the model as machine learning based on 15 years of historical data."}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ai_role","category"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].alternatives":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].assessor_date":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].depth":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":2,"reason":"EPA reports that inspectors using the model found severe violations substantially more efficiently than with status quo targeting, at no extra operating cost."},{"group":"societal","reason":"No source measures pollution or harm avoided through the violations found."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].display_confidence":{"state":"value_present","value":{"kind":"structured","data":{"confidence":"low","evidence_word":"claimed","claim_status":"The makers' claim","basis":"Sources: the makers' other source and the evaluators' evaluation report. The cited evidence includes no independent source and no finding by an external body.","interpretation":"Existing display rule preserved; the richer outcome-specific confidence question still needs review."}},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rationale":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":2,"reason":"EPA reports that inspectors using the model found severe violations substantially more efficiently than with status quo targeting, at no extra operating cost."},{"group":"societal","reason":"No source measures pollution or harm avoided through the violations found."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rubric_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].status_basis":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].target":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":2,"reason":"EPA reports that inspectors using the model found severe violations substantially more efficiently than with status quo targeting, at no extra operating cost."},{"group":"societal","reason":"No source measures pollution or harm avoided through the violations found."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"availability":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"brief":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_kind":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_links[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_links":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_strength":{"state":"value_present","value":{"kind":"structured","data":{"answer":"The makers' claim. Sources: the makers' other source and the evaluators' evaluation report. The cited evidence includes no independent source and no finding by an external body.","evidence_word":"claimed","claim_status":"The makers' claim"}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-1035-source-0001","AIBD-1035-source-0002"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"The makers' claim. Sources: the makers' other source and the evaluators' evaluation report. The cited evidence includes no independent source and no finding by an external body.","inferred":false}},"claims[].missingness":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].proposition":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"cross_border_flows[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"decisions[].action_outcome":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].grounds":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].institution_task":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].success_criterion":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"deployment_stage":{"state":"value_present","value":{"kind":"structured","data":{"classification":"pilot","answer":"The system was used in a pilot. The benefit comes from a randomized field test across EPA regions, after which EPA released scores to regions and states.","scope":"The period and activity described in the case."}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["account","evidence"],"source_refs":["AIBD-1035-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"The system was used in a pilot. The benefit comes from a randomized field test across EPA regions, after which EPA released scores to regions and states.","inferred":false}},"economics[].amount":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].costs[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].counterfactual":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].currency_price_basis":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].gross_net":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].measure_type":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].period_unit":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].realization":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].recipient_payer":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].return_payback":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].valuation_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"evaluations[].ai_uplift":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].comparator":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].design":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].effect":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].exposure":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].id":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].measurement_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].metric":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].reproduction_materials":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].setting_sample":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].uncertainty_limitations":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"external_references[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"follow_up[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"later":{"status":"scaled","note":"EPA released a new set of predictive scores to its regions and to states for inspection targeting in fiscal year 2021.","quote":"Based on this result, EPA released a new set of predictive analytics scores to both Regions and states for their use in FY 2021 inspection plan targeting.","url":"https://www.epa.gov/system/files/documents/2023-06/fy20-epa-program-evaluations.pdf"}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["later"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"human_oversight":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"id":{"state":"value_present","value":{"kind":"record_fields","fields":{"id":"AIBD-1035"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["id"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"infrastructure_dependencies[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiaries":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiary_count":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].benefit_type":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_type":"Improved Task Accuracy"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].claim":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"From 2015, EPA worked with the University of Chicago Energy & Environment Lab to develop a machine-learning model. The model forecasts which large quantity generators of hazardous waste are likely to violate RCRA rules. EPA writes that it is based on 15 years of historical data from across EPA programs. From fiscal years 2017 to 2019, EPA coordinated its regions to field test inspection targeting with the model. In its list of program evaluations for fiscal year 2020, EPA reports that a randomized evaluation compared the model with status quo targeting. It states that the model yielded a substantial increase in efficiency of detecting violations, with no increase in operating cost. EPA calls these results preliminary. It writes that the University of Chicago would release a working paper on how the model nearly doubled the violation detection rate. On its own page, the Lab reports an 82 percent higher detection rate. EPA then released predictive scores to its regions and to states for inspection targeting in fiscal year 2021. EPA is the deployer and a co-developer of the model.","benefit_type":"Improved Task Accuracy"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].distribution":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].duration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].id":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].stakeholder_group":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":2,"reason":"EPA reports that inspectors using the model found severe violations substantially more efficiently than with status quo targeting, at no extra operating cost."},{"group":"societal","reason":"No source measures pollution or harm avoided through the violations found."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].status":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_status":"reported"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_status"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].tradeoffs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].unexpected":{"state":"value_present","value":{"kind":"record_fields","fields":{"unexpected":false,"purpose":"The University of Chicago Energy & Environment Lab built the model with EPA to forecast which large quantity generators of hazardous waste are likely to violate RCRA rules, so that inspectors can focus on them."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["unexpected","purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"places[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"location":"United States (EPA regions)","developer_country":"United States","deployer_country":"United States"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["location","developer_country","deployer_country"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"purpose":{"state":"value_present","value":{"kind":"record_fields","fields":{"purpose":"The University of Chicago Energy & Environment Lab built the model with EPA to forecast which large quantity generators of hazardous waste are likely to violate RCRA rules, so that inspectors can focus on them."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"record_dates":{"state":"value_present","value":{"kind":"record_fields","fields":{"date_observed":"2020-01-01","date_basis":"event","date_precision":"year","revisions":[{"date":"2026-11-01","change":"Added the record from the report of the U.S. Environmental Protection Agency.","source":"https://www.epa.gov/system/files/documents/2023-06/fy20-epa-program-evaluations.pdf","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["date_observed","date_basis","date_precision","revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"replication.attempts[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"replication.conditions":{"state":"value_present","value":{"kind":"record_fields","fields":{"replication":{"produced_by":["The model was based on 15 years of historical data from across EPA programs.","EPA regions inspected facilities chosen with the model and with status quo practices in a randomized comparison.","Inspectors used the scores together with their own experience, skills and knowledge."],"must_hold":["Inspectors must combine the scores with their own judgment, as EPA describes.","The model must be refined with new scores each year, which EPA planned with the Lab's support."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"revision_history[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"revisions":[{"date":"2026-11-01","change":"Added the record from the report of the U.S. Environmental Protection Agency.","source":"https://www.epa.gov/system/files/documents/2023-06/fy20-epa-program-evaluations.pdf","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sector":{"state":"value_present","value":{"kind":"record_fields","fields":{"domain":"Environmental enforcement (hazardous waste)"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["domain"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].access_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].citation_locator":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"evaluation report","citation":"U.S. Environmental Protection Agency. FY 2020 EPA Program Evaluations, Office of Enforcement and Compliance Assurance (OECA), Activity 1: RCRA Data Analytics Evaluation, p. 1. Evaluation run by EPA with the University of Chicago Energy & Environment Lab.","title":"FY 2020 EPA Program Evaluations","url":"https://www.epa.gov/system/files/documents/2023-06/fy20-epa-program-evaluations.pdf","written_by":"evaluator","quote":"The randomized evaluation completed in FY 2020 benchmarked the ability of the model to identify facilities with severe RCRA violations detected during inspection relative to status quo practices across Regions. Preliminary results demonstrate that the model yields a substantial increase in efficiency of detecting hazardous waste violations compared to current targeting practices, with no increase in operational cost."},{"kind":"other","citation":"University of Chicago Energy & Environment Lab. AI and Inspection Targeting. Web page, read on 31 October 2026.","title":"AI and Inspection Targeting","url":"https://eelab.epic.uchicago.edu/ai-and-inspection-targeting/","written_by":"makers","quote":"The field experiment showed that the model had an 82 percent higher detection rate than the EPA’s status-quo practices, with no increase in cost."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].id":{"state":"value_present","value":{"kind":"identifiers","identifiers":["AIBD-1035-source-0001","AIBD-1035-source-0002"],"role":"Existing evidence items, in their original order"},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"sources[].language":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"evaluation report","citation":"U.S. Environmental Protection Agency. FY 2020 EPA Program Evaluations, Office of Enforcement and Compliance Assurance (OECA), Activity 1: RCRA Data Analytics Evaluation, p. 1. Evaluation run by EPA with the University of Chicago Energy & Environment Lab.","title":"FY 2020 EPA Program Evaluations","url":"https://www.epa.gov/system/files/documents/2023-06/fy20-epa-program-evaluations.pdf","written_by":"evaluator","quote":"The randomized evaluation completed in FY 2020 benchmarked the ability of the model to identify facilities with severe RCRA violations detected during inspection relative to status quo practices across Regions. Preliminary results demonstrate that the model yields a substantial increase in efficiency of detecting hazardous waste violations compared to current targeting practices, with no increase in operational cost."},{"kind":"other","citation":"University of Chicago Energy & Environment Lab. AI and Inspection Targeting. Web page, read on 31 October 2026.","title":"AI and Inspection Targeting","url":"https://eelab.epic.uchicago.edu/ai-and-inspection-targeting/","written_by":"makers","quote":"The field experiment showed that the model had an 82 percent higher detection rate than the EPA’s status-quo practices, with no increase in cost."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].upstream_sources":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"strategic_assessments[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"strategic assessments"},"summary":{"state":"value_present","value":{"kind":"record_fields","fields":{"summary":"EPA reports that a machine-learning model yielded a substantial increase in efficiency of detecting hazardous-waste violations in a randomized field test, with no extra operating cost.","account":"From 2015, EPA worked with the University of Chicago Energy & Environment Lab to develop a machine-learning model. The model forecasts which large quantity generators of hazardous waste are likely to violate RCRA rules. EPA writes that it is based on 15 years of historical data from across EPA programs. From fiscal years 2017 to 2019, EPA coordinated its regions to field test inspection targeting with the model. In its list of program evaluations for fiscal year 2020, EPA reports that a randomized evaluation compared the model with status quo targeting. It states that the model yielded a substantial increase in efficiency of detecting violations, with no increase in operating cost. EPA calls these results preliminary. It writes that the University of Chicago would release a working paper on how the model nearly doubled the violation detection rate. On its own page, the Lab reports an 82 percent higher detection rate. EPA then released predictive scores to its regions and to states for inspection targeting in fiscal year 2021. EPA is the deployer and a co-developer of the model."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["summary","account"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].autonomy_permissions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].component_role":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].deployment_configuration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].inputs_outputs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_name":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].product_name":{"state":"value_present","value":{"kind":"record_fields","fields":{"system":"Machine-learning model that forecasts RCRA violations by large quantity generator (LQG) hazardous waste facilities, tested in the RCRA Data Analytics Evaluation"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["system"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].provider":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"taxonomy_crosswalks[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"title":{"state":"value_present","value":{"kind":"record_fields","fields":{"title":"EPA reports that a machine-learning model for targeting hazardous-waste inspections detected violations more efficiently in a randomized field test","headline":"*RCRA predictive targeting model* spots violations more efficiently"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["title","headline"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"version":{"state":"value_present","value":{"kind":"identifiers","identifiers":["2c0887a5a2268a8ec2ba3affe2a131f6e30097b453f625814db00d3c709600c8"],"role":"SHA-256 of the complete public record and its assessments"},"provenance":{"kind":"curatorial","basis":"SHA-256 of the public record, its assessments, and its displayed answers and notes, excluding its own identifier and the derived coverage summary.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"workflow":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"From 2015, EPA worked with the University of Chicago Energy & Environment Lab to develop a machine-learning model. The model forecasts which large quantity generators of hazardous waste are likely to violate RCRA rules. EPA writes that it is based on 15 years of historical data from across EPA programs. From fiscal years 2017 to 2019, EPA coordinated its regions to field test inspection targeting with the model. In its list of program evaluations for fiscal year 2020, EPA reports that a randomized evaluation compared the model with status quo targeting. It states that the model yielded a substantial increase in efficiency of detecting violations, with no increase in operating cost. EPA calls these results preliminary. It writes that the University of Chicago would release a working paper on how the model nearly doubled the violation detection rate. On its own page, the Lab reports an 82 percent higher detection rate. EPA then released predictive scores to its regions and to states for inspection targeting in fiscal year 2021. EPA is the deployer and a co-developer of the model.","replication":{"produced_by":["The model was based on 15 years of historical data from across EPA programs.","EPA regions inspected facilities chosen with the model and with status quo practices in a randomized comparison.","Inspectors used the scores together with their own experience, skills and knowledge."],"must_hold":["Inspectors must combine the scores with their own judgment, as EPA describes.","The model must be refined with new scores each year, which EPA planned with the Lab's support."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"}},"summary":{"total":91,"addressed":91,"known":30,"reviewed":2,"reviewed_complete":2,"reviewed_partial":0,"record_mapped":28,"review_not_assessed":61,"not_assessed":0,"complete":false,"by_state":{"value_present":30,"not_reported":0,"unresolved":61,"not_assessed":0,"not_applicable":0,"withheld":0,"source_unavailable":0}}},"presentation_version":"fb708bf0b997b101cb3eaf5c0afa8508da04e2b52a56ab8d1aeba8015b5ea670"}