Flint uses predictions to find hazardous water pipes

ActiveRemediation helped Flint prioritize homes for inspection and replacement of lead or galvanized-steel service lines.

223ⓘ

AI system

System

ActiveRemediation. [1]

Model

XGBoost classification trees with a hierarchical Bayesian model for spatial patterns. An active-learning policy selected further inspections. [1]

Release

The paper names the algorithms but does not identify an XGBoost release or a reproducible deployment configuration. [1]

Provider

A research team from the University of Michigan, Georgia Tech, and Brigham Young University. [1]

Role

The system estimated pipe materials and ranked homes for further investigation. [1]

Configuration

A shared database and a password-protected Flask application let city staff and contractors review maps and add excavation results. [1]

Inputs and outputs

Parcel records, property characteristics, and confirmed pipe materials produced address-level probabilities and inspection priorities. [1]

Autonomy

The system recommended priorities. City officials and contractors decided where to excavate and replaced the pipes. [1]

Workflow

Crews inspected pipes and recorded their materials. Researchers used those results to update predictions and recommend further inspections. [1]

Human oversight

City officials set priorities, contractors confirmed pipe materials, and researchers maintained the model. [1]

Relation to AI

The system used machine learning to predict pipe materials and guide inspections. [1]

AI contribution

Predictions informed inspection and replacement priorities. The paper did not randomize the city’s decisions. [1]

Benefits

Outcome identifiers

Not assessed

Benefit

The model helped direct inspections toward homes likely to have hazardous pipes. [1]

Category

Improved accuracy in locating hazardous service lines. [1]

Status

The system was used in the field. Accuracy was tested retrospectively, and monetary savings were modeled. [1]

Beneficiary groups

Residents and the city’s water-infrastructure program. [1]

Beneficiaries

Residents whose hazardous service lines were identified and replaced. [1]

Reach

By September 2017, the program had replaced hazardous lines at 4,419 homes and identified pipe materials at 6,506. [1]

Distribution and access

Predictions varied by address and neighborhood. The benefit depended on whether officials used them to set priorities. [1]

Duration

Replacement permanently changed the identified service lines. The paper did not measure residents’ later health. [1]

Expected?

Finding and removing hazardous pipes was the intended benefit. [1]

Costs and harms

Residents and officials also sought broad coverage and certainty about individual homes. These priorities could change the order of excavation. [2]

Measurement

Studies

AIBD-0166-E01, AIBD-0166-E02 [1]

Study design

Researchers tested predictions on held-out homes and compared inspection strategies in simulations. [1]

Measurement

Excavation results supplied the pipe-material labels. Validation and simulated work sequences used those records. [1]

Setting and sample

The database covered 55,893 parcels. The main accuracy test held out 1,606 homes with known pipe materials. [1]

Measures

Pipe-material prediction, inspection success, and modeled cost per replacement. [1]

Comparison

The cost simulation compared the proposed strategy with the sequence of work in the city’s records. [1]

Results

The held-out prediction accuracy was 91.6%. The simulated strategy lowered estimated cost per replacement by 10.7%. [1]

Additional value from AI

The estimated cost improvement came from a simulation. The field results do not isolate the model from crews, funding, and policy decisions. [1]

Limitations

Known pipe materials came from a selected set of inspected homes. The simulated costs omitted travel and other logistical constraints. [1]

Denominators

Predictions were updated as crews recorded new inspections and replacements. [1]

Materials for replication

The paper describes the algorithms and simulations. It does not supply all settings needed to reproduce the deployed system. [1]

Money

Kind of value

Modeled cost savings. [1]

Amount

The simulation estimated about US$622 less per replacement, or US$11.18 million if applied to 18,000 replacements. [1]

Currency and prices

U.S. dollars, using the unit costs assumed in the study. A separate inflation base year is not stated. [1]

Period and unit

Per replacement, with an extrapolation to 18,000 replacements. [1]

Realization

The savings were simulated. They are not an audited reduction in city expenditure. [1]

Recipients and payers

The modeled savings would reduce the cost of the publicly funded replacement program. [1]

Gross or net

The estimate includes excavation and replacement costs, but not every cost of operating the program. [1]

Included costs

The simulation assumed US$250 for a hydrovac inspection, US$2,500 for an unnecessary excavation, and US$5,000 for a needed replacement. [1]

Comparison

Estimated average cost was US$5,818 under the recorded work sequence and US$5,196 under the proposed strategy. [1]

Method

Researchers simulated inspection and replacement sequences, applied fixed unit costs, and extrapolated the difference. [1]

Return and payback

No complete return-on-investment or payback calculation is reported. [1]

People and places

Participants

University researchers developed the system. Flint officials managed the program, and contractors inspected and replaced service lines. [1]

Jurisdictions

Flint, Michigan, United States. [1]

Ownership and control

The research team developed the models. The city controlled the replacement program and its contracts. [1]

Dependencies

The system depended on digitized parcel records, reliable excavation labels, a shared database, and crews who could inspect and replace pipes. [1]

Cross-border connections

The research institutions and deployment were in the United States. No international data transfer is documented. [1]

Geopolitical implications

Not assessed

Follow-up

Conditions for replication

Useful parcel records, verified inspection results, and a working relationship with the people who choose excavation sites are necessary. [1]

Replication attempts

Not assessed

Later findings

A March 2019 court order required the city to prioritize addresses identified by the predictive model, subject to defined exceptions. [3]

Availability

Not assessed

Institutional decision

The federal court amended the settlement governing Flint’s service-line replacement program. [3]

Grounds

The parties agreed that the city should first excavate homes with the highest predicted likelihood of hazardous lines. [3]

Action and result

The city had to prioritize the model’s address lists, document exceptions, and report completed work. [3]

Success criterion

The city had to excavate the listed addresses and replace hazardous lines by 1 January 2020. [3]

Evidence

Source numbers

AIBD-0166-source-0001, AIBD-0166-source-0002, AIBD-0166-source-0003, AIBD-0166-source-0004 [1] [2] [3] [4]

Citations

The original paper establishes the methods and modeled savings. Independent interviews describe implementation. The court order establishes the required prioritization. [1] [2] [3]

Language

English. [1] [2] [3]

Source relationships

The researchers evaluated their own system. The Atlantic adds independent reporting. The court order is evidence of a decision, not an independent estimate of lives or money saved. [1] [2] [3]

Original evidence

The original model paper supplies the validation and simulation. The court order follows the parties’ February 2019 stipulation. [1] [2] [3] [4]

Access and versions

The revised original paper, the complete news article, and the relevant court-order provisions were read. Earlier versions and the underlying stipulation are preserved in the source chain. [1] [2] [3]

Supported findings

Predictions can help locate hazardous service lines and avoid some unnecessary excavations. [1]

Evidence strength

The developers reported validation and simulation results. Independent reporting and a court order document how officials used the system. [1] [2] [3]

Missing evidence

Not assessed

Grades

Assessed benefits

Identification and replacement of hazardous service lines. [1]

Depth

Personal: 2; Organizational: 2; Societal: 3 [1]

Reasons

Residents benefited from identification and replacement of hazardous service lines, without a measured health effect attributable to the model. The program gained a measured capability to predict pipe materials and prioritize work. Flint replaced hazardous service lines at thousands of homes, with predictions helping prioritize inspections. [1]

Observed or intended

The system was used in the field. Accuracy was tested retrospectively, and monetary savings were modeled. [1]

Rubric

Not assessed

Assessor and date

Not assessed

Alternative assessments

Not assessed

Fill

Independently reported [1] [2] [3] [4]

Entry details

Kind

An operational application with retrospective validation and simulation. [1]

Field

Water infrastructure and public health. [1]

Purpose

The system estimated which homes were most likely to have hazardous service lines. [1]

Dates

Field work began in summer 2016. The paper reports replacements and inspections through September 2017. [1]

Stage

Researchers worked with Flint’s replacement program from summer 2016. [1]

Version

SHA-256: ded7efa1cccb…

References

Other identifiers

Not assessed

Category mappings

Not assessed

Brief

Not assessed

Revisions

7 revisions. Latest: 25 October 2026.

Sources

  1. Peer-reviewed study Developer

    Abernethy, Jacob, Alex Chojnacki, Arya Farahi, Eric Schwartz, and Jared Webb. “ActiveRemediation: The Search for Lead Pipes in Flint, Michigan.” KDD 2018. https://doi.org/10.1145/3219819.3219896.

    Original methods, field implementation, validation, and simulated costs. §§2–4, Tables 1 and 5.

    Primary report by the researchers who developed and helped deploy the system.

    Access copy, supplement, or earlier version of the same work. 17 August 2018 revision. 17 August 2018 revision.

    Access copy, supplement, or earlier version of the same work.

  2. News report Independent author

    Madrigal, Alexis C. “How a Feel-Good AI Story Went Wrong in Flint.” The Atlantic, January 3, 2019.

    Independent reporting about model use, excavation results, and the contractor’s later change in priorities. Field totals and interviews with Michael McDaniel, Karen Weaver, Alan Wong, and Eric Schwartz.

    Original interviews and reporting. The model description and some estimates derive from F1 and court filings.

    Declaration of Eric Schwartz, October 1, 2018. Primary declaration underlying part of the implementation account. Targeted passages were read; the whole filing was not reviewed. ECF 203-4, model development and communications with AECOM.

  3. Court document Independent author Context or contrary evidence

    Concerned Pastors for Social Action v. Khouri, No. 16-10277, ECF No. 208 (E.D. Mich. March 26, 2019).

    The court required prioritization of addresses selected using the predictive model, with specified exceptions and reporting. ¶¶1–6, pp. 1–4.

    Original judicial order. It establishes the required decision process, not a causal finding about the system’s benefit.

    Stipulation and Notice of Proposed Amendments to Settlement Agreement. The agreement that the court approved. Relevant original pages were read. ECF 207, pp. 1–6; ¶1 n. 1 cites ActiveRemediation.

  4. News report Independent author

    Tribou, Doug. “In Flint, Algorithm Predicts Lead Pipe Locations as Replacement Work Continues.” Michigan Radio, April 25, 2019.

    A later firsthand interview reports that the research team was again working with Flint in 2019. “A goal of efficiency” and the original interview with Eric Schwartz.

    Independent interview with a developer. It establishes his account of renewed implementation, not an independent measurement of the modeled saving.