More mothers keep listening to health messages

mMitra’s call scheduler reduced cumulative engagement drops by 32% compared with regular messaging alone over seven weeks.

22ⓘ

AI system

System

The mMitra service-call scheduler. [1]

Model

A restless multi-armed bandit policy used Whittle indices. K-means grouped past listening patterns, and a random forest assigned new participants to groups. [1]

Release

The 2021 paper identifies the algorithms and training approach, but not a numbered software release. [1]

Provider

Researchers from Google Research, Harvard, and Singapore Management University worked with ARMMAN. [1]

Role

The model ranked participants for staff calls within the weekly calling limit. [1]

Configuration

The system modeled two weekly listening states and used 40 groups derived from historical data. [1]

Inputs and outputs

Registration details and listening logs produced a weekly list of participants for staff to call. [1]

Autonomy

The model selected call recipients. ARMMAN staff placed the calls and supported participants. [1]

Workflow

Participants received recorded health messages. Each week, the scheduler selected a subset for live calls that encouraged continued listening. [1]

Human oversight

ARMMAN staff made the calls without knowing the participants’ assigned study group. [1]

Relation to AI

Machine learning estimated listening behavior, and a bandit policy allocated staff calls. [1]

AI contribution

The scheduler selected who received a call. Comparing it with round-robin calling tested that selection policy. [1]

Benefits

Outcome identifiers

Not assessed

Benefit

The scheduling policy reduced loss of engagement with health messages. [1]

Category

Continued access to maternal and child health information. [1]

Status

Observed in a randomized field study. [1]

Beneficiary groups

Mothers enrolled in mMitra and ARMMAN’s outreach program. [1]

Beneficiaries

Pregnant women and new mothers enrolled in the program. [1]

Reach

The study included 23,003 women. The model group contained 7,668, of whom about 20% received a staff call. [1]

Distribution and access

Limited staff time meant that only some participants received calls. The measured benefit was an aggregate change in listening. [1]

Duration

Listening was measured over seven weeks. [1]

Expected?

Sustained listening was the intended benefit. [1]

Costs and harms

The program could call only a small share of participants each week. The study did not establish which clinical outcomes followed. [1]

Measurement

Studies

AIBD-0099-E01, AIBD-0099-E02, AIBD-0099-E03 [1] [4] [5]

Study design

Researchers randomly assigned participants to model-selected calls, round-robin calls, or regular messaging alone. [1]

Measurement

Call logs identified weeks in which a participant listened to at least one message for more than 30 seconds. [1]

Setting and sample

The groups contained 7,668, 7,668, and 7,667 participants, respectively. [1]

Measures

Cumulative weekly drops in listening engagement. [1]

Comparison

Regular messages alone, and regular messages with staff calls allocated in rotation. [1]

Results

Engagement drops fell by 32.0% versus regular messages alone and 28.3% versus round-robin calling. [1]

Additional value from AI

The comparison with round-robin calling favored the model, but its p-value was .098. The comparison with messaging alone had p = .044. [1]

Limitations

The study measured listening, not clinical health. Cumulative drops can count the same participant in more than one week. [1]

Denominators

Each calling group received about 225 staff calls a week for seven weeks. [1]

Materials for replication

Public SAHELI code and a data dictionary cover the later deployed system. They do not identify the software release used in the 2021 trial. [1] [5]

Money

Kind of value

The study reports a limit on staff calls, not a monetary benefit. [1]

Amount

No cash amount is reported for the benefit or delivery cost. [1]

Currency and prices

No monetary estimate is reported. [1]

Period and unit

Resources were allocated weekly over a seven-week study. [1]

Realization

The engagement improvement was observed. No monetary saving was measured. [1]

Recipients and payers

ARMMAN supplied the staff calls. The paper does not report their cost. [1]

Gross or net

No gross or net financial benefit was calculated. [1]

Included costs

The resource constraint was staff capacity: about 225 calls per week in each calling group. [1]

Comparison

The study compared calling policies at similar call capacity, rather than comparing cash expenditure. [1]

Method

The authors did not assign a monetary value to the engagement improvement. [1]

Return and payback

No return or payback estimate is reported. [1]

People and places

Participants

ARMMAN ran mMitra and supplied health workers. The research partners developed and evaluated the scheduler with the NGO. [1]

Jurisdictions

The field study took place in ARMMAN’s mMitra program in India. [1]

Ownership and control

ARMMAN operated the health program and held its participant records. Research partners used anonymized data. [1]

Dependencies

The program needed telephone access, listening logs, registration records, and staff who could place live calls. [1]

Cross-border connections

Researchers were based in India, the United States, and Singapore. The paper does not identify where participant data were hosted or transferred. [1]

Geopolitical implications

Not assessed

Follow-up

Conditions for replication

The scheduler needs usable listening histories, current registration details, and a known limit on staff calls. [1]

Replication attempts

A 2022 deployment study also found fewer engagement drops. A 2024 study reported some better health behaviors among selected survey respondents. [4] [5]

Later findings

SAHELI entered routine use in April 2022. Later studies evaluated revised models and health-behavior outcomes. [4] [5]

Availability

The developers reported continuous SAHELI use from April 2022. [5]

Institutional decision

Not assessed

Grounds

Not assessed

Action and result

Not assessed

Success criterion

Not assessed

Evidence

Source numbers

AIBD-0099-source-0001, AIBD-0099-source-0002, AIBD-0099-source-0003, AIBD-0099-source-0004, AIBD-0099-source-0005 [1] [2] [3] [4] [5]

Citations

The published seven-week trial supplies the engagement result. Dated developer reports cover deployment. The 2025 preprint is the original source for later health-behavior findings. [1] [2] [3] [4]

Language

English. [1] [2] [3] [4]

Source relationships

The sources come from the development and implementation partnership. Repeated trial results are not independent corroboration. [1] [2] [3] [4]

Original evidence

The 2022 paper reports the trial. The 2023 deployment paper links code. The 2026 chapter’s health-behavior findings originate in the 2025 preprint. [1] [2] [3] [4] [5]

Access and versions

The original studies, deployment account, SAHELI chapter sections, and linked code documentation were read within the scopes recorded in the source notes. [1] [2] [3] [4] [5]

Supported findings

Selecting live-call recipients with the model helped sustain listening within the available staff capacity. [1]

Evidence strength

A peer-reviewed randomized study supports the engagement finding. The authors developed the system and included the implementing NGO. [1]

Missing evidence

Not assessed

Grades

Assessed benefits

Continued listening and effective allocation of staff calls. [1]

Depth

Personal: 2; Organizational: 2 [1]

Reasons

The study found a measurable improvement in sustained access to health information, without establishing clinical health gains. ARMMAN improved engagement within its limited capacity for staff calls. [1]

Observed or intended

Observed in a randomized field study. [1]

Rubric

Not assessed

Assessor and date

Not assessed

Alternative assessments

Not assessed

Fill

The makers' claim [1] [2] [3] [4] [5]

Entry details

Kind

A randomized field study of call scheduling. [1]

Field

Maternal and child health information. [1]

Purpose

The system selected mothers for limited staff calls to encourage continued listening to mMitra messages. [1]

Dates

The seven-week study began on 26 April 2021. [1]

Stage

ARMMAN tested the scheduler in its operating mMitra program. [1]

Version

SHA-256: 95fb8c572187…

References

Other identifiers

AI Incident Database: 124.

Category mappings

Not assessed

Brief

Not assessed

Revisions

8 revisions. Latest: 25 October 2026.

Sources

  1. Peer-reviewed study Developer

    Mate, Aditya, et al. Proceedings of the AAAI Conference on Artificial Intelligence 36, no. 11 (2022): 12017–25. https://doi.org/10.1609/aaai.v36i11.21460.

    Original randomized field study, system details, operational constraints, and engagement results. pp. 12018–23, especially Tables 2–3.

    Primary study by the developers and implementing NGO, with Google Research, Harvard, ARMMAN, and Singapore Management University affiliations.

    Access copy, supplement, or earlier version of the same work. Published nine-page paper. Published nine-page paper.

    Access copy, supplement, or earlier version of the same work.

    Access copy, supplement, or earlier version of the same work. Earlier preprint, first submitted 16 September 2021, revised 27 October 2021. Earlier preprint, first submitted 16 September 2021, revised 27 October 2021.

    Access copy, supplement, or earlier version of the same work.

  2. Report Developer

    Taneja, Aparna, and Milind Tambe. Google Research, August 24, 2022.

    Reports routine weekly use after testing. Closing deployment update.

    Original follow-up from the developers; the experimental figures repeat A1.

  3. Preprint Developer

    Verma, Shresth, Arpan Dasgupta, Neha Madhiwalla, Aparna Taneja, and Milind Tambe. arXiv:2604.07384, April 8, 2026.

    Names the later SAHELI deployment and describes the transition to decision-focused learning. Opening deployment history; §§3–4 and Tables 1–2.

    Retrospective chapter by developers and ARMMAN. Its older trial and later health-behavior findings derive from earlier studies.

  4. Preprint Developer

    Dasgupta, Arpan, Sarvesh Gharat, Neha Madhiwalla, Aparna Hegde, Milind Tambe, and Aparna Taneja. arXiv:2507.20755, July 28, 2025.

    Original report of a separate 2024 intervention and selected survey follow-up on health behaviors. §§3–4, Tables 1–5.

    Primary preprint by developers and ARMMAN. The analysis uses selected respondents and matching, not a complete randomized-cohort outcome comparison.

  5. Peer-reviewed study Developer

    Verma, Shresth, et al. “Expanding Impact of Mobile Health Programs: SAHELI for Maternal and Child Care.” AI Magazine 44 (2023): 363–76. https://doi.org/10.1002/aaai.12126.

    The developers document routine use from April 2022, a separate comparison of engagement, changes to the deployed system, and public code and a data dictionary. “Previous study”; “Deploying SAHELI”; “Application use and payoff,” Table 2; “Responsible AI practices”; endnote 1.

    Original account of later deployment by the development and implementation partnership. Its repetition of the 2021 trial is not independent corroboration.

    SAHELI source code. Original implementation repository linked in endnote 1. It contains a pipeline, Whittle-index functions, and a data dictionary for the later system; it does not identify the exact release used in the 2021 trial. README, data_description.md, and repository file listing.