Delhi students improve their math and Hindi scores

Students offered free access to Mindspark centers gained 0.37 standard deviations in math and 0.23 in Hindi over 4.5 months.

AI system

System

Mindspark. [1]

Model

Rules written by education specialists selected lessons from students’ answers and error patterns. [1]

Release

The study does not identify a numbered software release. [1]

Provider

Educational Initiatives. [1]

Role

The software assessed each student and selected exercises at the appropriate level. [1]

Configuration

Students used individual computers with headphones for 45 minutes, then spent 45 minutes with an instructor in a small group. [1]

Inputs and outputs

Students’ answers, scores, and errors determined the next exercises and explanations. [1]

Autonomy

The software selected exercises automatically. Instructors could assign particular topics. [1]

Workflow

Each session combined practice on Mindspark with instruction in groups of about 12–15 students. Centers offered six sessions a week. [1]

Human oversight

Education specialists wrote the teaching rules. Trained instructors supervised students and provided group instruction. [1]

Relation to AI

Mindspark used rules for adaptive teaching. It did not use machine learning. [1]

Editor’s note. Treating the system as symbolic AI is an editorial classification of its expert-written rules. The authors expressly state that it did not use machine learning.

AI contribution

The trial evaluated software and instruction together. It did not measure the software’s separate effect. [1]

Benefits

Outcome identifiers

Not assessed

Benefit

Students offered a voucher scored higher in math and Hindi after 4.5 months. [1]

Category

Improved learning. [1]

Status

Observed in a randomized evaluation. [1]

Beneficiary groups

Students. [1]

Beneficiaries

Public-school students in Delhi, most of whom were in grades 6–9 and behind their grade’s curriculum. [1]

Reach

The trial enrolled 619 students and offered 314 a voucher. Researchers tested 539 students at the end. [1]

Distribution and access

Gains were similar across initial ability levels. Students who began further behind gained more relative to their previous progress. [1]

Duration

The measured learning gains covered 4.5 months. [1]

Expected?

Improved learning was the intended benefit. [1]

Costs and harms

The centers required staff and equipment. Low enrollment and the loss of subsidies led all three to close. [1]

Measurement

Studies

AIBD-0212-E01 [1]

Study design

A lottery assigned students to a free voucher or a comparison group. Researchers estimated the effect of the offer. [1]

Measurement

Independent paper tests assessed math and Hindi before and after the program. Scores were placed on comparable scales. [1]

Setting and sample

There were 314 voucher recipients and 305 controls. Endline participation was 85% and 90%, respectively. [1]

Measures

Math and Hindi test scores. [1]

Comparison

Students who were not offered a voucher continued their usual schooling and activities. [1]

Results

The voucher offer raised math scores by 0.37 standard deviations and Hindi scores by 0.23. [1]

Additional value from AI

The design did not separate adaptive software from additional teaching and practice. [1]

Limitations

Participants volunteered for the study. Endline attrition differed between groups, and longer-term attainment was not measured. [1]

Denominators

Average attendance was 58%, or about 50 of the 86 available days. [1]

Materials for replication

Replication data are deposited with the American Economic Association at openICPSR. [1]

Money

Kind of value

Program cost and subsidized fee. Separate estimates describe possible costs at scale. [1]

Amount

Delivery cost about INR 1,000 per student per month. The subsidized fee was INR 200, which vouchers waived. [1]

Currency and prices

Indian rupees. The authors gave an approximate equivalent of US$15 for the monthly delivery cost. [1]

Period and unit

Per student per month during the Delhi pilot. [1]

Realization

The INR 1,000 figure describes pilot delivery cost. Lower costs at scale were projections. [1]

Recipients and payers

Families normally paid the subsidized fee. Donors funded the remaining cost, and vouchers covered the fee for selected students. [1]

Gross or net

These are delivery costs and fees, not income or net savings. [1]

Included costs

The delivery estimate included premises, hardware, staff, and a share of software development costs. [1]

Comparison

The authors compared learning and cost with regular public schooling and with separate research on after-school tutoring. [1]

Method

The pilot cost was reported per student. Forecasts for schools used a deployment budget that Educational Initiatives prepared in 2017. [1]

Return and payback

The study does not estimate financial returns or a payback period. [1]

People and places

Participants

Educational Initiatives operated the centers. Academic researchers evaluated the program with J-PAL support. [1]

Jurisdictions

Three centers served low-income neighborhoods in Delhi, India. Students were recruited near five public schools. [1]

Ownership and control

Educational Initiatives developed the commercial product and operated the three centers. [1]

Dependencies

The centers needed computers, headphones, suitable rooms, and instructors. [1]

Cross-border connections

The research involved institutions in several countries. The study does not document a cross-border transfer of students’ data. [1]

Geopolitical implications

Not assessed

Follow-up

Conditions for replication

Students need regular access to the software and instructional support. The Delhi program also depended on continued subsidy. [1]

Replication attempts

A separate Rajasthan school trial reported gains of 0.22 standard deviations in math and 0.20 in Hindi after 18 months. [2]

Later findings

The Delhi centers closed in March 2016. Later research evaluated a different school-based delivery model in Rajasthan. [1] [2]

Availability

The three Delhi centers closed in March 2016. Mindspark continued in other settings. [1]

Institutional decision

Donors decided whether to continue subsidizing the centers. [1]

Grounds

Donors required enrollment at or above 80% of capacity. [1]

Action and result

Donors ended the subsidies, and all three centers closed. [1]

Success criterion

At least 80% enrollment at the subsidized fee. [1]

Evidence

Source numbers

AIBD-0212-source-0001, AIBD-0212-source-0002 [1] [2]

Citations

The final Delhi study provides the results. Its official appendix explains the teaching rules. A later paper covers Rajasthan. [1] [2]

Language

English. [1] [2]

Source relationships

The Delhi evaluation and its versions are one work. The Rajasthan trial used a different setting and cohort. [1] [2]

Original evidence

The Delhi trial and its official methods appendix provide the original evidence. The Rajasthan paper reports a separate trial. [1] [2]

Access and versions

The final author manuscript and official appendix were read. The Rajasthan review covered its abstract and introduction. [1] [2]

Supported findings

Free access to the combined program improved students’ measured learning. [1]

Evidence strength

A peer-reviewed randomized evaluation supports the learning gains. [1]

Missing evidence

Not assessed

Grades

Assessed benefits

Students’ learning. [1]

Depth

Personal: 2 [1]

Reasons

Students had measurable gains in math and Hindi. [1]

Observed or intended

Observed in a randomized evaluation. [1]

Rubric

Not assessed

Assessor and date

Not assessed

Alternative assessments

Not assessed

Fill

Independently studied [1] [2]

Entry details

Kind

A randomized evaluation of an after-school program. [1]

Field

Education. [1]

Purpose

Mindspark matched lessons to each student’s current level. [1]

Dates

The study ran from September 2015 to February 2016. The centers closed in March 2016. [1]

Stage

The program operated in three Delhi centers during the study. [1]

Version

SHA-256: f4c15b98fbef…

References

Other identifiers

Not assessed

Category mappings

Not assessed

Brief

Not assessed

Revisions

6 revisions. Latest: 25 October 2026.

Sources

  1. Peer-reviewed study Independent author

    Muralidharan, Karthik, Abhijeet Singh, and Alejandro J. Ganimian. American Economic Review 109, no. 4 (2019): 1426–60. https://doi.org/10.1257/aer.20171112.

    Original randomized evaluation, attendance, costs, and closure of the Delhi centers. Author final manuscript, §§2–5, Tables 1–3.

    Primary evaluation by academic researchers. J-PAL supported the evaluation; Educational Initiatives supplied the intervention.

    Access copy, supplement, or earlier version of the same work. Author final manuscript, 23 March 2019; linked by Abhijeet Singh’s research page. Author final manuscript, 23 March 2019; linked by Abhijeet Singh’s research page.

    Access copy, supplement, or earlier version of the same work.

    Access copy, supplement, or earlier version of the same work. Official online appendix, 22 February 2019; §§D.2–D.5, pp. 36–40. Official online appendix, 22 February 2019; §§D.2–D.5, pp. 36–40.

    Access copy, supplement, or earlier version of the same work.

    Replication data for: Disrupting Education? Experimental Evidence on Technology-Aided Instruction in India. Original replication deposit. Its existence was verified in the publisher and ICPSR catalog, but direct access returned HTTP 403; the deposited files were not inspected. Publisher link and ICPSR catalog entry 113192.

  2. Preprint Independent author

    Muralidharan, Karthik, and Abhijeet Singh. “Adapting for Scale: Experimental Evidence on Technology-Aided Instruction in India.” Working paper, 7 October 2025.

    A separate 18-month evaluation in Rajasthan public schools and subsequent expansion. Abstract and introduction.

    Primary study by researchers, including two authors of the Delhi evaluation. It is not follow-up of the same students.