{"id":"AIBD-0615","title":"Mindspark adaptive learning software in 40 Rajasthan public schools raises math scores by 0.22 and Hindi scores by 0.20 standard deviations after 18 months","summary":"In an 80-school trial in Rajasthan, India, students in the 40 schools that used Mindspark in school hours scored 0.22 SD higher in math and 0.20 SD higher in Hindi after 18 months.","date_observed":"2019-02-01","date_basis":"event","date_precision":"month","benefit_status":"reported","source_collection":null,"source_entry":null,"account":"Karthik Muralidharan and Abhijeet Singh evaluated Mindspark, the personalized adaptive learning software of Educational Initiatives, in government Adarsh schools in four districts of Rajasthan, India, with the Government of Rajasthan. They randomly assigned 80 schools with about 6,500 students. The 40 treatment schools received a Mindspark computer lab and a local lab assistant, and they replaced about a quarter of weekly math and Hindi time in primary grades, and 40 to 50 percent in middle grades, with lab periods on the software. The other 40 schools continued regular teaching. Baseline tests took place in October 2017. After 18 months, students in treatment schools scored 0.22 standard deviations higher in math and 0.20 standard deviations higher in Hindi on independently designed tests. The authors describe this as a 50 to 66 percent increase in the productivity of school time. Gains did not vary by gender, socioeconomic status or initial scores. The program had no effect on school exam scores. The estimate covers the whole program, including the computers and the lab assistants. The paper is an NBER working paper revised in November 2025.","category":"general benefit","unexpected":false,"purpose":"Mindspark was built to give each student exercises at the student's own level and to adapt as the student progresses. Higher test scores were that purpose.","system":"Mindspark personalized adaptive learning software (math and Hindi), used in school computer labs","model_version":null,"developer":"Educational Initiatives (EI)","deployer":"Government of Rajasthan with Educational Initiatives, in 40 Adarsh public schools","location":"Churu, Jhunjhunu, Udaipur and Dungarpur districts, Rajasthan, India","domain":"Education","segment":null,"benefit_type":"Improved Learning","taxonomy_note":null,"registry_ids":{},"ratings":[{"group":"personal","depth":2,"reason":"Students in treatment schools scored 0.22 standard deviations higher in math and 0.20 higher in Hindi after 18 months."},{"group":"organizational","depth":2,"reason":"The authors estimate a 50 to 66 percent increase in the productivity of school time, and J-PAL reports that the in-school model was twice as cost-effective as the earlier after-school model."}],"ai_role":{"status":"unassessed","statement":"Schools were randomized to the whole program or to regular teaching. The program bundled the adaptive software with new computer labs, lab assistants and changed timetables, so the trial does not separate the software's adaptation from the extra equipment and time on computers."},"evidence":[{"kind":"report","citation":"Muralidharan K, Singh A. Adapting for Scale: Experimental Evidence on Technology-Aided Instruction in India. NBER Working Paper 34205, September 2025, revised November 2025. doi:10.3386/w34205","title":"Adapting for Scale: Experimental Evidence on Technology-Aided Instruction in India","url":"https://www.nber.org/papers/w34205","date":"2025-11-01","written_by":"independent","quote":"After 18 months, treated students scored 0.22σ higher in Mathematics and 0.20σ higher in Hindi, a 50-66% productivity increase over the control group."},{"kind":"report","citation":"Muralidharan K, Singh A. NBER Working Paper 34205, full text (study design and baseline).","title":"Adapting for Scale: Experimental Evidence on Technology-Aided Instruction in India (PDF)","url":"https://www.nber.org/system/files/working_papers/w34205/w34205.pdf","date":"2025-11-01","written_by":"independent","quote":"We collected baseline data on school characteristics, student test scores, and socioeconomic status in October 2017"},{"kind":"report","citation":"J-PAL. Scaling Personalized Adaptive Learning (PAL) for Math and Language in India. Evaluation summary, AEARCTR-0002546.","title":"Scaling Personalized Adaptive Learning (PAL) for Math and Language in India","url":"https://www.povertyactionlab.org/evaluation/scaling-personalized-adaptive-learning-pal-math-and-language-india","date":null,"written_by":"independent","quote":"Despite learning gains on independently administered tests, the intervention had no effects on school exam scores in math or Hindi."}],"replication":{"produced_by":["Schools moved part of regular math and Hindi time into computer lab periods on the software.","Each school had a lab assistant who kept the computers working.","Gains rose with the time that students spent on the platform."],"must_hold":["Schools need working computer labs and someone to run them.","Timetables must protect the lab periods."],"echoes":[{"date":"2016-02-01","setting":"After-school Mindspark centers in Delhi, India (Muralidharan, Singh and Ganimian; recorded as AIBD-0212)","model_version":null,"outcome":"recurred","source":"https://www.povertyactionlab.org/evaluation/disrupting-education-evidence-technology-aided-instruction-india"}]},"paired_incident":null,"headline":"*Mindspark* lab periods raise math and Hindi scores in Rajasthan","metric":"0.22 standard deviations higher in math and 0.20 standard deviations higher in Hindi","comparator":{"against":"Students in 40 comparison schools with regular teaching","before":"Comparison schools' scores (the reference level)","after":"0.22 standard deviations higher in math and 0.20 higher in Hindi","basis":"measured","quote":"After 18 months, students in intervention schools scored 0.22 standard deviations higher in math and 0.20 standard deviations higher in Hindi compared to students in comparison schools.","url":"https://www.povertyactionlab.org/evaluation/scaling-personalized-adaptive-learning-pal-math-and-language-india"},"later":{"status":"scaled","date":null,"note":"J-PAL reports that Mindspark ran in more than 2,200 government schools in 13 Indian states in 2024-25.","quote":"with Mindspark operating in over 2,200 government schools, serving more than 266,000 students across thirteen Indian states, as of 2024-25.","url":"https://www.povertyactionlab.org/evaluation/scaling-personalized-adaptive-learning-pal-math-and-language-india"},"value":null,"developer_country":"India","deployer_country":"India","unrated_because":null,"brief_notes":null,"brief":null,"revisions":[{"date":"2026-10-29","change":"Added the case.","source":"https://www.nber.org/papers/w34205","editor":"AIBD"}],"confidence":"studied","shade":"high","claim_status":"Independently studied","claim_basis":"Sources: three independent reports. The cited evidence includes no finding by a regulator or court.","case_jurisdictions":["India"],"profile":{"case_id":"AIBD-0615","catalog_version":"1.0.0","source_fingerprint":"7d0404caa875cbb084a103012514c267da1f38a7b4d2967692f7cf6cd7d0c950","collection_refs":[{"collection_id":"aibd","version":"2026-10-29"}],"source_ids":["AIBD-0615-source-0001","AIBD-0615-source-0002","AIBD-0615-source-0003"],"families":{"strategic assessments":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"evaluations":{"state":"value_present","value":{"kind":"identifiers","identifiers":["AIBD-0615-evaluation-1"],"role":"Evaluations of the benefit"},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":[],"source_refs":["AIBD-0615-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"partial","record_ids":["AIBD-0615-evaluation-1"]},"monetary observations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"institutional decisions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]}},"fields":{"actors[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"developer":"Educational Initiatives (EI)","deployer":"Government of Rajasthan with Educational Initiatives, in 40 Adarsh public schools"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["developer","deployer"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"actors[].ownership_control":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"ai_contribution":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"ai_relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"category":"general benefit","ai_role":{"status":"unassessed","statement":"Schools were randomized to the whole program or to regular teaching. The program bundled the adaptive software with new computer labs, lab assistants and changed timetables, so the trial does not separate the software's adaptation from the extra equipment and time on computers."}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ai_role","category"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].alternatives":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].assessor_date":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].depth":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"personal","depth":2,"reason":"Students in treatment schools scored 0.22 standard deviations higher in math and 0.20 higher in Hindi after 18 months."},{"group":"organizational","depth":2,"reason":"The authors estimate a 50 to 66 percent increase in the productivity of school time, and J-PAL reports that the in-school model was twice as cost-effective as the earlier after-school model."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].display_confidence":{"state":"value_present","value":{"kind":"structured","data":{"confidence":"high","evidence_word":"studied","claim_status":"Independently studied","basis":"Sources: three independent reports. The cited evidence includes no finding by a regulator or court.","interpretation":"Existing display rule preserved; the richer outcome-specific confidence question still needs review."}},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rationale":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"personal","depth":2,"reason":"Students in treatment schools scored 0.22 standard deviations higher in math and 0.20 higher in Hindi after 18 months."},{"group":"organizational","depth":2,"reason":"The authors estimate a 50 to 66 percent increase in the productivity of school time, and J-PAL reports that the in-school model was twice as cost-effective as the earlier after-school model."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rubric_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].status_basis":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].target":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"personal","depth":2,"reason":"Students in treatment schools scored 0.22 standard deviations higher in math and 0.20 higher in Hindi after 18 months."},{"group":"organizational","depth":2,"reason":"The authors estimate a 50 to 66 percent increase in the productivity of school time, and J-PAL reports that the in-school model was twice as cost-effective as the earlier after-school model."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"availability":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"brief":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_kind":{"state":"value_present","value":{"kind":"structured","data":{"classification":"evaluation or study","answer":"The case describes an evaluation or a study. The case is a school-randomized trial by academic researchers.","scope":"The period and activity described in the case."}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["account","evidence"],"source_refs":["AIBD-0615-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"The case describes an evaluation or a study. The case is a school-randomized trial by academic researchers.","inferred":false}},"case_links[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Compared with the incidents in the AI Incident Database snapshot of 26 October 2026.","record_fields":["paired_incident"],"source_refs":[]},"reason":"No incident in the AI Incident Database snapshot of 26 October 2026 concerns the same kind of system harming the same kind of stakeholder.","review_state":"reviewed","coverage":"partial"},"claims[].evidence_links":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_strength":{"state":"value_present","value":{"kind":"structured","data":{"answer":"Independently studied. Sources: three independent reports. The cited evidence includes no finding by a regulator or court.","evidence_word":"studied","claim_status":"Independently studied"}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0615-source-0001","AIBD-0615-source-0002","AIBD-0615-source-0003"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Independently studied. Sources: three independent reports. The cited evidence includes no finding by a regulator or court.","inferred":false}},"claims[].missingness":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].proposition":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"cross_border_flows[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"decisions[].action_outcome":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].grounds":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].institution_task":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].success_criterion":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"deployment_stage":{"state":"value_present","value":{"kind":"structured","data":{"classification":"scaling","answer":"The system was being scaled up. The trial tested an in-school model meant for scale, and J-PAL reports later use in more than 2,200 government schools.","scope":"The period and activity described in the case."}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["account","evidence"],"source_refs":["AIBD-0615-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"The system was being scaled up. The trial tested an in-school model meant for scale, and J-PAL reports later use in more than 2,200 government schools.","inferred":false}},"economics[].amount":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].costs[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].counterfactual":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].currency_price_basis":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].gross_net":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].measure_type":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].period_unit":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].realization":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].recipient_payer":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].return_payback":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].valuation_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"evaluations[].ai_uplift":{"state":"value_present","value":{"kind":"text","text":"Not isolated; the estimate covers the software with labs, lab assistants and timetable changes."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0615-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Not isolated; the estimate covers the software with labs, lab assistants and timetable changes.","inferred":false}},"evaluations[].comparator":{"state":"value_present","value":{"kind":"text","text":"40 comparison schools with regular teaching."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0615-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"40 comparison schools with regular teaching.","inferred":false}},"evaluations[].design":{"state":"value_present","value":{"kind":"text","text":"Randomized."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0615-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Randomized.","inferred":false}},"evaluations[].effect":{"state":"value_present","value":{"kind":"text","text":"0.22 SD in math and 0.20 SD in Hindi."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0615-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"0.22 SD in math and 0.20 SD in Hindi.","inferred":false}},"evaluations[].exposure":{"state":"value_present","value":{"kind":"text","text":"About a quarter of math and Hindi time in primary grades and 40 to 50 percent in middle grades over 18 months."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0615-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"About a quarter of math and Hindi time in primary grades and 40 to 50 percent in middle grades over 18 months.","inferred":false}},"evaluations[].id":{"state":"value_present","value":{"kind":"identifiers","identifiers":["AIBD-0615-evaluation-1"],"role":"Evaluations of the benefit"},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0615-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Randomized.","inferred":false}},"evaluations[].measurement_method":{"state":"value_present","value":{"kind":"text","text":"Independently designed and administered math and Hindi tests, scaled with item response theory."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0615-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Independently designed and administered math and Hindi tests, scaled with item response theory.","inferred":false}},"evaluations[].metric":{"state":"value_present","value":{"kind":"text","text":"Test scores in standard deviations after 18 months."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0615-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Test scores in standard deviations after 18 months.","inferred":false}},"evaluations[].reproduction_materials":{"state":"value_present","value":{"kind":"text","text":"AEA RCT Registry AEARCTR-0002546."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0615-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"AEA RCT Registry AEARCTR-0002546.","inferred":false}},"evaluations[].setting_sample":{"state":"value_present","value":{"kind":"text","text":"80 Adarsh public schools (about 6,500 students) in four districts of Rajasthan, India."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0615-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"80 Adarsh public schools (about 6,500 students) in four districts of Rajasthan, India.","inferred":false}},"evaluations[].uncertainty_limitations":{"state":"value_present","value":{"kind":"text","text":"Working paper; no effect on school exams; Adarsh schools have better infrastructure than other public schools."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0615-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Working paper; no effect on school exams; Adarsh schools have better infrastructure than other public schools.","inferred":false}},"external_references[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"follow_up[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"later":{"status":"scaled","note":"J-PAL reports that Mindspark ran in more than 2,200 government schools in 13 Indian states in 2024-25.","quote":"with Mindspark operating in over 2,200 government schools, serving more than 266,000 students across thirteen Indian states, as of 2024-25.","url":"https://www.povertyactionlab.org/evaluation/scaling-personalized-adaptive-learning-pal-math-and-language-india"}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["later"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"human_oversight":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"id":{"state":"value_present","value":{"kind":"record_fields","fields":{"id":"AIBD-0615"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["id"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"infrastructure_dependencies[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiaries":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiary_count":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].benefit_type":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_type":"Improved Learning"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].claim":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"Karthik Muralidharan and Abhijeet Singh evaluated Mindspark, the personalized adaptive learning software of Educational Initiatives, in government Adarsh schools in four districts of Rajasthan, India, with the Government of Rajasthan. They randomly assigned 80 schools with about 6,500 students. The 40 treatment schools received a Mindspark computer lab and a local lab assistant, and they replaced about a quarter of weekly math and Hindi time in primary grades, and 40 to 50 percent in middle grades, with lab periods on the software. The other 40 schools continued regular teaching. Baseline tests took place in October 2017. After 18 months, students in treatment schools scored 0.22 standard deviations higher in math and 0.20 standard deviations higher in Hindi on independently designed tests. The authors describe this as a 50 to 66 percent increase in the productivity of school time. Gains did not vary by gender, socioeconomic status or initial scores. The program had no effect on school exam scores. The estimate covers the whole program, including the computers and the lab assistants. The paper is an NBER working paper revised in November 2025.","benefit_type":"Improved Learning"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].distribution":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].duration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].id":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].stakeholder_group":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"personal","depth":2,"reason":"Students in treatment schools scored 0.22 standard deviations higher in math and 0.20 higher in Hindi after 18 months."},{"group":"organizational","depth":2,"reason":"The authors estimate a 50 to 66 percent increase in the productivity of school time, and J-PAL reports that the in-school model was twice as cost-effective as the earlier after-school model."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].status":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_status":"reported"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_status"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].tradeoffs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].unexpected":{"state":"value_present","value":{"kind":"record_fields","fields":{"unexpected":false,"purpose":"Mindspark was built to give each student exercises at the student's own level and to adapt as the student progresses. Higher test scores were that purpose."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["unexpected","purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"places[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"location":"Churu, Jhunjhunu, Udaipur and Dungarpur districts, Rajasthan, India","developer_country":"India","deployer_country":"India"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["location","developer_country","deployer_country"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"purpose":{"state":"value_present","value":{"kind":"record_fields","fields":{"purpose":"Mindspark was built to give each student exercises at the student's own level and to adapt as the student progresses. Higher test scores were that purpose."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"record_dates":{"state":"value_present","value":{"kind":"record_fields","fields":{"date_observed":"2019-02-01","date_basis":"event","date_precision":"month","revisions":[{"date":"2026-10-29","change":"Added the case.","source":"https://www.nber.org/papers/w34205","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["date_observed","date_basis","date_precision","revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"replication.attempts[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"replication":{"produced_by":["Schools moved part of regular math and Hindi time into computer lab periods on the software.","Each school had a lab assistant who kept the computers working.","Gains rose with the time that students spent on the platform."],"must_hold":["Schools need working computer labs and someone to run them.","Timetables must protect the lab periods."],"echoes":[{"date":"2016-02-01","setting":"After-school Mindspark centers in Delhi, India (Muralidharan, Singh and Ganimian; recorded as AIBD-0212)","outcome":"recurred","source":"https://www.povertyactionlab.org/evaluation/disrupting-education-evidence-technology-aided-instruction-india"}]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"replication.conditions":{"state":"value_present","value":{"kind":"record_fields","fields":{"replication":{"produced_by":["Schools moved part of regular math and Hindi time into computer lab periods on the software.","Each school had a lab assistant who kept the computers working.","Gains rose with the time that students spent on the platform."],"must_hold":["Schools need working computer labs and someone to run them.","Timetables must protect the lab periods."],"echoes":[{"date":"2016-02-01","setting":"After-school Mindspark centers in Delhi, India (Muralidharan, Singh and Ganimian; recorded as AIBD-0212)","outcome":"recurred","source":"https://www.povertyactionlab.org/evaluation/disrupting-education-evidence-technology-aided-instruction-india"}]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"revision_history[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"revisions":[{"date":"2026-10-29","change":"Added the case.","source":"https://www.nber.org/papers/w34205","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sector":{"state":"value_present","value":{"kind":"record_fields","fields":{"domain":"Education"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["domain"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].access_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].citation_locator":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"report","citation":"Muralidharan K, Singh A. Adapting for Scale: Experimental Evidence on Technology-Aided Instruction in India. NBER Working Paper 34205, September 2025, revised November 2025. doi:10.3386/w34205","title":"Adapting for Scale: Experimental Evidence on Technology-Aided Instruction in India","url":"https://www.nber.org/papers/w34205","date":"2025-11-01","written_by":"independent","quote":"After 18 months, treated students scored 0.22σ higher in Mathematics and 0.20σ higher in Hindi, a 50-66% productivity increase over the control group."},{"kind":"report","citation":"Muralidharan K, Singh A. NBER Working Paper 34205, full text (study design and baseline).","title":"Adapting for Scale: Experimental Evidence on Technology-Aided Instruction in India (PDF)","url":"https://www.nber.org/system/files/working_papers/w34205/w34205.pdf","date":"2025-11-01","written_by":"independent","quote":"We collected baseline data on school characteristics, student test scores, and socioeconomic status in October 2017"},{"kind":"report","citation":"J-PAL. Scaling Personalized Adaptive Learning (PAL) for Math and Language in India. Evaluation summary, AEARCTR-0002546.","title":"Scaling Personalized Adaptive Learning (PAL) for Math and Language in India","url":"https://www.povertyactionlab.org/evaluation/scaling-personalized-adaptive-learning-pal-math-and-language-india","written_by":"independent","quote":"Despite learning gains on independently administered tests, the intervention had no effects on school exam scores in math or Hindi."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].id":{"state":"value_present","value":{"kind":"identifiers","identifiers":["AIBD-0615-source-0001","AIBD-0615-source-0002","AIBD-0615-source-0003"],"role":"Existing evidence items, in their original order"},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"sources[].language":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"report","citation":"Muralidharan K, Singh A. Adapting for Scale: Experimental Evidence on Technology-Aided Instruction in India. NBER Working Paper 34205, September 2025, revised November 2025. doi:10.3386/w34205","title":"Adapting for Scale: Experimental Evidence on Technology-Aided Instruction in India","url":"https://www.nber.org/papers/w34205","date":"2025-11-01","written_by":"independent","quote":"After 18 months, treated students scored 0.22σ higher in Mathematics and 0.20σ higher in Hindi, a 50-66% productivity increase over the control group."},{"kind":"report","citation":"Muralidharan K, Singh A. NBER Working Paper 34205, full text (study design and baseline).","title":"Adapting for Scale: Experimental Evidence on Technology-Aided Instruction in India (PDF)","url":"https://www.nber.org/system/files/working_papers/w34205/w34205.pdf","date":"2025-11-01","written_by":"independent","quote":"We collected baseline data on school characteristics, student test scores, and socioeconomic status in October 2017"},{"kind":"report","citation":"J-PAL. Scaling Personalized Adaptive Learning (PAL) for Math and Language in India. Evaluation summary, AEARCTR-0002546.","title":"Scaling Personalized Adaptive Learning (PAL) for Math and Language in India","url":"https://www.povertyactionlab.org/evaluation/scaling-personalized-adaptive-learning-pal-math-and-language-india","written_by":"independent","quote":"Despite learning gains on independently administered tests, the intervention had no effects on school exam scores in math or Hindi."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].upstream_sources":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"strategic_assessments[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"strategic assessments"},"summary":{"state":"value_present","value":{"kind":"record_fields","fields":{"summary":"In an 80-school trial in Rajasthan, India, students in the 40 schools that used Mindspark in school hours scored 0.22 SD higher in math and 0.20 SD higher in Hindi after 18 months.","account":"Karthik Muralidharan and Abhijeet Singh evaluated Mindspark, the personalized adaptive learning software of Educational Initiatives, in government Adarsh schools in four districts of Rajasthan, India, with the Government of Rajasthan. They randomly assigned 80 schools with about 6,500 students. The 40 treatment schools received a Mindspark computer lab and a local lab assistant, and they replaced about a quarter of weekly math and Hindi time in primary grades, and 40 to 50 percent in middle grades, with lab periods on the software. The other 40 schools continued regular teaching. Baseline tests took place in October 2017. After 18 months, students in treatment schools scored 0.22 standard deviations higher in math and 0.20 standard deviations higher in Hindi on independently designed tests. The authors describe this as a 50 to 66 percent increase in the productivity of school time. Gains did not vary by gender, socioeconomic status or initial scores. The program had no effect on school exam scores. The estimate covers the whole program, including the computers and the lab assistants. The paper is an NBER working paper revised in November 2025."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["summary","account"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].autonomy_permissions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].component_role":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].deployment_configuration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].inputs_outputs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_name":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].product_name":{"state":"value_present","value":{"kind":"record_fields","fields":{"system":"Mindspark personalized adaptive learning software (math and Hindi), used in school computer labs"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["system"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].provider":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"taxonomy_crosswalks[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"title":{"state":"value_present","value":{"kind":"record_fields","fields":{"title":"Mindspark adaptive learning software in 40 Rajasthan public schools raises math scores by 0.22 and Hindi scores by 0.20 standard deviations after 18 months","headline":"*Mindspark* lab periods raise math and Hindi scores in Rajasthan"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["title","headline"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"version":{"state":"value_present","value":{"kind":"identifiers","identifiers":["d46fe6c874b7a57ece3eeecf252b991aaa5e17a4e1487d01b900ccab9640ded0"],"role":"SHA-256 of the complete public case and its assessments"},"provenance":{"kind":"curatorial","basis":"SHA-256 of the public case, its assessments, and its displayed answers and notes, excluding its own identifier and the derived coverage summary.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"workflow":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"Karthik Muralidharan and Abhijeet Singh evaluated Mindspark, the personalized adaptive learning software of Educational Initiatives, in government Adarsh schools in four districts of Rajasthan, India, with the Government of Rajasthan. They randomly assigned 80 schools with about 6,500 students. The 40 treatment schools received a Mindspark computer lab and a local lab assistant, and they replaced about a quarter of weekly math and Hindi time in primary grades, and 40 to 50 percent in middle grades, with lab periods on the software. The other 40 schools continued regular teaching. Baseline tests took place in October 2017. After 18 months, students in treatment schools scored 0.22 standard deviations higher in math and 0.20 standard deviations higher in Hindi on independently designed tests. The authors describe this as a 50 to 66 percent increase in the productivity of school time. Gains did not vary by gender, socioeconomic status or initial scores. The program had no effect on school exam scores. The estimate covers the whole program, including the computers and the lab assistants. The paper is an NBER working paper revised in November 2025.","replication":{"produced_by":["Schools moved part of regular math and Hindi time into computer lab periods on the software.","Each school had a lab assistant who kept the computers working.","Gains rose with the time that students spent on the platform."],"must_hold":["Schools need working computer labs and someone to run them.","Timetables must protect the lab periods."],"echoes":[{"date":"2016-02-01","setting":"After-school Mindspark centers in Delhi, India (Muralidharan, Singh and Ganimian; recorded as AIBD-0212)","outcome":"recurred","source":"https://www.povertyactionlab.org/evaluation/disrupting-education-evidence-technology-aided-instruction-india"}]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"}},"summary":{"total":91,"addressed":91,"known":42,"reviewed":15,"reviewed_complete":14,"reviewed_partial":1,"record_mapped":28,"review_not_assessed":48,"not_assessed":0,"complete":false,"by_state":{"value_present":42,"not_reported":0,"unresolved":49,"not_assessed":0,"not_applicable":0,"withheld":0,"source_unavailable":0}}},"presentation_version":"1253573dd6a43a50aea8733a736f907b5c665f8837719ee565f519ac82c5481d"}