{"id":"AIBD-0695","title":"A randomized evaluation for UNICEF finds that dropout fell by almost half in Mexican schools that used the AI-personalized MatematIA platform","summary":"In a randomized evaluation for UNICEF in 14 schools in the State of Mexico, dropout fell by almost 50 percent where students used MatematIA. Mathematics grades did not improve.","date_observed":"2023-01-01","date_basis":"event","date_precision":"year","benefit_status":"mixed","source_collection":null,"source_entry":null,"account":"UNICEF and the educational software firm Pixframe Studios developed MatematIA, a remedial mathematics platform for first-year upper-secondary students. The evaluators write that it uses artificial intelligence to set the order of topics for each student, alongside game mechanics and curriculum-based content. UNICEF commissioned EASE-ECONOMETRÍA to evaluate it in CECyTEM schools in the State of Mexico. In a randomized design, 7 schools used the platform and 7 served as controls, covering activities from November 2022 to July 2023. They found no effect on algebra or geometry grades, on liking mathematics or on interest in STEM careers. They found that dropout fell by almost 50 percent in the treatment schools, with larger effects for boys and for students with internet access. The estimated reduction was 0.92 percentage points, about half of the average dropout rate of 1.58 percent. Dropout was counted from final-withdrawal codes on a geometry test. The report is dated 27 November 2023. The evaluators tested the whole platform, so the AI's own share is unknown.","category":"aggregate result","unexpected":false,"purpose":"UNICEF and Pixframe Studios built MatematIA to help first-year upper-secondary students in Mexico recover basic mathematics skills.","system":"MatematIA (AI-personalized, gamified remedial mathematics platform)","model_version":null,"developer":"UNICEF with Pixframe Studios","deployer":"UNICEF Mexico with the Secretaría de Educación Pública and CECyTEM (Colegio de Estudios Científicos y Tecnológicos del Estado de México)","location":"State of Mexico, Mexico (14 CECyTEM upper-secondary schools)","domain":"Education","segment":null,"benefit_type":"Increased Access to Education","work_activities":["4.A.4.b.3"],"taxonomy_note":"The benefit is lower dropout. The platform did not improve measured learning, so the type records continued schooling.","registry_ids":{},"ratings":[{"group":"personal","depth":2,"reason":"Dropout among students in the treatment schools fell by 0.92 percentage points, about half of the 1.58 percent average."}],"ai_role":{"status":"unassessed","statement":"The trial compared schools with and without the whole platform, which combines AI topic sequencing, gamification and curriculum content. The evaluators did not test the AI alone. They describe the AI as setting the order of topics for each student and give no detail showing that it learns from data."},"evidence":[{"kind":"evaluation report","citation":"EASE-ECONOMETRÍA for UNICEF Mexico. Uso de la plataforma MatematIA en CECyTEMs: Informe final ajustado (evaluation of the impact, effectiveness, relevance and sustainability of the MatematIA digital education platform), 27 November 2023. Commissioned by UNICEF and published in UNICEF's and the UN Evaluation Group's evaluation repositories.","title":"Uso de la plataforma MatematIA en CECyTEMs: Informe final ajustado","url":"https://www.unevaluation.org/get-download-file/3824","date":"2023-11-27","written_by":"evaluator","quote":"En relación con el abandono escolar el programa sí tuvo un impacto positivo en el periodo analizado, reduciéndose casi en 50 por ciento para los estudiantes en las escuelas de tratamiento, con un efecto de mayor magnitud para los hombres y para los estudiantes que tienen internet."}],"replication":{"produced_by":["The platform used artificial intelligence to set the order of 54 topics for each student.","It combined gamification, support material and a report generator with content from the national curriculum.","Students in 7 randomly chosen CECyTEM schools used it, with 7 schools as controls."],"must_hold":["Students need internet access, and the effect was larger for those who had it.","Content must match what is taught in class.","Students need reasons to use the platform, since it was not part of their grade."],"echoes":[]},"paired_incident":null,"headline":"Dropout nearly halves in Mexican schools using *MatematIA*","metric":"dropout fell by almost 50 percent","comparator":{"against":"Students in the 7 randomized control schools without the platform","before":"Average dropout rate of 1.58 percent across the sample","after":"0.92 percentage points lower in the treatment schools","basis":"measured","quote":"El efecto es de -0.92 puntos porcentuales y es estadísticamente significativo al 5% (columna 1), que es cerca de la mitad de la media incondicional del abandono escolar (1.58 puntos porcentuales).","url":"https://www.unevaluation.org/get-download-file/3824"},"later":null,"value":null,"developer_country":"Mexico","deployer_country":"Mexico","unrated_because":null,"brief_notes":null,"brief":null,"revisions":[{"date":"2026-10-31","change":"Added the record from the report of EASE-ECONOMETRÍA, the evaluator for UNICEF Mexico.","source":"https://www.unevaluation.org/get-download-file/3824","editor":"AIBD"}],"confidence":"claimed","shade":"low","claim_status":"The evaluator's account","claim_basis":"Sources: the evaluators' evaluation report. The cited evidence includes no independent source and no finding by an external body.","case_jurisdictions":["Mexico"],"profile":{"case_id":"AIBD-0695","catalog_version":"1.0.0","source_fingerprint":"129932ecbac4a387773036cf7644ff8641a99390536443abc97200c35eaf8d43","collection_refs":[{"collection_id":"aibd","version":"2026-10-31"},{"collection_id":"querist","version":"2026-10-25"}],"source_ids":["AIBD-0695-source-0001"],"families":{"strategic assessments":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"evaluations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"monetary observations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"institutional decisions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]}},"fields":{"actors[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"developer":"UNICEF with Pixframe Studios","deployer":"UNICEF Mexico with the Secretaría de Educación Pública and CECyTEM (Colegio de Estudios Científicos y Tecnológicos del Estado de México)"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["developer","deployer"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"actors[].ownership_control":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"ai_contribution":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"ai_relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"category":"aggregate result","ai_role":{"status":"unassessed","statement":"The trial compared schools with and without the whole platform, which combines AI topic sequencing, gamification and curriculum content. The evaluators did not test the AI alone. They describe the AI as setting the order of topics for each student and give no detail showing that it learns from data."}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ai_role","category"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].alternatives":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].assessor_date":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].depth":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"personal","depth":2,"reason":"Dropout among students in the treatment schools fell by 0.92 percentage points, about half of the 1.58 percent average."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].display_confidence":{"state":"value_present","value":{"kind":"structured","data":{"confidence":"low","evidence_word":"claimed","claim_status":"The evaluator's account","basis":"Sources: the evaluators' evaluation report. The cited evidence includes no independent source and no finding by an external body.","interpretation":"Existing display rule preserved; the richer outcome-specific confidence question still needs review."}},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rationale":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"personal","depth":2,"reason":"Dropout among students in the treatment schools fell by 0.92 percentage points, about half of the 1.58 percent average."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rubric_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].status_basis":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].target":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"personal","depth":2,"reason":"Dropout among students in the treatment schools fell by 0.92 percentage points, about half of the 1.58 percent average."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"availability":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"brief":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_kind":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_links[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_links":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_strength":{"state":"value_present","value":{"kind":"structured","data":{"answer":"The evaluator's account. Sources: the evaluators' evaluation report. The cited evidence includes no independent source and no finding by an external body.","evidence_word":"claimed","claim_status":"The evaluator's account"}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0695-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"The evaluator's account. Sources: the evaluators' evaluation report. The cited evidence includes no independent source and no finding by an external body.","inferred":false}},"claims[].missingness":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].proposition":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"cross_border_flows[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"decisions[].action_outcome":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].grounds":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].institution_task":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].success_criterion":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"deployment_stage":{"state":"value_present","value":{"kind":"structured","data":{"classification":"scaling","answer":"The system was being scaled up. The evaluators report that MatematIA had been implemented nationally, and they tested it in 7 treatment schools in the State of Mexico.","scope":"The period and activity described in the case."}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["account","evidence"],"source_refs":["AIBD-0695-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"The system was being scaled up. The evaluators report that MatematIA had been implemented nationally, and they tested it in 7 treatment schools in the State of Mexico.","inferred":false}},"economics[].amount":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].costs[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].counterfactual":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].currency_price_basis":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].gross_net":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].measure_type":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].period_unit":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].realization":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].recipient_payer":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].return_payback":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].valuation_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"evaluations[].ai_uplift":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].comparator":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].design":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].effect":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].exposure":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].id":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].measurement_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].metric":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].reproduction_materials":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].setting_sample":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].uncertainty_limitations":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"external_references[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"follow_up[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"human_oversight":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"id":{"state":"value_present","value":{"kind":"record_fields","fields":{"id":"AIBD-0695"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["id"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"infrastructure_dependencies[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiaries":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiary_count":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].benefit_type":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_type":"Increased Access to Education","taxonomy_note":"The benefit is lower dropout. The platform did not improve measured learning, so the type records continued schooling."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_type","taxonomy_note"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].claim":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"UNICEF and the educational software firm Pixframe Studios developed MatematIA, a remedial mathematics platform for first-year upper-secondary students. The evaluators write that it uses artificial intelligence to set the order of topics for each student, alongside game mechanics and curriculum-based content. UNICEF commissioned EASE-ECONOMETRÍA to evaluate it in CECyTEM schools in the State of Mexico. In a randomized design, 7 schools used the platform and 7 served as controls, covering activities from November 2022 to July 2023. They found no effect on algebra or geometry grades, on liking mathematics or on interest in STEM careers. They found that dropout fell by almost 50 percent in the treatment schools, with larger effects for boys and for students with internet access. The estimated reduction was 0.92 percentage points, about half of the average dropout rate of 1.58 percent. Dropout was counted from final-withdrawal codes on a geometry test. The report is dated 27 November 2023. The evaluators tested the whole platform, so the AI's own share is unknown.","benefit_type":"Increased Access to Education"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].distribution":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].duration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].id":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].stakeholder_group":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"personal","depth":2,"reason":"Dropout among students in the treatment schools fell by 0.92 percentage points, about half of the 1.58 percent average."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].status":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_status":"mixed"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_status"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].tradeoffs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].unexpected":{"state":"value_present","value":{"kind":"record_fields","fields":{"unexpected":false,"purpose":"UNICEF and Pixframe Studios built MatematIA to help first-year upper-secondary students in Mexico recover basic mathematics skills."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["unexpected","purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"places[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"location":"State of Mexico, Mexico (14 CECyTEM upper-secondary schools)","developer_country":"Mexico","deployer_country":"Mexico"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["location","developer_country","deployer_country"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"purpose":{"state":"value_present","value":{"kind":"record_fields","fields":{"purpose":"UNICEF and Pixframe Studios built MatematIA to help first-year upper-secondary students in Mexico recover basic mathematics skills."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"record_dates":{"state":"value_present","value":{"kind":"record_fields","fields":{"date_observed":"2023-01-01","date_basis":"event","date_precision":"year","revisions":[{"date":"2026-10-31","change":"Added the record from the report of EASE-ECONOMETRÍA, the evaluator for UNICEF Mexico.","source":"https://www.unevaluation.org/get-download-file/3824","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["date_observed","date_basis","date_precision","revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"replication.attempts[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"replication.conditions":{"state":"value_present","value":{"kind":"record_fields","fields":{"replication":{"produced_by":["The platform used artificial intelligence to set the order of 54 topics for each student.","It combined gamification, support material and a report generator with content from the national curriculum.","Students in 7 randomly chosen CECyTEM schools used it, with 7 schools as controls."],"must_hold":["Students need internet access, and the effect was larger for those who had it.","Content must match what is taught in class.","Students need reasons to use the platform, since it was not part of their grade."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"revision_history[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"revisions":[{"date":"2026-10-31","change":"Added the record from the report of EASE-ECONOMETRÍA, the evaluator for UNICEF Mexico.","source":"https://www.unevaluation.org/get-download-file/3824","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sector":{"state":"value_present","value":{"kind":"record_fields","fields":{"domain":"Education"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["domain"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].access_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].citation_locator":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"evaluation report","citation":"EASE-ECONOMETRÍA for UNICEF Mexico. Uso de la plataforma MatematIA en CECyTEMs: Informe final ajustado (evaluation of the impact, effectiveness, relevance and sustainability of the MatematIA digital education platform), 27 November 2023. Commissioned by UNICEF and published in UNICEF's and the UN Evaluation Group's evaluation repositories.","title":"Uso de la plataforma MatematIA en CECyTEMs: Informe final ajustado","url":"https://www.unevaluation.org/get-download-file/3824","date":"2023-11-27","written_by":"evaluator","quote":"En relación con el abandono escolar el programa sí tuvo un impacto positivo en el periodo analizado, reduciéndose casi en 50 por ciento para los estudiantes en las escuelas de tratamiento, con un efecto de mayor magnitud para los hombres y para los estudiantes que tienen internet."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].id":{"state":"value_present","value":{"kind":"identifiers","identifiers":["AIBD-0695-source-0001"],"role":"Existing evidence items, in their original order"},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"sources[].language":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"evaluation report","citation":"EASE-ECONOMETRÍA for UNICEF Mexico. Uso de la plataforma MatematIA en CECyTEMs: Informe final ajustado (evaluation of the impact, effectiveness, relevance and sustainability of the MatematIA digital education platform), 27 November 2023. Commissioned by UNICEF and published in UNICEF's and the UN Evaluation Group's evaluation repositories.","title":"Uso de la plataforma MatematIA en CECyTEMs: Informe final ajustado","url":"https://www.unevaluation.org/get-download-file/3824","date":"2023-11-27","written_by":"evaluator","quote":"En relación con el abandono escolar el programa sí tuvo un impacto positivo en el periodo analizado, reduciéndose casi en 50 por ciento para los estudiantes en las escuelas de tratamiento, con un efecto de mayor magnitud para los hombres y para los estudiantes que tienen internet."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].upstream_sources":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"strategic_assessments[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"strategic assessments"},"summary":{"state":"value_present","value":{"kind":"record_fields","fields":{"summary":"In a randomized evaluation for UNICEF in 14 schools in the State of Mexico, dropout fell by almost 50 percent where students used MatematIA. Mathematics grades did not improve.","account":"UNICEF and the educational software firm Pixframe Studios developed MatematIA, a remedial mathematics platform for first-year upper-secondary students. The evaluators write that it uses artificial intelligence to set the order of topics for each student, alongside game mechanics and curriculum-based content. UNICEF commissioned EASE-ECONOMETRÍA to evaluate it in CECyTEM schools in the State of Mexico. In a randomized design, 7 schools used the platform and 7 served as controls, covering activities from November 2022 to July 2023. They found no effect on algebra or geometry grades, on liking mathematics or on interest in STEM careers. They found that dropout fell by almost 50 percent in the treatment schools, with larger effects for boys and for students with internet access. The estimated reduction was 0.92 percentage points, about half of the average dropout rate of 1.58 percent. Dropout was counted from final-withdrawal codes on a geometry test. The report is dated 27 November 2023. The evaluators tested the whole platform, so the AI's own share is unknown."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["summary","account"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].autonomy_permissions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].component_role":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].deployment_configuration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].inputs_outputs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_name":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].product_name":{"state":"value_present","value":{"kind":"record_fields","fields":{"system":"MatematIA (AI-personalized, gamified remedial mathematics platform)"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["system"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].provider":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"taxonomy_crosswalks[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"title":{"state":"value_present","value":{"kind":"record_fields","fields":{"title":"A randomized evaluation for UNICEF finds that dropout fell by almost half in Mexican schools that used the AI-personalized MatematIA platform","headline":"Dropout nearly halves in Mexican schools using *MatematIA*"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["title","headline"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"version":{"state":"value_present","value":{"kind":"identifiers","identifiers":["7121a1eb459b2eb0fb110a387986e6fe3ce92d121eaddf2adecf497ada5a119d"],"role":"SHA-256 of the complete public record and its assessments"},"provenance":{"kind":"curatorial","basis":"SHA-256 of the public record, its assessments, and its displayed answers and notes, excluding its own identifier and the derived coverage summary.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"workflow":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"UNICEF and the educational software firm Pixframe Studios developed MatematIA, a remedial mathematics platform for first-year upper-secondary students. The evaluators write that it uses artificial intelligence to set the order of topics for each student, alongside game mechanics and curriculum-based content. UNICEF commissioned EASE-ECONOMETRÍA to evaluate it in CECyTEM schools in the State of Mexico. In a randomized design, 7 schools used the platform and 7 served as controls, covering activities from November 2022 to July 2023. They found no effect on algebra or geometry grades, on liking mathematics or on interest in STEM careers. They found that dropout fell by almost 50 percent in the treatment schools, with larger effects for boys and for students with internet access. The estimated reduction was 0.92 percentage points, about half of the average dropout rate of 1.58 percent. Dropout was counted from final-withdrawal codes on a geometry test. The report is dated 27 November 2023. The evaluators tested the whole platform, so the AI's own share is unknown.","replication":{"produced_by":["The platform used artificial intelligence to set the order of 54 topics for each student.","It combined gamification, support material and a report generator with content from the national curriculum.","Students in 7 randomly chosen CECyTEM schools used it, with 7 schools as controls."],"must_hold":["Students need internet access, and the effect was larger for those who had it.","Content must match what is taught in class.","Students need reasons to use the platform, since it was not part of their grade."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"}},"summary":{"total":91,"addressed":91,"known":28,"reviewed":2,"reviewed_complete":2,"reviewed_partial":0,"record_mapped":26,"review_not_assessed":63,"not_assessed":0,"complete":false,"by_state":{"value_present":28,"not_reported":0,"unresolved":63,"not_assessed":0,"not_applicable":0,"withheld":0,"source_unavailable":0}}},"presentation_version":"0b5a87179ad655c4d816a26aa0a3ea80f641607c2d02d9e655ab4a65b8f37965"}