{"id":"AIBD-1170","title":"Cambridge Education's review for UNICEF relays Andhra Pradesh's report that its Vidyarthi Nestham dropout model reached 92% accuracy in 2018-19","summary":"A review for UNICEF relays Andhra Pradesh's figures that its dropout prediction model reached 92% accuracy in 2018-19. The reviewers could not establish whether dropout fell.","date_observed":"2020-08-05","date_basis":"source publication","date_precision":"day","benefit_status":"reported","source_collection":null,"source_entry":null,"account":"The Andhra Pradesh School Education department, with support from Microsoft, piloted a dropout prediction model in 10,000 government schools. The model applies clustering and boosted decision trees to student data in the state's student information system, and it was first trained on 2016-17 data. Under the Vidyarthi Nestham program, teachers in selected schools are each assigned predicted dropouts from Classes 6 to 9 to mentor. Cambridge Education reviewed the state's education management information system for UNICEF's Regional Office for South Asia, in a report dated 5 August 2020. The reviewers report that the model's accuracy rose to 75% in 2017-18 and to 92% in 2018-19. These are the department's own figures, from its comparison of actual dropout with predicted likelihood, and the reviewers did not check them. The review does not define accuracy beyond that comparison. The reviewers found that it was not conclusively established whether the intervention reduced dropout, as the pilot was only then concluding.","category":"aggregate result","unexpected":false,"purpose":"The Andhra Pradesh School Education department built the dropout prediction model, with support from Microsoft, to identify students likely to drop out so that teachers can mentor them.","system":"Vidyarthi Nestham dropout prediction model","model_version":null,"developer":"Andhra Pradesh School Education department, with support from Microsoft","deployer":"Andhra Pradesh School Education department (pilot in 10,000 government schools)","location":"Andhra Pradesh, India","domain":"Education","segment":null,"benefit_type":"Improved Task Accuracy","work_activities":["4.A.2.a.4","4.A.1.b.1"],"taxonomy_note":null,"registry_ids":{},"ratings":[{"group":"organizational","depth":2,"reason":"The department reports that the model's accuracy in predicting dropout rose from 75% in 2017-18 to 92% in 2018-19."},{"group":"personal","depth":null,"reason":"The reviewers could not establish whether the mentoring reduced dropout, because the pilot was only then concluding."}],"ai_role":{"status":"unassessed","statement":"The review describes clustering and a boosted decision tree model trained on 2016-17 student data with Azure Machine Learning, so the system learns from data. The accuracy figures are the department's, and the review does not compare dropout with and without the model."},"evidence":[{"kind":"descriptive report","citation":"Cambridge Education. Review of Education management and monitoring system at school and sub-national level: Report for EMIS in Andhra Pradesh. Prepared for the UNICEF Regional Office for South Asia, 5 August 2020. Published in UNICEF's evaluation database.","title":"Review of Education management and monitoring system at school and sub-national level: Report for EMIS in Andhra Pradesh","url":"https://evaluationreports.unicef.org/GetDocument?documentID=17617&fileID=40712","date":"2020-08-05","written_by":"independent","quote":"The accuracy of the model progressed to 75% in 2017-18 and then to 92% in 2018-19"}],"replication":{"produced_by":["The model applied clustering and boosted decision trees to individual student records in the state's SIMS database.","It used 64 parameters, with learning outcomes weighted most.","The department refined the model each year against actual dropout.","Teachers received predicted dropouts to mentor and reported on them every fortnight through a mobile app."],"must_hold":["Each child must have an individual record in the student information system.","Teachers must follow up the students assigned to them and report through the app."],"echoes":[]},"paired_incident":null,"headline":"Andhra Pradesh reports 92% accuracy for its *Vidyarthi Nestham* model","metric":"92% accuracy in 2018-19","comparator":null,"later":null,"value":null,"developer_country":"India and United States","deployer_country":"India","unrated_because":null,"brief_notes":null,"brief":null,"revisions":[{"date":"2026-11-01","change":"Added the record from the report of Cambridge Education, the reviewer for the UNICEF Regional Office for South Asia.","source":"https://evaluationreports.unicef.org/GetDocument?documentID=17617&fileID=40712","editor":"AIBD"}],"confidence":"reported","shade":"medium","claim_status":"Independently reported","claim_basis":"Sources: one independent descriptive report. The cited evidence includes no independent study of the benefit and no finding by an external body.","case_jurisdictions":["India"],"profile":{"case_id":"AIBD-1170","catalog_version":"1.0.0","source_fingerprint":"5787518dd9cb43f8905940ce27f9b6e07df500c2c1f2ba0a7fde8780ea9d9949","collection_refs":[{"collection_id":"aibd","version":"2026-10-31"}],"source_ids":["AIBD-1170-source-0001"],"families":{"strategic assessments":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"evaluations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"monetary observations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"institutional decisions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]}},"fields":{"actors[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"developer":"Andhra Pradesh School Education department, with support from Microsoft","deployer":"Andhra Pradesh School Education department (pilot in 10,000 government schools)"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["developer","deployer"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"actors[].ownership_control":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"ai_contribution":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"ai_relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"category":"aggregate result","ai_role":{"status":"unassessed","statement":"The review describes clustering and a boosted decision tree model trained on 2016-17 student data with Azure Machine Learning, so the system learns from data. The accuracy figures are the department's, and the review does not compare dropout with and without the model."}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ai_role","category"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].alternatives":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].assessor_date":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].depth":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":2,"reason":"The department reports that the model's accuracy in predicting dropout rose from 75% in 2017-18 to 92% in 2018-19."},{"group":"personal","reason":"The reviewers could not establish whether the mentoring reduced dropout, because the pilot was only then concluding."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].display_confidence":{"state":"value_present","value":{"kind":"structured","data":{"confidence":"medium","evidence_word":"reported","claim_status":"Independently reported","basis":"Sources: one independent descriptive report. The cited evidence includes no independent study of the benefit and no finding by an external body.","interpretation":"Existing display rule preserved; the richer outcome-specific confidence question still needs review."}},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rationale":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":2,"reason":"The department reports that the model's accuracy in predicting dropout rose from 75% in 2017-18 to 92% in 2018-19."},{"group":"personal","reason":"The reviewers could not establish whether the mentoring reduced dropout, because the pilot was only then concluding."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rubric_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].status_basis":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].target":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":2,"reason":"The department reports that the model's accuracy in predicting dropout rose from 75% in 2017-18 to 92% in 2018-19."},{"group":"personal","reason":"The reviewers could not establish whether the mentoring reduced dropout, because the pilot was only then concluding."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"availability":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"brief":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_kind":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_links[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_links":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_strength":{"state":"value_present","value":{"kind":"structured","data":{"answer":"Independently reported. Sources: one independent descriptive report. The cited evidence includes no independent study of the benefit and no finding by an external body.","evidence_word":"reported","claim_status":"Independently reported"}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-1170-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Independently reported. Sources: one independent descriptive report. The cited evidence includes no independent study of the benefit and no finding by an external body.","inferred":false}},"claims[].missingness":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].proposition":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"cross_border_flows[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"decisions[].action_outcome":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].grounds":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].institution_task":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].success_criterion":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"deployment_stage":{"state":"value_present","value":{"kind":"structured","data":{"classification":"pilot","answer":"The system was used in a pilot. The review says that the predictive method had been in pilot for two years in 10,000 government schools and would be rolled out gradually.","scope":"The period and activity described in the case."}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["account","evidence"],"source_refs":["AIBD-1170-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"The system was used in a pilot. The review says that the predictive method had been in pilot for two years in 10,000 government schools and would be rolled out gradually.","inferred":false}},"economics[].amount":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].costs[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].counterfactual":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].currency_price_basis":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].gross_net":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].measure_type":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].period_unit":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].realization":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].recipient_payer":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].return_payback":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].valuation_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"evaluations[].ai_uplift":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].comparator":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].design":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].effect":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].exposure":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].id":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].measurement_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].metric":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].reproduction_materials":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].setting_sample":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].uncertainty_limitations":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"external_references[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"follow_up[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"human_oversight":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"id":{"state":"value_present","value":{"kind":"record_fields","fields":{"id":"AIBD-1170"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["id"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"infrastructure_dependencies[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiaries":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiary_count":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].benefit_type":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_type":"Improved Task Accuracy"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].claim":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"The Andhra Pradesh School Education department, with support from Microsoft, piloted a dropout prediction model in 10,000 government schools. The model applies clustering and boosted decision trees to student data in the state's student information system, and it was first trained on 2016-17 data. Under the Vidyarthi Nestham program, teachers in selected schools are each assigned predicted dropouts from Classes 6 to 9 to mentor. Cambridge Education reviewed the state's education management information system for UNICEF's Regional Office for South Asia, in a report dated 5 August 2020. The reviewers report that the model's accuracy rose to 75% in 2017-18 and to 92% in 2018-19. These are the department's own figures, from its comparison of actual dropout with predicted likelihood, and the reviewers did not check them. The review does not define accuracy beyond that comparison. The reviewers found that it was not conclusively established whether the intervention reduced dropout, as the pilot was only then concluding.","benefit_type":"Improved Task Accuracy"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].distribution":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].duration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].id":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].stakeholder_group":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":2,"reason":"The department reports that the model's accuracy in predicting dropout rose from 75% in 2017-18 to 92% in 2018-19."},{"group":"personal","reason":"The reviewers could not establish whether the mentoring reduced dropout, because the pilot was only then concluding."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].status":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_status":"reported"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_status"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].tradeoffs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].unexpected":{"state":"value_present","value":{"kind":"record_fields","fields":{"unexpected":false,"purpose":"The Andhra Pradesh School Education department built the dropout prediction model, with support from Microsoft, to identify students likely to drop out so that teachers can mentor them."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["unexpected","purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"places[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"location":"Andhra Pradesh, India","developer_country":"India and United States","deployer_country":"India"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["location","developer_country","deployer_country"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"purpose":{"state":"value_present","value":{"kind":"record_fields","fields":{"purpose":"The Andhra Pradesh School Education department built the dropout prediction model, with support from Microsoft, to identify students likely to drop out so that teachers can mentor them."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"record_dates":{"state":"value_present","value":{"kind":"record_fields","fields":{"date_observed":"2020-08-05","date_basis":"source publication","date_precision":"day","revisions":[{"date":"2026-11-01","change":"Added the record from the report of Cambridge Education, the reviewer for the UNICEF Regional Office for South Asia.","source":"https://evaluationreports.unicef.org/GetDocument?documentID=17617&fileID=40712","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["date_observed","date_basis","date_precision","revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"replication.attempts[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"replication.conditions":{"state":"value_present","value":{"kind":"record_fields","fields":{"replication":{"produced_by":["The model applied clustering and boosted decision trees to individual student records in the state's SIMS database.","It used 64 parameters, with learning outcomes weighted most.","The department refined the model each year against actual dropout.","Teachers received predicted dropouts to mentor and reported on them every fortnight through a mobile app."],"must_hold":["Each child must have an individual record in the student information system.","Teachers must follow up the students assigned to them and report through the app."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"revision_history[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"revisions":[{"date":"2026-11-01","change":"Added the record from the report of Cambridge Education, the reviewer for the UNICEF Regional Office for South Asia.","source":"https://evaluationreports.unicef.org/GetDocument?documentID=17617&fileID=40712","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sector":{"state":"value_present","value":{"kind":"record_fields","fields":{"domain":"Education"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["domain"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].access_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].citation_locator":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"descriptive report","citation":"Cambridge Education. Review of Education management and monitoring system at school and sub-national level: Report for EMIS in Andhra Pradesh. Prepared for the UNICEF Regional Office for South Asia, 5 August 2020. Published in UNICEF's evaluation database.","title":"Review of Education management and monitoring system at school and sub-national level: Report for EMIS in Andhra Pradesh","url":"https://evaluationreports.unicef.org/GetDocument?documentID=17617&fileID=40712","date":"2020-08-05","written_by":"independent","quote":"The accuracy of the model progressed to 75% in 2017-18 and then to 92% in 2018-19"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].id":{"state":"value_present","value":{"kind":"identifiers","identifiers":["AIBD-1170-source-0001"],"role":"Existing evidence items, in their original order"},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"sources[].language":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"descriptive report","citation":"Cambridge Education. Review of Education management and monitoring system at school and sub-national level: Report for EMIS in Andhra Pradesh. Prepared for the UNICEF Regional Office for South Asia, 5 August 2020. Published in UNICEF's evaluation database.","title":"Review of Education management and monitoring system at school and sub-national level: Report for EMIS in Andhra Pradesh","url":"https://evaluationreports.unicef.org/GetDocument?documentID=17617&fileID=40712","date":"2020-08-05","written_by":"independent","quote":"The accuracy of the model progressed to 75% in 2017-18 and then to 92% in 2018-19"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].upstream_sources":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"strategic_assessments[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"strategic assessments"},"summary":{"state":"value_present","value":{"kind":"record_fields","fields":{"summary":"A review for UNICEF relays Andhra Pradesh's figures that its dropout prediction model reached 92% accuracy in 2018-19. The reviewers could not establish whether dropout fell.","account":"The Andhra Pradesh School Education department, with support from Microsoft, piloted a dropout prediction model in 10,000 government schools. The model applies clustering and boosted decision trees to student data in the state's student information system, and it was first trained on 2016-17 data. Under the Vidyarthi Nestham program, teachers in selected schools are each assigned predicted dropouts from Classes 6 to 9 to mentor. Cambridge Education reviewed the state's education management information system for UNICEF's Regional Office for South Asia, in a report dated 5 August 2020. The reviewers report that the model's accuracy rose to 75% in 2017-18 and to 92% in 2018-19. These are the department's own figures, from its comparison of actual dropout with predicted likelihood, and the reviewers did not check them. The review does not define accuracy beyond that comparison. The reviewers found that it was not conclusively established whether the intervention reduced dropout, as the pilot was only then concluding."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["summary","account"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].autonomy_permissions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].component_role":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].deployment_configuration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].inputs_outputs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_name":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].product_name":{"state":"value_present","value":{"kind":"record_fields","fields":{"system":"Vidyarthi Nestham dropout prediction model"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["system"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].provider":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"taxonomy_crosswalks[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"title":{"state":"value_present","value":{"kind":"record_fields","fields":{"title":"Cambridge Education's review for UNICEF relays Andhra Pradesh's report that its Vidyarthi Nestham dropout model reached 92% accuracy in 2018-19","headline":"Andhra Pradesh reports 92% accuracy for its *Vidyarthi Nestham* model"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["title","headline"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"version":{"state":"value_present","value":{"kind":"identifiers","identifiers":["57ce11631253a3527230b1f2566b3abb5806afdc4e3f22519502788b40b14b99"],"role":"SHA-256 of the complete public record and its assessments"},"provenance":{"kind":"curatorial","basis":"SHA-256 of the public record, its assessments, and its displayed answers and notes, excluding its own identifier and the derived coverage summary.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"workflow":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"The Andhra Pradesh School Education department, with support from Microsoft, piloted a dropout prediction model in 10,000 government schools. The model applies clustering and boosted decision trees to student data in the state's student information system, and it was first trained on 2016-17 data. Under the Vidyarthi Nestham program, teachers in selected schools are each assigned predicted dropouts from Classes 6 to 9 to mentor. Cambridge Education reviewed the state's education management information system for UNICEF's Regional Office for South Asia, in a report dated 5 August 2020. The reviewers report that the model's accuracy rose to 75% in 2017-18 and to 92% in 2018-19. These are the department's own figures, from its comparison of actual dropout with predicted likelihood, and the reviewers did not check them. The review does not define accuracy beyond that comparison. The reviewers found that it was not conclusively established whether the intervention reduced dropout, as the pilot was only then concluding.","replication":{"produced_by":["The model applied clustering and boosted decision trees to individual student records in the state's SIMS database.","It used 64 parameters, with learning outcomes weighted most.","The department refined the model each year against actual dropout.","Teachers received predicted dropouts to mentor and reported on them every fortnight through a mobile app."],"must_hold":["Each child must have an individual record in the student information system.","Teachers must follow up the students assigned to them and report through the app."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"}},"summary":{"total":91,"addressed":91,"known":28,"reviewed":2,"reviewed_complete":2,"reviewed_partial":0,"record_mapped":26,"review_not_assessed":63,"not_assessed":0,"complete":false,"by_state":{"value_present":28,"not_reported":0,"unresolved":63,"not_assessed":0,"not_applicable":0,"withheld":0,"source_unavailable":0}}},"presentation_version":"33838b924eef3b52e57eed7710d99e13e34501a571e572ca434fb7f6dd93a75c"}