{"id":"AIBD-1173","title":"The World Bank's Independent Evaluation Group lists a machine-learning tool used since 2017 to price Zimbabwe's health financing package","summary":"The World Bank's evaluation office lists a machine-learning-based optimization tool, introduced in 2017 and used in later price reviews, among the efficiency measures of Zimbabwe's health RBF program.","date_observed":"2017-01-01","date_basis":"event","date_precision":"year","benefit_status":"reported","source_collection":null,"source_entry":null,"account":"Zimbabwe's Health Sector Development Support Project ran from 2011 to April 2023 with World Bank-administered grants. It paid health facilities through results-based financing contracts for a package of maternal and child health services. The World Bank's Independent Evaluation Group reviewed the project's completion report on 9 June 2025 and rated its efficiency substantial. Among the efficiency studies and tools, the evaluators list an innovative machine-learning-based optimization tool. It was introduced in 2017 and used in subsequent price reviews to derive prices for interventions in the RBF-incentivized package. The Bank's own completion report of 3 April 2025 contains the same sentence. Neither document names the tool, says who built it, describes its method or states what the tool changed in the prices, the cost of price reviews or the services delivered.","category":"benefit created","unexpected":false,"purpose":"An unnamed developer built the optimization tool to derive the prices paid for interventions in Zimbabwe's results-based financing package at price reviews.","system":"Machine-learning-based optimization tool for pricing interventions in Zimbabwe's results-based financing package (not named in the review)","model_version":null,"developer":"Not named in the review","deployer":"Zimbabwe's results-based financing program under the Ministry of Health and Child Care, with Cordaid as project implementation entity (the review does not say who ran the price reviews)","location":"Zimbabwe","domain":"Health financing","segment":null,"benefit_type":"Improved Organizational Efficiency","work_activities":["4.A.1.b.3","4.A.2.a.4"],"taxonomy_note":"The evaluators list the tool among efficiency measures without stating the gain.","registry_ids":{},"ratings":[{"group":"organizational","depth":null,"reason":"The evaluators list the tool among the project's efficiency measures but give no figure for what it changed in prices, review costs or services, so the extent cannot be established."}],"ai_role":{"status":"unassessed","statement":"The evaluators call the tool machine-learning-based and state that it was used in price reviews from 2017. They do not describe the model, name its builder or compare prices set with and without it."},"evidence":[{"kind":"evaluation report","citation":"World Bank Independent Evaluation Group. Implementation Completion Report (ICR) Review: ZW-Health Sector Development Support Project (FY12) (P125229), ICRR0022785, 9 June 2025.","title":"Implementation Completion Report (ICR) Review: ZW-Health Sector Development Support Project (FY12) (P125229)","url":"https://documents.worldbank.org/curated/en/099060925164519784/pdf/P125229-562fb4d1-75a5-46bb-9b46-d6b3624ce43d.pdf","date":"2025-06-09","written_by":"independent","quote":"An innovative machine-learning-based optimization tool was introduced in 2017 and used in subsequent price reviews to derive prices for interventions in the RBF-incentivized package."},{"kind":"report","citation":"World Bank. Implementation Completion and Results Report: Zimbabwe Health Sector Development Support Project (P125229). ICR00318, 3 April 2025. The Bank's own completion report, which the Independent Evaluation Group reviewed.","title":"Implementation Completion and Results Report: Zimbabwe Health Sector Development Support Project (P125229)","url":"https://documents.worldbank.org/curated/en/099040725122029966/pdf/BOSIB-94e88ae1-44e2-4630-91de-714e8fde7cd7.pdf","date":"2025-04-03","written_by":"evaluator","quote":"An innovative machine-learning-based optimization tool was introduced in 2017 and used in subsequent price reviews to derive prices for interventions in the RBF incentivized package."}],"replication":{"produced_by":["The results-based financing program paid facilities for a defined package of services at set prices.","The program reviewed the prices of the package periodically and used the tool from 2017 to derive them."],"must_hold":["The program must hold service volume and cost data on which prices can be derived.","Price reviews must take place and must adopt the tool's prices."],"echoes":[]},"paired_incident":null,"headline":"Machine learning helps price Zimbabwe's health financing package","metric":null,"comparator":null,"later":null,"benefit_dimensions":["functional"],"benefit_categories":["operational_improvement"],"scsp_example":"Faster data management, decision-making","size":{"reach":{"band":1,"fact":"The tool served one program, Zimbabwe's results-based health financing, in its price reviews.","quote":"An innovative machine-learning-based optimization tool was introduced in 2017 and used in subsequent price reviews to derive prices for interventions in the RBF-incentivized package.","url":"https://documents.worldbank.org/curated/en/099060925164519784/pdf/P125229-562fb4d1-75a5-46bb-9b46-d6b3624ce43d.pdf","reason":null},"duration":{"band":null,"fact":null,"quote":null,"url":null,"reason":"The reviews say the tool was used in price reviews after 2017 but do not say for how many years."},"distribution":{"band":null,"fact":null,"quote":null,"url":null,"reason":"The benefit went to one program, and no groups are compared."},"frequency":{"band":null,"fact":null,"quote":null,"url":null,"reason":"The reviews do not say how often prices were reviewed."}},"value":null,"developer_country":null,"deployer_country":"Zimbabwe","unrated_because":"The review records that the tool was used in price reviews but does not state any result that the tool produced.","brief_notes":null,"brief":null,"revisions":[{"date":"2026-11-01","change":"Added the record from the finding of the World Bank Independent Evaluation Group.","source":"https://documents.worldbank.org/curated/en/099060925164519784/pdf/P125229-562fb4d1-75a5-46bb-9b46-d6b3624ce43d.pdf","editor":"AIBD"},{"date":"2026-11-01","change":"Placed the benefit under its broad categories and recorded its reach, duration, distribution and frequency from its sources.","source":null,"editor":"AIBD"}],"confidence":"found","shade":"high","claim_status":"Found by an evaluation office","claim_basis":"Sources: one independent evaluation report and the evaluators' report. The cited evidence includes no independent study or research report.","case_jurisdictions":["Zimbabwe"],"profile":{"case_id":"AIBD-1173","catalog_version":"1.0.0","source_fingerprint":"9f6af3ff292d179e10283767acdaae3e9ec61412db9da994e4941853dd47a679","collection_refs":[{"collection_id":"aibd","version":"2026-10-31"},{"collection_id":"querist","version":"2026-10-25"}],"source_ids":["AIBD-1173-source-0001","AIBD-1173-source-0002"],"families":{"strategic assessments":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"evaluations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"monetary observations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"institutional decisions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]}},"fields":{"actors[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"developer":"Not named in the review","deployer":"Zimbabwe's results-based financing program under the Ministry of Health and Child Care, with Cordaid as project implementation entity (the review does not say who ran the price reviews)"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["developer","deployer"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"actors[].ownership_control":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"ai_contribution":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"ai_relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"category":"benefit created","ai_role":{"status":"unassessed","statement":"The evaluators call the tool machine-learning-based and state that it was used in price reviews from 2017. They do not describe the model, name its builder or compare prices set with and without it."}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ai_role","category"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].alternatives":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].assessor_date":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].depth":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].display_confidence":{"state":"value_present","value":{"kind":"structured","data":{"confidence":"high","evidence_word":"found","claim_status":"Found by an evaluation office","basis":"Sources: one independent evaluation report and the evaluators' report. The cited evidence includes no independent study or research report.","interpretation":"Existing display rule preserved; the richer outcome-specific confidence question still needs review."}},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rationale":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","reason":"The evaluators list the tool among the project's efficiency measures but give no figure for what it changed in prices, review costs or services, so the extent cannot be established."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rubric_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].status_basis":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].target":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","reason":"The evaluators list the tool among the project's efficiency measures but give no figure for what it changed in prices, review costs or services, so the extent cannot be established."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"availability":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"brief":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_kind":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_links[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_links":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_strength":{"state":"value_present","value":{"kind":"structured","data":{"answer":"Found by an evaluation office. Sources: one independent evaluation report and the evaluators' report. The cited evidence includes no independent study or report.","evidence_word":"found","claim_status":"Found by an evaluation office"}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-1173-source-0001","AIBD-1173-source-0002"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Found by an evaluation office. Sources: one independent evaluation report and the evaluators' report. The cited evidence includes no independent study or report.","inferred":false}},"claims[].missingness":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].proposition":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"cross_border_flows[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"decisions[].action_outcome":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].grounds":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].institution_task":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].success_criterion":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"deployment_stage":{"state":"value_present","value":{"kind":"structured","data":{"classification":"routine use","answer":"The system was in routine use. The tool was used in subsequent price reviews after its 2017 introduction, according to the review.","scope":"The period and activity described in the case."}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["account","evidence"],"source_refs":["AIBD-1173-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"The system was in routine use. The tool was used in subsequent price reviews after its 2017 introduction, according to the review.","inferred":false}},"economics[].amount":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].costs[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].counterfactual":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].currency_price_basis":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].gross_net":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].measure_type":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].period_unit":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].realization":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].recipient_payer":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].return_payback":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].valuation_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"evaluations[].ai_uplift":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].comparator":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].design":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].effect":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].exposure":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].id":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].measurement_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].metric":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].reproduction_materials":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].setting_sample":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].uncertainty_limitations":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"external_references[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"follow_up[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"human_oversight":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"id":{"state":"value_present","value":{"kind":"record_fields","fields":{"id":"AIBD-1173"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["id"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"infrastructure_dependencies[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiaries":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiary_count":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].benefit_type":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_type":"Improved Organizational Efficiency","taxonomy_note":"The evaluators list the tool among efficiency measures without stating the gain."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_type","taxonomy_note"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].claim":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"Zimbabwe's Health Sector Development Support Project ran from 2011 to April 2023 with World Bank-administered grants. It paid health facilities through results-based financing contracts for a package of maternal and child health services. The World Bank's Independent Evaluation Group reviewed the project's completion report on 9 June 2025 and rated its efficiency substantial. Among the efficiency studies and tools, the evaluators list an innovative machine-learning-based optimization tool. It was introduced in 2017 and used in subsequent price reviews to derive prices for interventions in the RBF-incentivized package. The Bank's own completion report of 3 April 2025 contains the same sentence. Neither document names the tool, says who built it, describes its method or states what the tool changed in the prices, the cost of price reviews or the services delivered.","benefit_type":"Improved Organizational Efficiency"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].distribution":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].duration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].id":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].stakeholder_group":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","reason":"The evaluators list the tool among the project's efficiency measures but give no figure for what it changed in prices, review costs or services, so the extent cannot be established."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].status":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_status":"reported"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_status"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].tradeoffs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].unexpected":{"state":"value_present","value":{"kind":"record_fields","fields":{"unexpected":false,"purpose":"An unnamed developer built the optimization tool to derive the prices paid for interventions in Zimbabwe's results-based financing package at price reviews."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["unexpected","purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"places[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"location":"Zimbabwe","deployer_country":"Zimbabwe"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["location","deployer_country"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"purpose":{"state":"value_present","value":{"kind":"record_fields","fields":{"purpose":"An unnamed developer built the optimization tool to derive the prices paid for interventions in Zimbabwe's results-based financing package at price reviews."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"record_dates":{"state":"value_present","value":{"kind":"record_fields","fields":{"date_observed":"2017-01-01","date_basis":"event","date_precision":"year","revisions":[{"date":"2026-11-01","change":"Added the record from the finding of the World Bank Independent Evaluation Group.","source":"https://documents.worldbank.org/curated/en/099060925164519784/pdf/P125229-562fb4d1-75a5-46bb-9b46-d6b3624ce43d.pdf","editor":"AIBD"},{"date":"2026-11-01","change":"Placed the benefit under its broad categories and recorded its reach, duration, distribution and frequency from its sources.","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["date_observed","date_basis","date_precision","revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"replication.attempts[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"replication.conditions":{"state":"value_present","value":{"kind":"record_fields","fields":{"replication":{"produced_by":["The results-based financing program paid facilities for a defined package of services at set prices.","The program reviewed the prices of the package periodically and used the tool from 2017 to derive them."],"must_hold":["The program must hold service volume and cost data on which prices can be derived.","Price reviews must take place and must adopt the tool's prices."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"revision_history[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"revisions":[{"date":"2026-11-01","change":"Added the record from the finding of the World Bank Independent Evaluation Group.","source":"https://documents.worldbank.org/curated/en/099060925164519784/pdf/P125229-562fb4d1-75a5-46bb-9b46-d6b3624ce43d.pdf","editor":"AIBD"},{"date":"2026-11-01","change":"Placed the benefit under its broad categories and recorded its reach, duration, distribution and frequency from its sources.","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sector":{"state":"value_present","value":{"kind":"record_fields","fields":{"domain":"Health financing"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["domain"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].access_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].citation_locator":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"evaluation report","citation":"World Bank Independent Evaluation Group. Implementation Completion Report (ICR) Review: ZW-Health Sector Development Support Project (FY12) (P125229), ICRR0022785, 9 June 2025.","title":"Implementation Completion Report (ICR) Review: ZW-Health Sector Development Support Project (FY12) (P125229)","url":"https://documents.worldbank.org/curated/en/099060925164519784/pdf/P125229-562fb4d1-75a5-46bb-9b46-d6b3624ce43d.pdf","date":"2025-06-09","written_by":"independent","quote":"An innovative machine-learning-based optimization tool was introduced in 2017 and used in subsequent price reviews to derive prices for interventions in the RBF-incentivized package."},{"kind":"report","citation":"World Bank. Implementation Completion and Results Report: Zimbabwe Health Sector Development Support Project (P125229). ICR00318, 3 April 2025. The Bank's own completion report, which the Independent Evaluation Group reviewed.","title":"Implementation Completion and Results Report: Zimbabwe Health Sector Development Support Project (P125229)","url":"https://documents.worldbank.org/curated/en/099040725122029966/pdf/BOSIB-94e88ae1-44e2-4630-91de-714e8fde7cd7.pdf","date":"2025-04-03","written_by":"evaluator","quote":"An innovative machine-learning-based optimization tool was introduced in 2017 and used in subsequent price reviews to derive prices for interventions in the RBF incentivized package."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].id":{"state":"value_present","value":{"kind":"identifiers","identifiers":["AIBD-1173-source-0001","AIBD-1173-source-0002"],"role":"Existing evidence items, in their original order"},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"sources[].language":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"evaluation report","citation":"World Bank Independent Evaluation Group. Implementation Completion Report (ICR) Review: ZW-Health Sector Development Support Project (FY12) (P125229), ICRR0022785, 9 June 2025.","title":"Implementation Completion Report (ICR) Review: ZW-Health Sector Development Support Project (FY12) (P125229)","url":"https://documents.worldbank.org/curated/en/099060925164519784/pdf/P125229-562fb4d1-75a5-46bb-9b46-d6b3624ce43d.pdf","date":"2025-06-09","written_by":"independent","quote":"An innovative machine-learning-based optimization tool was introduced in 2017 and used in subsequent price reviews to derive prices for interventions in the RBF-incentivized package."},{"kind":"report","citation":"World Bank. Implementation Completion and Results Report: Zimbabwe Health Sector Development Support Project (P125229). ICR00318, 3 April 2025. The Bank's own completion report, which the Independent Evaluation Group reviewed.","title":"Implementation Completion and Results Report: Zimbabwe Health Sector Development Support Project (P125229)","url":"https://documents.worldbank.org/curated/en/099040725122029966/pdf/BOSIB-94e88ae1-44e2-4630-91de-714e8fde7cd7.pdf","date":"2025-04-03","written_by":"evaluator","quote":"An innovative machine-learning-based optimization tool was introduced in 2017 and used in subsequent price reviews to derive prices for interventions in the RBF incentivized package."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].upstream_sources":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"strategic_assessments[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"strategic assessments"},"summary":{"state":"value_present","value":{"kind":"record_fields","fields":{"summary":"The World Bank's evaluation office lists a machine-learning-based optimization tool, introduced in 2017 and used in later price reviews, among the efficiency measures of Zimbabwe's health RBF program.","account":"Zimbabwe's Health Sector Development Support Project ran from 2011 to April 2023 with World Bank-administered grants. It paid health facilities through results-based financing contracts for a package of maternal and child health services. The World Bank's Independent Evaluation Group reviewed the project's completion report on 9 June 2025 and rated its efficiency substantial. Among the efficiency studies and tools, the evaluators list an innovative machine-learning-based optimization tool. It was introduced in 2017 and used in subsequent price reviews to derive prices for interventions in the RBF-incentivized package. The Bank's own completion report of 3 April 2025 contains the same sentence. Neither document names the tool, says who built it, describes its method or states what the tool changed in the prices, the cost of price reviews or the services delivered."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["summary","account"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].autonomy_permissions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].component_role":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].deployment_configuration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].inputs_outputs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_name":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].product_name":{"state":"value_present","value":{"kind":"record_fields","fields":{"system":"Machine-learning-based optimization tool for pricing interventions in Zimbabwe's results-based financing package (not named in the review)"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["system"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].provider":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"taxonomy_crosswalks[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"title":{"state":"value_present","value":{"kind":"record_fields","fields":{"title":"The World Bank's Independent Evaluation Group lists a machine-learning tool used since 2017 to price Zimbabwe's health financing package","headline":"Machine learning helps price Zimbabwe's health financing package"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["title","headline"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"version":{"state":"value_present","value":{"kind":"identifiers","identifiers":["0e9ea2e8ad15c981549a28d15df6eb1858efd7f9fbe0711c722ad3e42913f951"],"role":"SHA-256 of the complete public record and its assessments"},"provenance":{"kind":"curatorial","basis":"SHA-256 of the public record, its assessments, and its displayed answers and notes, excluding its own identifier and the derived coverage summary.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"workflow":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"Zimbabwe's Health Sector Development Support Project ran from 2011 to April 2023 with World Bank-administered grants. It paid health facilities through results-based financing contracts for a package of maternal and child health services. The World Bank's Independent Evaluation Group reviewed the project's completion report on 9 June 2025 and rated its efficiency substantial. Among the efficiency studies and tools, the evaluators list an innovative machine-learning-based optimization tool. It was introduced in 2017 and used in subsequent price reviews to derive prices for interventions in the RBF-incentivized package. The Bank's own completion report of 3 April 2025 contains the same sentence. Neither document names the tool, says who built it, describes its method or states what the tool changed in the prices, the cost of price reviews or the services delivered.","replication":{"produced_by":["The results-based financing program paid facilities for a defined package of services at set prices.","The program reviewed the prices of the package periodically and used the tool from 2017 to derive them."],"must_hold":["The program must hold service volume and cost data on which prices can be derived.","Price reviews must take place and must adopt the tool's prices."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"}},"summary":{"total":91,"addressed":91,"known":27,"reviewed":2,"reviewed_complete":2,"reviewed_partial":0,"record_mapped":25,"review_not_assessed":64,"not_assessed":0,"complete":false,"by_state":{"value_present":27,"not_reported":0,"unresolved":64,"not_assessed":0,"not_applicable":0,"withheld":0,"source_unavailable":0}}},"presentation_version":"526a10de378551cd4f4e9949ef25609407ff251d48d318bb21bb8ec887cbebf2"}