{"id":"AIBD-1165","title":"UNICEF's Evaluation Office finds that AI analysis of complaint narratives gave insights that appeared specific enough for UNICEF programs to use","summary":"UNICEF's Evaluation Office found that AI analysis of feedback and complaint narratives by two UNICEF teams gave insights and trends that appeared specific enough for programs to use.","date_observed":"2026-03-01","date_basis":"source publication","date_precision":"month","benefit_status":"reported","source_collection":null,"source_entry":null,"account":"UNICEF's Evaluation Office published an evaluation of UNICEF's accountability to affected populations in March 2026. The firm Itad carried it out, drawing on ten regional and country case studies that cover 2020 to 2025. The evaluators found that offices lacked the time and skills to turn large volumes of feedback and complaints into usable data. They report that UNICEF's grievance redress mechanism (GRM) and social and behavior change (SBC) teams had started to use AI to find patterns in the narrative text of submissions. An evaluator saw an example report and judged that its insights and emerging trends appeared specific enough for programs to use. The passage does not name the country office. The report's examples of GRM and SBC feedback channels come from UNICEF Afghanistan, which the team studied through remote interviews. The report names neither the tool nor its developer and does not describe the model. It does not say whether any program acted on the insights. The evaluators add that the time needed to amend partnership agreements and procurement slowed changes based on what people said.","category":"benefit created","unexpected":false,"purpose":"An unnamed developer built the AI tool to identify patterns in the large volumes of feedback and complaint narratives that UNICEF's GRM and SBC teams collect.","system":"AI analysis of feedback and complaint narratives used by UNICEF's GRM and SBC teams (unnamed tool)","model_version":null,"developer":"Not named in the report","deployer":"UNICEF's grievance redress mechanism (GRM) and social and behavior change (SBC) teams, in a country office that the passage does not name (the report's GRM and SBC examples are from UNICEF Afghanistan)","location":"Country office not named in the passage (the report's GRM and SBC examples are from Afghanistan)","domain":"Humanitarian accountability and community feedback","segment":null,"benefit_type":"Improved Knowledge Discovery","work_activities":["4.A.2.a.4","4.A.2.a.2"],"taxonomy_note":null,"registry_ids":{},"ratings":[{"group":"organizational","depth":null,"reason":"The evaluator judged that one example report appeared usable by programs, and the report does not record any decision that drew on it."}],"ai_role":{"status":"unassessed","statement":"The report says only that the teams started to use AI to identify patterns in large volumes of qualitative feedback. It names no tool or model and does not show that the system learns from data. The evaluator judged one output and did not compare it with manual analysis."},"evidence":[{"kind":"evaluation report","citation":"UNICEF Evaluation Office. Evaluation of UNICEF's Accountability to Affected Populations: Evaluation report. Carried out by Itad. New York, March 2026. The evaluation covers 2020 to 2025.","title":"Evaluation of UNICEF's Accountability to Affected Populations","url":"https://evaluationreports.unicef.org/GetDocument?documentID=20750&fileID=60839","date":"2026-03-01","written_by":"independent","quote":"Both have started to use artificial intelligence (AI) to identify patterns in the large volumes of qualitative data that have been captured, relevant to each sector. The example report seen by the evaluator provided actionable insights and emerging trends that appeared detailed/specific enough to be usable by programmes."}],"replication":{"produced_by":["The GRM and SBC teams captured the narrative text of feedback and complaint submissions.","Both teams started to use AI to identify patterns in this qualitative data, relevant to each sector.","The output was a report of insights and emerging trends for programs."],"must_hold":["Feedback and complaints must be gathered at scale through a management information system.","Programs must have the time and processes to act on what people say."],"echoes":[]},"paired_incident":null,"headline":"AI analysis of complaint narratives yields trends for UNICEF programs","metric":null,"comparator":null,"later":null,"value":null,"developer_country":null,"deployer_country":null,"unrated_because":"The evaluator judged that one example report appeared usable by programs, but the report does not record any decision that drew on it.","brief_notes":null,"brief":null,"revisions":[{"date":"2026-11-01","change":"Added the record from the finding of the UNICEF Evaluation Office.","source":"https://evaluationreports.unicef.org/GetDocument?documentID=20750&fileID=60839","editor":"AIBD"}],"confidence":"found","shade":"high","claim_status":"Found by an evaluation office","claim_basis":"Sources: one independent evaluation report. The cited evidence includes no independent study or report.","case_jurisdictions":["Afghanistan"],"profile":{"case_id":"AIBD-1165","catalog_version":"1.0.0","source_fingerprint":"745b24c1ca7ed7abe8496625fe1e3034445a3392d8586060d6e21e2b072f8601","collection_refs":[{"collection_id":"aibd","version":"2026-10-31"},{"collection_id":"querist","version":"2026-10-25"}],"source_ids":["AIBD-1165-source-0001"],"families":{"strategic assessments":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"evaluations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"monetary observations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"institutional decisions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]}},"fields":{"actors[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"developer":"Not named in the report","deployer":"UNICEF's grievance redress mechanism (GRM) and social and behavior change (SBC) teams, in a country office that the passage does not name (the report's GRM and SBC examples are from UNICEF Afghanistan)"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["developer","deployer"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"actors[].ownership_control":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"ai_contribution":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"ai_relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"category":"benefit created","ai_role":{"status":"unassessed","statement":"The report says only that the teams started to use AI to identify patterns in large volumes of qualitative feedback. It names no tool or model and does not show that the system learns from data. The evaluator judged one output and did not compare it with manual analysis."}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ai_role","category"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].alternatives":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].assessor_date":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].depth":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].display_confidence":{"state":"value_present","value":{"kind":"structured","data":{"confidence":"high","evidence_word":"found","claim_status":"Found by an evaluation office","basis":"Sources: one independent evaluation report. The cited evidence includes no independent study or report.","interpretation":"Existing display rule preserved; the richer outcome-specific confidence question still needs review."}},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rationale":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","reason":"The evaluator judged that one example report appeared usable by programs, and the report does not record any decision that drew on it."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rubric_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].status_basis":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].target":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","reason":"The evaluator judged that one example report appeared usable by programs, and the report does not record any decision that drew on it."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"availability":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"brief":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_kind":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_links[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_links":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_strength":{"state":"value_present","value":{"kind":"structured","data":{"answer":"Found by an evaluation office. Sources: one independent evaluation report. The cited evidence includes no independent study or report.","evidence_word":"found","claim_status":"Found by an evaluation office"}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-1165-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Found by an evaluation office. Sources: one independent evaluation report. The cited evidence includes no independent study or report.","inferred":false}},"claims[].missingness":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].proposition":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"cross_border_flows[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"decisions[].action_outcome":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].grounds":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].institution_task":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].success_criterion":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"deployment_stage":{"state":"value_present","value":{"kind":"structured","data":{"classification":"routine use","answer":"The system was in routine use. The report says that both teams had started to use AI on the feedback that they collect, and it describes no trial.","scope":"The period and activity described in the case."}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["account","evidence"],"source_refs":["AIBD-1165-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"The system was in routine use. The report says that both teams had started to use AI on the feedback that they collect, and it describes no trial.","inferred":false}},"economics[].amount":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].costs[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].counterfactual":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].currency_price_basis":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].gross_net":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].measure_type":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].period_unit":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].realization":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].recipient_payer":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].return_payback":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].valuation_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"evaluations[].ai_uplift":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].comparator":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].design":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].effect":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].exposure":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].id":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].measurement_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].metric":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].reproduction_materials":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].setting_sample":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].uncertainty_limitations":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"external_references[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"follow_up[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"human_oversight":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"id":{"state":"value_present","value":{"kind":"record_fields","fields":{"id":"AIBD-1165"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["id"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"infrastructure_dependencies[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiaries":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiary_count":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].benefit_type":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_type":"Improved Knowledge Discovery"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].claim":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"UNICEF's Evaluation Office published an evaluation of UNICEF's accountability to affected populations in March 2026. The firm Itad carried it out, drawing on ten regional and country case studies that cover 2020 to 2025. The evaluators found that offices lacked the time and skills to turn large volumes of feedback and complaints into usable data. They report that UNICEF's grievance redress mechanism (GRM) and social and behavior change (SBC) teams had started to use AI to find patterns in the narrative text of submissions. An evaluator saw an example report and judged that its insights and emerging trends appeared specific enough for programs to use. The passage does not name the country office. The report's examples of GRM and SBC feedback channels come from UNICEF Afghanistan, which the team studied through remote interviews. The report names neither the tool nor its developer and does not describe the model. It does not say whether any program acted on the insights. The evaluators add that the time needed to amend partnership agreements and procurement slowed changes based on what people said.","benefit_type":"Improved Knowledge Discovery"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].distribution":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].duration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].id":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].stakeholder_group":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","reason":"The evaluator judged that one example report appeared usable by programs, and the report does not record any decision that drew on it."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].status":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_status":"reported"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_status"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].tradeoffs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].unexpected":{"state":"value_present","value":{"kind":"record_fields","fields":{"unexpected":false,"purpose":"An unnamed developer built the AI tool to identify patterns in the large volumes of feedback and complaint narratives that UNICEF's GRM and SBC teams collect."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["unexpected","purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"places[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"location":"Country office not named in the passage (the report's GRM and SBC examples are from Afghanistan)"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["location"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"purpose":{"state":"value_present","value":{"kind":"record_fields","fields":{"purpose":"An unnamed developer built the AI tool to identify patterns in the large volumes of feedback and complaint narratives that UNICEF's GRM and SBC teams collect."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"record_dates":{"state":"value_present","value":{"kind":"record_fields","fields":{"date_observed":"2026-03-01","date_basis":"source publication","date_precision":"month","revisions":[{"date":"2026-11-01","change":"Added the record from the finding of the UNICEF Evaluation Office.","source":"https://evaluationreports.unicef.org/GetDocument?documentID=20750&fileID=60839","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["date_observed","date_basis","date_precision","revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"replication.attempts[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"replication.conditions":{"state":"value_present","value":{"kind":"record_fields","fields":{"replication":{"produced_by":["The GRM and SBC teams captured the narrative text of feedback and complaint submissions.","Both teams started to use AI to identify patterns in this qualitative data, relevant to each sector.","The output was a report of insights and emerging trends for programs."],"must_hold":["Feedback and complaints must be gathered at scale through a management information system.","Programs must have the time and processes to act on what people say."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"revision_history[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"revisions":[{"date":"2026-11-01","change":"Added the record from the finding of the UNICEF Evaluation Office.","source":"https://evaluationreports.unicef.org/GetDocument?documentID=20750&fileID=60839","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sector":{"state":"value_present","value":{"kind":"record_fields","fields":{"domain":"Humanitarian accountability and community feedback"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["domain"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].access_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].citation_locator":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"evaluation report","citation":"UNICEF Evaluation Office. Evaluation of UNICEF's Accountability to Affected Populations: Evaluation report. Carried out by Itad. New York, March 2026. The evaluation covers 2020 to 2025.","title":"Evaluation of UNICEF's Accountability to Affected Populations","url":"https://evaluationreports.unicef.org/GetDocument?documentID=20750&fileID=60839","date":"2026-03-01","written_by":"independent","quote":"Both have started to use artificial intelligence (AI) to identify patterns in the large volumes of qualitative data that have been captured, relevant to each sector. The example report seen by the evaluator provided actionable insights and emerging trends that appeared detailed/specific enough to be usable by programmes."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].id":{"state":"value_present","value":{"kind":"identifiers","identifiers":["AIBD-1165-source-0001"],"role":"Existing evidence items, in their original order"},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"sources[].language":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"evaluation report","citation":"UNICEF Evaluation Office. Evaluation of UNICEF's Accountability to Affected Populations: Evaluation report. Carried out by Itad. New York, March 2026. The evaluation covers 2020 to 2025.","title":"Evaluation of UNICEF's Accountability to Affected Populations","url":"https://evaluationreports.unicef.org/GetDocument?documentID=20750&fileID=60839","date":"2026-03-01","written_by":"independent","quote":"Both have started to use artificial intelligence (AI) to identify patterns in the large volumes of qualitative data that have been captured, relevant to each sector. The example report seen by the evaluator provided actionable insights and emerging trends that appeared detailed/specific enough to be usable by programmes."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].upstream_sources":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"strategic_assessments[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"strategic assessments"},"summary":{"state":"value_present","value":{"kind":"record_fields","fields":{"summary":"UNICEF's Evaluation Office found that AI analysis of feedback and complaint narratives by two UNICEF teams gave insights and trends that appeared specific enough for programs to use.","account":"UNICEF's Evaluation Office published an evaluation of UNICEF's accountability to affected populations in March 2026. The firm Itad carried it out, drawing on ten regional and country case studies that cover 2020 to 2025. The evaluators found that offices lacked the time and skills to turn large volumes of feedback and complaints into usable data. They report that UNICEF's grievance redress mechanism (GRM) and social and behavior change (SBC) teams had started to use AI to find patterns in the narrative text of submissions. An evaluator saw an example report and judged that its insights and emerging trends appeared specific enough for programs to use. The passage does not name the country office. The report's examples of GRM and SBC feedback channels come from UNICEF Afghanistan, which the team studied through remote interviews. The report names neither the tool nor its developer and does not describe the model. It does not say whether any program acted on the insights. The evaluators add that the time needed to amend partnership agreements and procurement slowed changes based on what people said."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["summary","account"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].autonomy_permissions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].component_role":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].deployment_configuration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].inputs_outputs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_name":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].product_name":{"state":"value_present","value":{"kind":"record_fields","fields":{"system":"AI analysis of feedback and complaint narratives used by UNICEF's GRM and SBC teams (unnamed tool)"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["system"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].provider":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"taxonomy_crosswalks[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"title":{"state":"value_present","value":{"kind":"record_fields","fields":{"title":"UNICEF's Evaluation Office finds that AI analysis of complaint narratives gave insights that appeared specific enough for UNICEF programs to use","headline":"AI analysis of complaint narratives yields trends for UNICEF programs"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["title","headline"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"version":{"state":"value_present","value":{"kind":"identifiers","identifiers":["91fba769af6ff939dcbbc3ce2146d4d83f9b2a0f6eb60b95bb7477924bf97a79"],"role":"SHA-256 of the complete public record and its assessments"},"provenance":{"kind":"curatorial","basis":"SHA-256 of the public record, its assessments, and its displayed answers and notes, excluding its own identifier and the derived coverage summary.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"workflow":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"UNICEF's Evaluation Office published an evaluation of UNICEF's accountability to affected populations in March 2026. The firm Itad carried it out, drawing on ten regional and country case studies that cover 2020 to 2025. The evaluators found that offices lacked the time and skills to turn large volumes of feedback and complaints into usable data. They report that UNICEF's grievance redress mechanism (GRM) and social and behavior change (SBC) teams had started to use AI to find patterns in the narrative text of submissions. An evaluator saw an example report and judged that its insights and emerging trends appeared specific enough for programs to use. The passage does not name the country office. The report's examples of GRM and SBC feedback channels come from UNICEF Afghanistan, which the team studied through remote interviews. The report names neither the tool nor its developer and does not describe the model. It does not say whether any program acted on the insights. The evaluators add that the time needed to amend partnership agreements and procurement slowed changes based on what people said.","replication":{"produced_by":["The GRM and SBC teams captured the narrative text of feedback and complaint submissions.","Both teams started to use AI to identify patterns in this qualitative data, relevant to each sector.","The output was a report of insights and emerging trends for programs."],"must_hold":["Feedback and complaints must be gathered at scale through a management information system.","Programs must have the time and processes to act on what people say."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"}},"summary":{"total":91,"addressed":91,"known":27,"reviewed":2,"reviewed_complete":2,"reviewed_partial":0,"record_mapped":25,"review_not_assessed":64,"not_assessed":0,"complete":false,"by_state":{"value_present":27,"not_reported":0,"unresolved":64,"not_assessed":0,"not_applicable":0,"withheld":0,"source_unavailable":0}}},"presentation_version":"430268b8085ae83f807d091a3c4b44561d1c1596a9ae519827d31d6841384bba"}