What happened
UNICEF's Evaluation Office published an evaluation of UNICEF's accountability to affected populations in March 2026. The firm Itad carried it out, drawing on ten regional and country case studies that cover 2020 to 2025. The evaluators found that offices lacked the time and skills to turn large volumes of feedback and complaints into usable data. They report that UNICEF's grievance redress mechanism (GRM) and social and behavior change (SBC) teams had started to use AI to find patterns in the narrative text of submissions. An evaluator saw an example report and judged that its insights and emerging trends appeared specific enough for programs to use. The passage does not name the country office. The report's examples of GRM and SBC feedback channels come from UNICEF Afghanistan, which the team studied through remote interviews. The report names neither the tool nor its developer and does not describe the model. It does not say whether any program acted on the insights. The evaluators add that the time needed to amend partnership agreements and procurement slowed changes based on what people said.
Sources
-
Evaluation report, by authors with no tie to the system.
UNICEF Evaluation Office. Evaluation of UNICEF's Accountability to Affected Populations: Evaluation report. Carried out by Itad. New York, March 2026. The evaluation covers 2020 to 2025.
Both have started to use artificial intelligence (AI) to identify patterns in the large volumes of qualitative data that have been captured, relevant to each sector. The example report seen by the evaluator provided actionable insights and emerging trends that appeared detailed/specific enough to be usable by programmes.
Details
AI system
- Workflow
-
The GRM and SBC teams captured the narrative text of feedback and complaint submissions. Both teams started to use AI to identify patterns in this qualitative data, relevant to each sector. The output was a report of insights and emerging trends for programs.
Follow-up
- Conditions for replication
-
Feedback and complaints must be gathered at scale through a management information system. Programs must have the time and processes to act on what people say.
Entry details
- Sector
-
Humanitarian accountability and community feedback.
- Purpose
-
An unnamed developer built the AI tool to identify patterns in the large volumes of feedback and complaint narratives that UNICEF's GRM and SBC teams collect.
31 more questions not yet checked
model, release, provider, role, configuration, inputs and outputs, autonomy, human oversight, AI contribution, beneficiaries, reach, distribution and access, duration, every measurement question, every money question, ownership and control, dependencies, cross-border connections, geopolitical implications, replication attempts, availability, institutional decision, grounds, action and result, success criterion, every evidence question, observed or intended, alternative assessments, related entries, other identifiers, category mappings.
Cite this record
Peter H. Vartanian. (2026). AI analysis of complaint narratives yields trends for UNICEF programs (AIBD-1165). Artificial Intelligence Benefits Database, edition of 1 November 2026. https://petervartanian.xyz/aibd/records/AIBD-1165.html (archived at https://doi.org/10.7910/DVN/AADSII, version 7.0)