What happened
The Home Office is trialing the Asylum Case Summarisation tool, which uses a large language model to summarize asylum interview transcripts of 50 pages or more. Its own analysts evaluated two pilots in two Decision Making Units and published on 29 April 2025. The first pilot ran from May to June 2024 with 60 decision-makers in the test group and 15 in a comparison group. The second ran from September to October 2024 with 45 and 15. Participants logged their time on 334 test-group cases and 95 comparison-group cases. On average, the test group reviewed transcripts 23 minutes quicker than the comparison group, a 32% time saving. A dip-sample checked with the Calibre quality tool showed similar decision quality in both groups. Technical specialists checked every summary before use and removed 9% as inaccurate or incomplete. Of the users surveyed, 23% were not fully confident in the summaries and 65% would keep using the tool. The evaluators write that the pilots were small, the units were not representative and all measures were self-reported.
Sources
-
Evaluation report, by the organization that used it.
Home Office. Evaluation of AI trials in the asylum decision making process. Research and analysis, GOV.UK, 29 April 2025.
On average, the test group reviewed transcripts 23 minutes quicker than the comparison group (a 32% time saving).
Details
AI system
- Workflow
-
The tool used a large language model to extract and summarize information from asylum interview transcripts. Technical specialists reviewed every summary before use and removed the 9% that were inaccurate or had missing information. Decision-makers used the summary as an aid and still worked through the usual decision process.
Follow-up
- Conditions for replication
-
Summaries must be checked for accuracy before decision-makers rely on them. Decision-makers must keep making the decision themselves, with the summary as an aid. A full rollout needs a larger evaluation, as the pilots were small and the units were not representative.
Entry details
- Sector
-
Asylum and immigration administration.
- Purpose
-
The Home Office introduced the Asylum Case Summarisation tool to summarize asylum interview transcripts with a large language model, so that decision-makers can refamiliarize themselves with a case faster.
30 more questions not yet checked
model, release, provider, role, configuration, inputs and outputs, autonomy, human oversight, beneficiaries, reach, distribution and access, duration, every measurement question, every money question, ownership and control, dependencies, cross-border connections, geopolitical implications, replication attempts, availability, institutional decision, grounds, action and result, success criterion, every evidence question, observed or intended, alternative assessments, related entries, other identifiers, category mappings.
Cite this benefit
Peter H. Vartanian. (2026). Asylum Case Summarisation cuts transcript review by 23 minutes (AIBD-1193). Artificial Intelligence Benefits Database, edition of 2 November 2026. https://petervartanian.xyz/aibd/records/AIBD-1193.html (archived at https://doi.org/10.7910/DVN/AADSII, version 9.0)