{"id":"AIBD-1193","title":"The Home Office's evaluation of its Asylum Case Summarisation tool finds that decision-makers reviewed transcripts 23 minutes faster per case","summary":"In Home Office pilots in 2024, decision-makers using the Asylum Case Summarisation tool reviewed interview transcripts 23 minutes quicker per case than a comparison group, a 32% time saving.","date_observed":"2024-10-01","date_basis":"event","date_precision":"month","benefit_status":"reported","source_collection":null,"source_entry":null,"account":"The Home Office is trialing the Asylum Case Summarisation tool, which uses a large language model to summarize asylum interview transcripts of 50 pages or more. Its own analysts evaluated two pilots in two Decision Making Units and published on 29 April 2025. The first pilot ran from May to June 2024 with 60 decision-makers in the test group and 15 in a comparison group. The second ran from September to October 2024 with 45 and 15. Participants logged their time on 334 test-group cases and 95 comparison-group cases. On average, the test group reviewed transcripts 23 minutes quicker than the comparison group, a 32% time saving. A dip-sample checked with the Calibre quality tool showed similar decision quality in both groups. Technical specialists checked every summary before use and removed 9% as inaccurate or incomplete. Of the users surveyed, 23% were not fully confident in the summaries and 65% would keep using the tool. The evaluators write that the pilots were small, the units were not representative and all measures were self-reported.","category":"aggregate result","unexpected":false,"purpose":"The Home Office introduced the Asylum Case Summarisation tool to summarize asylum interview transcripts with a large language model, so that decision-makers can refamiliarize themselves with a case faster.","system":"Asylum Case Summarisation (ACS) tool","model_version":null,"developer":"Home Office (the evaluation names no outside supplier)","deployer":"Home Office asylum decision-makers in two Decision Making Units","location":"United Kingdom","domain":"Asylum and immigration administration","segment":null,"benefit_type":"Reduced Task Time","work_activities":["4.A.2.a.2","4.A.1.a.1"],"taxonomy_note":null,"registry_ids":{},"ratings":[{"group":"organizational","depth":1,"reason":"Decision-makers using the tool reviewed transcripts 23 minutes quicker per case than the comparison group, with no change in decision quality in a dip-sample. The pilots were small and times were self-logged."}],"ai_role":{"status":"assessed","statement":"The evaluation compared decision-makers using the tool with a comparison group without it in the same units, and it credits the 23-minute difference to the tool. The groups were not randomly assigned, times were self-logged and the pilots were small. The document says that the tool uses a large language model."},"evidence":[{"kind":"evaluation report","citation":"Home Office. Evaluation of AI trials in the asylum decision making process. Research and analysis, GOV.UK, 29 April 2025.","title":"Evaluation of AI trials in the asylum decision making process","url":"https://www.gov.uk/government/publications/evaluation-of-ai-trials-in-the-asylum-decision-making-process/evaluation-of-ai-trials-in-the-asylum-decision-making-process","date":"2025-04-29","written_by":"deployer","quote":"On average, the test group reviewed transcripts 23 minutes quicker than the comparison group (a 32% time saving)."}],"replication":{"produced_by":["The tool used a large language model to extract and summarize information from asylum interview transcripts.","Technical specialists reviewed every summary before use and removed the 9% that were inaccurate or had missing information.","Decision-makers used the summary as an aid and still worked through the usual decision process."],"must_hold":["Summaries must be checked for accuracy before decision-makers rely on them.","Decision-makers must keep making the decision themselves, with the summary as an aid.","A full rollout needs a larger evaluation, as the pilots were small and the units were not representative."],"echoes":[]},"paired_incident":null,"headline":"*Asylum Case Summarisation* cuts transcript review by 23 minutes","metric":"23 minutes quicker per case","comparator":{"against":"A comparison group of decision-makers in the same Decision Making Units who worked without the tool","before":null,"after":"23 minutes quicker per case (a 32% time saving)","basis":"measured","quote":"On average, the test group reviewed transcripts 23 minutes quicker than the comparison group (a 32% time saving).","url":"https://www.gov.uk/government/publications/evaluation-of-ai-trials-in-the-asylum-decision-making-process/evaluation-of-ai-trials-in-the-asylum-decision-making-process"},"later":null,"benefit_dimensions":["functional","societal"],"benefit_categories":["operational_improvement"],"scsp_example":"Faster data management, decision-making","size":{"reach":{"band":2,"fact":"Sixty decision-makers used the tool in the first pilot phase, and 45 in the second, in the same units.","quote":"An initial 8-week pilot phase was undertaken from May to June 2024, with 60 decision-makers in the test group and 15 decision-makers in the comparison group.","url":"https://www.gov.uk/government/publications/evaluation-of-ai-trials-in-the-asylum-decision-making-process/evaluation-of-ai-trials-in-the-asylum-decision-making-process","reason":null},"duration":{"band":2,"fact":"Each pilot phase gave decision-makers the tool for eight weeks, the second from September to October 2024.","quote":"A second 8-week phase of piloting was undertaken within the same DMUs from September to October 2024, with 45 decision-makers in the test group and 15 decision-makers in the comparison group.","url":"https://www.gov.uk/government/publications/evaluation-of-ai-trials-in-the-asylum-decision-making-process/evaluation-of-ai-trials-in-the-asylum-decision-making-process","reason":null},"distribution":{"band":null,"fact":null,"quote":null,"url":null,"reason":"The evaluation checks decisions for the most common nationality only and does not compare the time saving across groups."},"frequency":{"band":null,"fact":null,"quote":null,"url":null,"reason":"The evaluation logs 334 asylum claims worked with the tool but does not say how often each decision-maker used it."}},"value":null,"developer_country":"United Kingdom","deployer_country":"United Kingdom","unrated_because":null,"brief_notes":null,"brief":null,"revisions":[{"date":"2026-11-01","change":"Added the record from the report of the Home Office.","source":"https://www.gov.uk/government/publications/evaluation-of-ai-trials-in-the-asylum-decision-making-process/evaluation-of-ai-trials-in-the-asylum-decision-making-process","editor":"AIBD"},{"date":"2026-11-01","change":"Placed the benefit under its broad categories and recorded its reach, duration, distribution and frequency from its sources.","source":null,"editor":"AIBD"}],"confidence":"claimed","shade":"low","claim_status":"The deployer's account","claim_basis":"Sources: the deployer's evaluation report. The cited evidence includes no independent source and no finding by an external body.","case_jurisdictions":["United Kingdom"],"profile":{"case_id":"AIBD-1193","catalog_version":"1.0.0","source_fingerprint":"e05879635e8b195dcc48ce2f3248f41a882eb1383bffcf905755d9f3be75f900","collection_refs":[{"collection_id":"aibd","version":"2026-10-31"},{"collection_id":"querist","version":"2026-10-25"}],"source_ids":["AIBD-1193-source-0001"],"families":{"strategic assessments":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"evaluations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"monetary observations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"institutional decisions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]}},"fields":{"actors[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"developer":"Home Office (the evaluation names no outside supplier)","deployer":"Home Office asylum decision-makers in two Decision Making Units"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["developer","deployer"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"actors[].ownership_control":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"ai_contribution":{"state":"value_present","value":{"kind":"record_fields","fields":{"ai_role":{"status":"assessed","statement":"The evaluation compared decision-makers using the tool with a comparison group without it in the same units, and it credits the 23-minute difference to the tool. The groups were not randomly assigned, times were self-logged and the pilots were small. The document says that the tool uses a large language model."}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ai_role"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"ai_relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"category":"aggregate result","ai_role":{"status":"assessed","statement":"The evaluation compared decision-makers using the tool with a comparison group without it in the same units, and it credits the 23-minute difference to the tool. The groups were not randomly assigned, times were self-logged and the pilots were small. The document says that the tool uses a large language model."}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ai_role","category"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].alternatives":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].assessor_date":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].depth":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":1,"reason":"Decision-makers using the tool reviewed transcripts 23 minutes quicker per case than the comparison group, with no change in decision quality in a dip-sample. The pilots were small and times were self-logged."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].display_confidence":{"state":"value_present","value":{"kind":"structured","data":{"confidence":"low","evidence_word":"claimed","claim_status":"The deployer's account","basis":"Sources: the deployer's evaluation report. The cited evidence includes no independent source and no finding by an external body.","interpretation":"Existing display rule preserved; the richer outcome-specific confidence question still needs review."}},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rationale":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":1,"reason":"Decision-makers using the tool reviewed transcripts 23 minutes quicker per case than the comparison group, with no change in decision quality in a dip-sample. The pilots were small and times were self-logged."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rubric_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].status_basis":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].target":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":1,"reason":"Decision-makers using the tool reviewed transcripts 23 minutes quicker per case than the comparison group, with no change in decision quality in a dip-sample. The pilots were small and times were self-logged."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"availability":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"brief":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_kind":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_links[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_links":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_strength":{"state":"value_present","value":{"kind":"structured","data":{"answer":"The deployer's account. Sources: the deployer's evaluation report. The cited evidence includes no independent source and no finding by an external body.","evidence_word":"claimed","claim_status":"The deployer's account"}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-1193-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"The deployer's account. Sources: the deployer's evaluation report. The cited evidence includes no independent source and no finding by an external body.","inferred":false}},"claims[].missingness":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].proposition":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"cross_border_flows[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"decisions[].action_outcome":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].grounds":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].institution_task":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].success_criterion":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"deployment_stage":{"state":"value_present","value":{"kind":"structured","data":{"classification":"pilot","answer":"The system was used in a pilot. The tool ran in two eight-week pilot phases in two Decision Making Units, and the evaluators recommend further evaluation before any full rollout.","scope":"The period and activity described in the case."}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["account","evidence"],"source_refs":["AIBD-1193-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"The system was used in a pilot. The tool ran in two eight-week pilot phases in two Decision Making Units, and the evaluators recommend further evaluation before any full rollout.","inferred":false}},"economics[].amount":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].costs[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].counterfactual":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].currency_price_basis":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].gross_net":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].measure_type":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].period_unit":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].realization":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].recipient_payer":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].return_payback":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].valuation_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"evaluations[].ai_uplift":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].comparator":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].design":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].effect":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].exposure":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].id":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].measurement_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].metric":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].reproduction_materials":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].setting_sample":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].uncertainty_limitations":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"external_references[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"follow_up[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"human_oversight":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"id":{"state":"value_present","value":{"kind":"record_fields","fields":{"id":"AIBD-1193"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["id"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"infrastructure_dependencies[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiaries":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiary_count":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].benefit_type":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_type":"Reduced Task Time"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].claim":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"The Home Office is trialing the Asylum Case Summarisation tool, which uses a large language model to summarize asylum interview transcripts of 50 pages or more. Its own analysts evaluated two pilots in two Decision Making Units and published on 29 April 2025. The first pilot ran from May to June 2024 with 60 decision-makers in the test group and 15 in a comparison group. The second ran from September to October 2024 with 45 and 15. Participants logged their time on 334 test-group cases and 95 comparison-group cases. On average, the test group reviewed transcripts 23 minutes quicker than the comparison group, a 32% time saving. A dip-sample checked with the Calibre quality tool showed similar decision quality in both groups. Technical specialists checked every summary before use and removed 9% as inaccurate or incomplete. Of the users surveyed, 23% were not fully confident in the summaries and 65% would keep using the tool. The evaluators write that the pilots were small, the units were not representative and all measures were self-reported.","benefit_type":"Reduced Task Time"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].distribution":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].duration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].id":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].stakeholder_group":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":1,"reason":"Decision-makers using the tool reviewed transcripts 23 minutes quicker per case than the comparison group, with no change in decision quality in a dip-sample. The pilots were small and times were self-logged."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].status":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_status":"reported"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_status"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].tradeoffs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].unexpected":{"state":"value_present","value":{"kind":"record_fields","fields":{"unexpected":false,"purpose":"The Home Office introduced the Asylum Case Summarisation tool to summarize asylum interview transcripts with a large language model, so that decision-makers can refamiliarize themselves with a case faster."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["unexpected","purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"places[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"location":"United Kingdom","developer_country":"United Kingdom","deployer_country":"United Kingdom"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["location","developer_country","deployer_country"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"purpose":{"state":"value_present","value":{"kind":"record_fields","fields":{"purpose":"The Home Office introduced the Asylum Case Summarisation tool to summarize asylum interview transcripts with a large language model, so that decision-makers can refamiliarize themselves with a case faster."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"record_dates":{"state":"value_present","value":{"kind":"record_fields","fields":{"date_observed":"2024-10-01","date_basis":"event","date_precision":"month","revisions":[{"date":"2026-11-01","change":"Added the record from the report of the Home Office.","source":"https://www.gov.uk/government/publications/evaluation-of-ai-trials-in-the-asylum-decision-making-process/evaluation-of-ai-trials-in-the-asylum-decision-making-process","editor":"AIBD"},{"date":"2026-11-01","change":"Placed the benefit under its broad categories and recorded its reach, duration, distribution and frequency from its sources.","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["date_observed","date_basis","date_precision","revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"replication.attempts[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"replication.conditions":{"state":"value_present","value":{"kind":"record_fields","fields":{"replication":{"produced_by":["The tool used a large language model to extract and summarize information from asylum interview transcripts.","Technical specialists reviewed every summary before use and removed the 9% that were inaccurate or had missing information.","Decision-makers used the summary as an aid and still worked through the usual decision process."],"must_hold":["Summaries must be checked for accuracy before decision-makers rely on them.","Decision-makers must keep making the decision themselves, with the summary as an aid.","A full rollout needs a larger evaluation, as the pilots were small and the units were not representative."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"revision_history[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"revisions":[{"date":"2026-11-01","change":"Added the record from the report of the Home Office.","source":"https://www.gov.uk/government/publications/evaluation-of-ai-trials-in-the-asylum-decision-making-process/evaluation-of-ai-trials-in-the-asylum-decision-making-process","editor":"AIBD"},{"date":"2026-11-01","change":"Placed the benefit under its broad categories and recorded its reach, duration, distribution and frequency from its sources.","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sector":{"state":"value_present","value":{"kind":"record_fields","fields":{"domain":"Asylum and immigration administration"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["domain"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].access_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].citation_locator":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"evaluation report","citation":"Home Office. Evaluation of AI trials in the asylum decision making process. Research and analysis, GOV.UK, 29 April 2025.","title":"Evaluation of AI trials in the asylum decision making process","url":"https://www.gov.uk/government/publications/evaluation-of-ai-trials-in-the-asylum-decision-making-process/evaluation-of-ai-trials-in-the-asylum-decision-making-process","date":"2025-04-29","written_by":"deployer","quote":"On average, the test group reviewed transcripts 23 minutes quicker than the comparison group (a 32% time saving)."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].id":{"state":"value_present","value":{"kind":"identifiers","identifiers":["AIBD-1193-source-0001"],"role":"Existing evidence items, in their original order"},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"sources[].language":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"evaluation report","citation":"Home Office. Evaluation of AI trials in the asylum decision making process. Research and analysis, GOV.UK, 29 April 2025.","title":"Evaluation of AI trials in the asylum decision making process","url":"https://www.gov.uk/government/publications/evaluation-of-ai-trials-in-the-asylum-decision-making-process/evaluation-of-ai-trials-in-the-asylum-decision-making-process","date":"2025-04-29","written_by":"deployer","quote":"On average, the test group reviewed transcripts 23 minutes quicker than the comparison group (a 32% time saving)."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].upstream_sources":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"strategic_assessments[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"strategic assessments"},"summary":{"state":"value_present","value":{"kind":"record_fields","fields":{"summary":"In Home Office pilots in 2024, decision-makers using the Asylum Case Summarisation tool reviewed interview transcripts 23 minutes quicker per case than a comparison group, a 32% time saving.","account":"The Home Office is trialing the Asylum Case Summarisation tool, which uses a large language model to summarize asylum interview transcripts of 50 pages or more. Its own analysts evaluated two pilots in two Decision Making Units and published on 29 April 2025. The first pilot ran from May to June 2024 with 60 decision-makers in the test group and 15 in a comparison group. The second ran from September to October 2024 with 45 and 15. Participants logged their time on 334 test-group cases and 95 comparison-group cases. On average, the test group reviewed transcripts 23 minutes quicker than the comparison group, a 32% time saving. A dip-sample checked with the Calibre quality tool showed similar decision quality in both groups. Technical specialists checked every summary before use and removed 9% as inaccurate or incomplete. Of the users surveyed, 23% were not fully confident in the summaries and 65% would keep using the tool. The evaluators write that the pilots were small, the units were not representative and all measures were self-reported."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["summary","account"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].autonomy_permissions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].component_role":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].deployment_configuration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].inputs_outputs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_name":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].product_name":{"state":"value_present","value":{"kind":"record_fields","fields":{"system":"Asylum Case Summarisation (ACS) tool"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["system"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].provider":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"taxonomy_crosswalks[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"title":{"state":"value_present","value":{"kind":"record_fields","fields":{"title":"The Home Office's evaluation of its Asylum Case Summarisation tool finds that decision-makers reviewed transcripts 23 minutes faster per case","headline":"*Asylum Case Summarisation* cuts transcript review by 23 minutes"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["title","headline"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"version":{"state":"value_present","value":{"kind":"identifiers","identifiers":["0b723922b344b0d1c2b027d3918e9b5a0a2b0f377be398ecc3016884fc52ef38"],"role":"SHA-256 of the complete public record and its assessments"},"provenance":{"kind":"curatorial","basis":"SHA-256 of the public record, its assessments, and its displayed answers and notes, excluding its own identifier and the derived coverage summary.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"workflow":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"The Home Office is trialing the Asylum Case Summarisation tool, which uses a large language model to summarize asylum interview transcripts of 50 pages or more. Its own analysts evaluated two pilots in two Decision Making Units and published on 29 April 2025. The first pilot ran from May to June 2024 with 60 decision-makers in the test group and 15 in a comparison group. The second ran from September to October 2024 with 45 and 15. Participants logged their time on 334 test-group cases and 95 comparison-group cases. On average, the test group reviewed transcripts 23 minutes quicker than the comparison group, a 32% time saving. A dip-sample checked with the Calibre quality tool showed similar decision quality in both groups. Technical specialists checked every summary before use and removed 9% as inaccurate or incomplete. Of the users surveyed, 23% were not fully confident in the summaries and 65% would keep using the tool. The evaluators write that the pilots were small, the units were not representative and all measures were self-reported.","replication":{"produced_by":["The tool used a large language model to extract and summarize information from asylum interview transcripts.","Technical specialists reviewed every summary before use and removed the 9% that were inaccurate or had missing information.","Decision-makers used the summary as an aid and still worked through the usual decision process."],"must_hold":["Summaries must be checked for accuracy before decision-makers rely on them.","Decision-makers must keep making the decision themselves, with the summary as an aid.","A full rollout needs a larger evaluation, as the pilots were small and the units were not representative."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"}},"summary":{"total":91,"addressed":91,"known":29,"reviewed":2,"reviewed_complete":2,"reviewed_partial":0,"record_mapped":27,"review_not_assessed":62,"not_assessed":0,"complete":false,"by_state":{"value_present":29,"not_reported":0,"unresolved":62,"not_assessed":0,"not_applicable":0,"withheld":0,"source_unavailable":0}}},"presentation_version":"cdf5dae9a4f8abe017bf94dd33acecfd79e1b802ebd23212ff74378549841195"}