{"id":"AIBD-1194","title":"The Home Office's evaluation of its Asylum Policy Search tool finds that decision-makers saved 37 minutes per case on country policy research","summary":"In a Home Office pilot from October to December 2024, decision-makers using the Asylum Policy Search tool saved an average of 37 minutes per case on country policy research.","date_observed":"2024-12-01","date_basis":"event","date_precision":"month","benefit_status":"reported","source_collection":null,"source_entry":null,"account":"The Home Office is trialing the Asylum Policy Search tool, a chat-based AI search assistant. It finds and summarizes the Country Policy Information Notes and Country of Origin Information Requests relevant to a case, and decision-makers must still read the full note before deciding. The department's own analysts evaluated a pilot in two Decision Making Units from October to December 2024, with 50 decision-makers in the test group and 30 in a comparison group. Participants logged their time on 270 test-group cases and 214 comparison-group cases. Those using the tool saved an average of 37 minutes per case on country policy research, about 12 minutes before interview and about 25 minutes at decision writing. A dip-sample checked with the Calibre quality tool found similar decision quality in both groups. In a survey of 39 users, 79% were confident in the tool's accuracy and 54% would keep using it. The evaluation does not say what model the tool uses. The evaluators write that the pilot was small, the units were not representative and all measures were self-reported.","category":"aggregate result","unexpected":false,"purpose":"The Home Office introduced the Asylum Policy Search tool, a chat-based AI search assistant, to find and summarize the country policy information that decision-makers need for a case.","system":"Asylum Policy Search (APS) tool","model_version":null,"developer":"Home Office (the evaluation names no outside supplier)","deployer":"Home Office asylum decision-makers in two Decision Making Units","location":"United Kingdom","domain":"Asylum and immigration administration","segment":null,"benefit_type":"Reduced Task Time","work_activities":["4.A.1.a.1","4.A.2.a.2"],"taxonomy_note":null,"registry_ids":{},"ratings":[{"group":"organizational","depth":1,"reason":"Decision-makers using the tool saved an average of 37 minutes per case on country policy research against the comparison group, with no change in decision quality in a dip-sample. The pilot was small and times were self-logged."}],"ai_role":{"status":"assessed","statement":"The evaluation compared decision-makers using the tool with a comparison group without it, and it credits the 37-minute difference to the tool. The groups were not randomly assigned, times were self-logged and the pilot was small. The document calls the tool an AI search assistant that finds and summarizes policy notes, and it does not name the model behind it."},"evidence":[{"kind":"evaluation report","citation":"Home Office. Evaluation of AI trials in the asylum decision making process. Research and analysis, GOV.UK, 29 April 2025.","title":"Evaluation of AI trials in the asylum decision making process","url":"https://www.gov.uk/government/publications/evaluation-of-ai-trials-in-the-asylum-decision-making-process/evaluation-of-ai-trials-in-the-asylum-decision-making-process","date":"2025-04-29","written_by":"deployer","quote":"Those in the test group saved on average 37 minutes per case, researching country policy information compared to the comparison group."}],"replication":{"produced_by":["The tool found and summarized Country Policy Information Notes and Country of Origin Information Requests through a chat interface.","Decision-makers had to open the full note or request before deciding, by design.","For 82% of queries, users reported that the tool gave sufficient information and references."],"must_hold":["Decision-makers must keep reading the full policy documents, as the tool's limits were set to protect their autonomy.","A full rollout needs a larger evaluation and continued monitoring of the tool's accuracy."],"echoes":[]},"paired_incident":null,"headline":"*Asylum Policy Search* saves decision-makers 37 minutes a case","metric":"37 minutes per case","comparator":{"against":"A comparison group of 30 decision-makers in the same units who researched country policy information without the tool","before":null,"after":"37 minutes saved per case (approximately 12 minutes at pre-interview stage and approximately 25 minutes at decision-writing stage)","basis":"measured","quote":"Those in the test group saved on average 37 minutes per case, researching country policy information compared to the comparison group.","url":"https://www.gov.uk/government/publications/evaluation-of-ai-trials-in-the-asylum-decision-making-process/evaluation-of-ai-trials-in-the-asylum-decision-making-process"},"later":null,"benefit_dimensions":["functional","societal"],"benefit_categories":["operational_improvement"],"scsp_example":"Faster data management, decision-making","size":{"reach":{"band":2,"fact":"Fifty decision-makers used the tool in the pilot, against 30 who worked without it.","quote":"The pilot was undertaken between October and December 2024, with 50 decision-makers in the test group and 30 decision-makers in the comparison group.","url":"https://www.gov.uk/government/publications/evaluation-of-ai-trials-in-the-asylum-decision-making-process/evaluation-of-ai-trials-in-the-asylum-decision-making-process","reason":null},"duration":{"band":3,"fact":"The pilot ran from October to December 2024, a few months.","quote":"The pilot was undertaken between October and December 2024, with 50 decision-makers in the test group and 30 decision-makers in the comparison group.","url":"https://www.gov.uk/government/publications/evaluation-of-ai-trials-in-the-asylum-decision-making-process/evaluation-of-ai-trials-in-the-asylum-decision-making-process","reason":null},"distribution":{"band":null,"fact":null,"quote":null,"url":null,"reason":"The evaluation finds similar decisions across nationalities but does not compare the time saving across groups of staff or applicants."},"frequency":{"band":null,"fact":null,"quote":null,"url":null,"reason":"The evaluation logs 270 asylum claims worked with the tool but does not say how often each decision-maker used it."}},"value":null,"developer_country":"United Kingdom","deployer_country":"United Kingdom","unrated_because":null,"brief_notes":null,"brief":null,"revisions":[{"date":"2026-11-01","change":"Added the record from the report of the Home Office.","source":"https://www.gov.uk/government/publications/evaluation-of-ai-trials-in-the-asylum-decision-making-process/evaluation-of-ai-trials-in-the-asylum-decision-making-process","editor":"AIBD"},{"date":"2026-11-01","change":"Placed the benefit under its broad categories and recorded its reach, duration, distribution and frequency from its sources.","source":null,"editor":"AIBD"}],"confidence":"claimed","shade":"low","claim_status":"The deployer's account","claim_basis":"Sources: the deployer's evaluation report. The cited evidence includes no independent source and no finding by an external body.","case_jurisdictions":["United Kingdom"],"profile":{"case_id":"AIBD-1194","catalog_version":"1.0.0","source_fingerprint":"79e56c8845f278dea1586c2a2d7c0cae54a9e6cd9b186eba14f347033d878f73","collection_refs":[{"collection_id":"aibd","version":"2026-10-31"},{"collection_id":"querist","version":"2026-10-25"}],"source_ids":["AIBD-1194-source-0001"],"families":{"strategic assessments":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"evaluations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"monetary observations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"institutional decisions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]}},"fields":{"actors[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"developer":"Home Office (the evaluation names no outside supplier)","deployer":"Home Office asylum decision-makers in two Decision Making Units"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["developer","deployer"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"actors[].ownership_control":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"ai_contribution":{"state":"value_present","value":{"kind":"record_fields","fields":{"ai_role":{"status":"assessed","statement":"The evaluation compared decision-makers using the tool with a comparison group without it, and it credits the 37-minute difference to the tool. The groups were not randomly assigned, times were self-logged and the pilot was small. The document calls the tool an AI search assistant that finds and summarizes policy notes, and it does not name the model behind it."}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ai_role"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"ai_relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"category":"aggregate result","ai_role":{"status":"assessed","statement":"The evaluation compared decision-makers using the tool with a comparison group without it, and it credits the 37-minute difference to the tool. The groups were not randomly assigned, times were self-logged and the pilot was small. The document calls the tool an AI search assistant that finds and summarizes policy notes, and it does not name the model behind it."}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ai_role","category"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].alternatives":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].assessor_date":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].depth":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":1,"reason":"Decision-makers using the tool saved an average of 37 minutes per case on country policy research against the comparison group, with no change in decision quality in a dip-sample. The pilot was small and times were self-logged."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].display_confidence":{"state":"value_present","value":{"kind":"structured","data":{"confidence":"low","evidence_word":"claimed","claim_status":"The deployer's account","basis":"Sources: the deployer's evaluation report. The cited evidence includes no independent source and no finding by an external body.","interpretation":"Existing display rule preserved; the richer outcome-specific confidence question still needs review."}},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rationale":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":1,"reason":"Decision-makers using the tool saved an average of 37 minutes per case on country policy research against the comparison group, with no change in decision quality in a dip-sample. The pilot was small and times were self-logged."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rubric_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].status_basis":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].target":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":1,"reason":"Decision-makers using the tool saved an average of 37 minutes per case on country policy research against the comparison group, with no change in decision quality in a dip-sample. The pilot was small and times were self-logged."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"availability":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"brief":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_kind":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_links[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_links":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_strength":{"state":"value_present","value":{"kind":"structured","data":{"answer":"The deployer's account. Sources: the deployer's evaluation report. The cited evidence includes no independent source and no finding by an external body.","evidence_word":"claimed","claim_status":"The deployer's account"}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-1194-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"The deployer's account. Sources: the deployer's evaluation report. The cited evidence includes no independent source and no finding by an external body.","inferred":false}},"claims[].missingness":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].proposition":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"cross_border_flows[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"decisions[].action_outcome":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].grounds":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].institution_task":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].success_criterion":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"deployment_stage":{"state":"value_present","value":{"kind":"structured","data":{"classification":"pilot","answer":"The system was used in a pilot. The tool ran in one pilot in two Decision Making Units from October to December 2024, and the evaluators recommend further evaluation before any full rollout.","scope":"The period and activity described in the case."}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["account","evidence"],"source_refs":["AIBD-1194-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"The system was used in a pilot. The tool ran in one pilot in two Decision Making Units from October to December 2024, and the evaluators recommend further evaluation before any full rollout.","inferred":false}},"economics[].amount":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].costs[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].counterfactual":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].currency_price_basis":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].gross_net":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].measure_type":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].period_unit":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].realization":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].recipient_payer":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].return_payback":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].valuation_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"evaluations[].ai_uplift":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].comparator":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].design":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].effect":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].exposure":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].id":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].measurement_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].metric":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].reproduction_materials":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].setting_sample":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].uncertainty_limitations":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"external_references[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"follow_up[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"human_oversight":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"id":{"state":"value_present","value":{"kind":"record_fields","fields":{"id":"AIBD-1194"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["id"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"infrastructure_dependencies[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiaries":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiary_count":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].benefit_type":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_type":"Reduced Task Time"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].claim":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"The Home Office is trialing the Asylum Policy Search tool, a chat-based AI search assistant. It finds and summarizes the Country Policy Information Notes and Country of Origin Information Requests relevant to a case, and decision-makers must still read the full note before deciding. The department's own analysts evaluated a pilot in two Decision Making Units from October to December 2024, with 50 decision-makers in the test group and 30 in a comparison group. Participants logged their time on 270 test-group cases and 214 comparison-group cases. Those using the tool saved an average of 37 minutes per case on country policy research, about 12 minutes before interview and about 25 minutes at decision writing. A dip-sample checked with the Calibre quality tool found similar decision quality in both groups. In a survey of 39 users, 79% were confident in the tool's accuracy and 54% would keep using it. The evaluation does not say what model the tool uses. The evaluators write that the pilot was small, the units were not representative and all measures were self-reported.","benefit_type":"Reduced Task Time"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].distribution":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].duration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].id":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].stakeholder_group":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":1,"reason":"Decision-makers using the tool saved an average of 37 minutes per case on country policy research against the comparison group, with no change in decision quality in a dip-sample. The pilot was small and times were self-logged."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].status":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_status":"reported"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_status"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].tradeoffs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].unexpected":{"state":"value_present","value":{"kind":"record_fields","fields":{"unexpected":false,"purpose":"The Home Office introduced the Asylum Policy Search tool, a chat-based AI search assistant, to find and summarize the country policy information that decision-makers need for a case."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["unexpected","purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"places[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"location":"United Kingdom","developer_country":"United Kingdom","deployer_country":"United Kingdom"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["location","developer_country","deployer_country"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"purpose":{"state":"value_present","value":{"kind":"record_fields","fields":{"purpose":"The Home Office introduced the Asylum Policy Search tool, a chat-based AI search assistant, to find and summarize the country policy information that decision-makers need for a case."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"record_dates":{"state":"value_present","value":{"kind":"record_fields","fields":{"date_observed":"2024-12-01","date_basis":"event","date_precision":"month","revisions":[{"date":"2026-11-01","change":"Added the record from the report of the Home Office.","source":"https://www.gov.uk/government/publications/evaluation-of-ai-trials-in-the-asylum-decision-making-process/evaluation-of-ai-trials-in-the-asylum-decision-making-process","editor":"AIBD"},{"date":"2026-11-01","change":"Placed the benefit under its broad categories and recorded its reach, duration, distribution and frequency from its sources.","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["date_observed","date_basis","date_precision","revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"replication.attempts[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"replication.conditions":{"state":"value_present","value":{"kind":"record_fields","fields":{"replication":{"produced_by":["The tool found and summarized Country Policy Information Notes and Country of Origin Information Requests through a chat interface.","Decision-makers had to open the full note or request before deciding, by design.","For 82% of queries, users reported that the tool gave sufficient information and references."],"must_hold":["Decision-makers must keep reading the full policy documents, as the tool's limits were set to protect their autonomy.","A full rollout needs a larger evaluation and continued monitoring of the tool's accuracy."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"revision_history[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"revisions":[{"date":"2026-11-01","change":"Added the record from the report of the Home Office.","source":"https://www.gov.uk/government/publications/evaluation-of-ai-trials-in-the-asylum-decision-making-process/evaluation-of-ai-trials-in-the-asylum-decision-making-process","editor":"AIBD"},{"date":"2026-11-01","change":"Placed the benefit under its broad categories and recorded its reach, duration, distribution and frequency from its sources.","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sector":{"state":"value_present","value":{"kind":"record_fields","fields":{"domain":"Asylum and immigration administration"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["domain"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].access_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].citation_locator":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"evaluation report","citation":"Home Office. Evaluation of AI trials in the asylum decision making process. Research and analysis, GOV.UK, 29 April 2025.","title":"Evaluation of AI trials in the asylum decision making process","url":"https://www.gov.uk/government/publications/evaluation-of-ai-trials-in-the-asylum-decision-making-process/evaluation-of-ai-trials-in-the-asylum-decision-making-process","date":"2025-04-29","written_by":"deployer","quote":"Those in the test group saved on average 37 minutes per case, researching country policy information compared to the comparison group."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].id":{"state":"value_present","value":{"kind":"identifiers","identifiers":["AIBD-1194-source-0001"],"role":"Existing evidence items, in their original order"},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"sources[].language":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"evaluation report","citation":"Home Office. Evaluation of AI trials in the asylum decision making process. Research and analysis, GOV.UK, 29 April 2025.","title":"Evaluation of AI trials in the asylum decision making process","url":"https://www.gov.uk/government/publications/evaluation-of-ai-trials-in-the-asylum-decision-making-process/evaluation-of-ai-trials-in-the-asylum-decision-making-process","date":"2025-04-29","written_by":"deployer","quote":"Those in the test group saved on average 37 minutes per case, researching country policy information compared to the comparison group."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].upstream_sources":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"strategic_assessments[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"strategic assessments"},"summary":{"state":"value_present","value":{"kind":"record_fields","fields":{"summary":"In a Home Office pilot from October to December 2024, decision-makers using the Asylum Policy Search tool saved an average of 37 minutes per case on country policy research.","account":"The Home Office is trialing the Asylum Policy Search tool, a chat-based AI search assistant. It finds and summarizes the Country Policy Information Notes and Country of Origin Information Requests relevant to a case, and decision-makers must still read the full note before deciding. The department's own analysts evaluated a pilot in two Decision Making Units from October to December 2024, with 50 decision-makers in the test group and 30 in a comparison group. Participants logged their time on 270 test-group cases and 214 comparison-group cases. Those using the tool saved an average of 37 minutes per case on country policy research, about 12 minutes before interview and about 25 minutes at decision writing. A dip-sample checked with the Calibre quality tool found similar decision quality in both groups. In a survey of 39 users, 79% were confident in the tool's accuracy and 54% would keep using it. The evaluation does not say what model the tool uses. The evaluators write that the pilot was small, the units were not representative and all measures were self-reported."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["summary","account"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].autonomy_permissions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].component_role":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].deployment_configuration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].inputs_outputs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_name":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].product_name":{"state":"value_present","value":{"kind":"record_fields","fields":{"system":"Asylum Policy Search (APS) tool"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["system"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].provider":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"taxonomy_crosswalks[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"title":{"state":"value_present","value":{"kind":"record_fields","fields":{"title":"The Home Office's evaluation of its Asylum Policy Search tool finds that decision-makers saved 37 minutes per case on country policy research","headline":"*Asylum Policy Search* saves decision-makers 37 minutes a case"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["title","headline"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"version":{"state":"value_present","value":{"kind":"identifiers","identifiers":["d06ce98a9c2bde236f05f1f6870ad63e62637a2105f788814206430d00c5b743"],"role":"SHA-256 of the complete public record and its assessments"},"provenance":{"kind":"curatorial","basis":"SHA-256 of the public record, its assessments, and its displayed answers and notes, excluding its own identifier and the derived coverage summary.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"workflow":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"The Home Office is trialing the Asylum Policy Search tool, a chat-based AI search assistant. It finds and summarizes the Country Policy Information Notes and Country of Origin Information Requests relevant to a case, and decision-makers must still read the full note before deciding. The department's own analysts evaluated a pilot in two Decision Making Units from October to December 2024, with 50 decision-makers in the test group and 30 in a comparison group. Participants logged their time on 270 test-group cases and 214 comparison-group cases. Those using the tool saved an average of 37 minutes per case on country policy research, about 12 minutes before interview and about 25 minutes at decision writing. A dip-sample checked with the Calibre quality tool found similar decision quality in both groups. In a survey of 39 users, 79% were confident in the tool's accuracy and 54% would keep using it. The evaluation does not say what model the tool uses. The evaluators write that the pilot was small, the units were not representative and all measures were self-reported.","replication":{"produced_by":["The tool found and summarized Country Policy Information Notes and Country of Origin Information Requests through a chat interface.","Decision-makers had to open the full note or request before deciding, by design.","For 82% of queries, users reported that the tool gave sufficient information and references."],"must_hold":["Decision-makers must keep reading the full policy documents, as the tool's limits were set to protect their autonomy.","A full rollout needs a larger evaluation and continued monitoring of the tool's accuracy."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"}},"summary":{"total":91,"addressed":91,"known":29,"reviewed":2,"reviewed_complete":2,"reviewed_partial":0,"record_mapped":27,"review_not_assessed":62,"not_assessed":0,"complete":false,"by_state":{"value_present":29,"not_reported":0,"unresolved":62,"not_assessed":0,"not_applicable":0,"withheld":0,"source_unavailable":0}}},"presentation_version":"569ff98943fdd67387351134bb4528d3e43e79f2e56269bc2267868ec81a05ee"}