{"id":"AIBD-1195","title":"DWP's evaluation of its Microsoft 365 Copilot trial estimates that license holders saved 19 minutes a day on routine tasks against non-users","summary":"DWP's evaluation of its Microsoft 365 Copilot trial estimated that license holders saved an average of 19 minutes a day across eight routine tasks, against a comparison group without licenses.","date_observed":"2025-03-01","date_basis":"event","date_precision":"month","benefit_status":"reported","source_collection":null,"source_entry":null,"account":"The Department for Work and Pensions trialed the licensed version of Microsoft 365 Copilot, a generative AI tool, from October 2024 to March 2025. It allocated 3,549 licenses to central office staff. DWP's own analysts published their evaluation on 29 January 2026. They surveyed all license holders in February 2025, with 1,716 responses, and a stratified random sample of staff without licenses in March 2025, with 2,535 responses. A Seemingly Unrelated Regression compared the two groups on task efficiency, job satisfaction and work quality. With controls for grade, gender, age, job category, health condition and interest in AI, license holders saved an estimated 19 minutes a day across eight routine tasks. The 95% confidence interval was 17 to 22 minutes. The largest savings were 26 minutes on searching for information, 25 minutes on writing emails and 24 minutes on summarizing. Job satisfaction rose by 0.56 points and work quality by 0.49 points on a 7-point scale. The evaluators note that licenses were not allocated at random, that time was self-reported and that there was no pre-trial baseline.","category":"aggregate result","unexpected":false,"purpose":"Microsoft built Microsoft 365 Copilot as a generative AI assistant inside its Microsoft 365 applications, to draft, summarize and search for its users.","system":"Microsoft 365 Copilot","model_version":null,"developer":"Microsoft","deployer":"Department for Work and Pensions (3,549 license holders in central office roles)","location":"United Kingdom","domain":"Public administration","segment":null,"benefit_type":"Reduced Task Time","work_activities":["4.A.1.a.1","4.A.4.a.2","4.A.2.a.2"],"taxonomy_note":null,"registry_ids":{},"ratings":[{"group":"organizational","depth":1,"reason":"Licence holders were estimated to save 19 minutes a day on eight routine tasks, with a 95% confidence interval of 17 to 22 minutes, from self-reported time categories."},{"group":"personal","depth":1,"reason":"Users reported higher job satisfaction, estimated at 0.56 points on a 7-point scale against non-users, and 65% said that they felt more fulfilled at work."}],"ai_role":{"status":"assessed","statement":"The evaluation compared license holders with staff without licenses and controlled for demographic, occupational and AI-interest variables. It credits the 19-minute saving to Copilot. Licenses were not allocated at random, outcomes were self-reported and there was no pre-trial baseline. The document calls Copilot a generative AI tool."},"evidence":[{"kind":"evaluation report","citation":"Arzilli, F., Lynch, C. S. and Page, L., Department for Work and Pensions. An Evaluation of DWP's Microsoft 365 Copilot Trial. Research and analysis, GOV.UK, 29 January 2026.","title":"An Evaluation of DWP's Microsoft 365 Copilot Trial","url":"https://www.gov.uk/government/publications/an-evaluation-of-dwps-microsoft-copilot-365-trial/an-evaluation-of-dwps-microsoft-365-copilot-trial","date":"2026-01-29","written_by":"deployer","quote":"The analysis estimated that users in the treatment group saved an average of 19 minutes per day across eight routine tasks when controlling for all demographic, occupational, and"}],"replication":{"produced_by":["DWP allocated 3,549 Copilot licenses to staff in central office roles through volunteers and peer nominations, in 12 license groups by business area.","Most users learned the tool by trial and error, online resources and peer support, and nearly two-thirds used it daily.","The evaluation compared license holders with a stratified random sample of non-users and controlled for grade, gender, age, job category, health condition and interest in AI."],"must_hold":["Users must still check and edit Copilot's outputs, which they described as a starting point.","Staff need training and role-specific guidance to use the tool well.","The estimate rests on self-reported time and a self-selected treatment group, so it may not hold for the wider workforce."],"echoes":[]},"paired_incident":null,"headline":"*Microsoft 365 Copilot* saves DWP staff 19 minutes a day in a trial","metric":"an average of 19 minutes a day","comparator":{"against":"DWP staff without a Copilot license, a stratified random sample matched on license group and grade","before":null,"after":"an average of over 19 minutes per day saved on routine tasks (95% confidence interval 17 to 22)","basis":"measured","quote":"Copilot users were estimated to save an average of over 19 minutes per day on routine tasks.","url":"https://www.gov.uk/government/publications/an-evaluation-of-dwps-microsoft-copilot-365-trial/an-evaluation-of-dwps-microsoft-365-copilot-trial"},"later":null,"benefit_dimensions":["functional"],"benefit_categories":["operational_improvement"],"scsp_example":"Enhanced productivity","size":{"reach":{"band":3,"fact":"The trial gave Copilot licenses to 3,549 DWP staff.","quote":"The trial ran from October 2024 to March 2025, involved 3,549 members of staff, and aimed to assess Copilot's effectiveness in improving task efficiency, job satisfaction, and quality of work output.","url":"https://www.gov.uk/government/publications/an-evaluation-of-dwps-microsoft-copilot-365-trial/an-evaluation-of-dwps-microsoft-365-copilot-trial","reason":null},"duration":{"band":3,"fact":"License holders had Copilot for the six months of the trial, October 2024 to March 2025.","quote":"The trial ran from October 2024 to March 2025, involved 3,549 members of staff, and aimed to assess Copilot's effectiveness in improving task efficiency, job satisfaction, and quality of work output.","url":"https://www.gov.uk/government/publications/an-evaluation-of-dwps-microsoft-copilot-365-trial/an-evaluation-of-dwps-microsoft-365-copilot-trial","reason":null},"distribution":{"band":2,"fact":"The trial covered central office staff only, and frontline staff such as those in Jobcentres got no access.","quote":"frontline operational colleagues (such as those in Jobcentres) did not receive any access to Microsoft Copilot during this trial.","url":"https://www.gov.uk/government/publications/an-evaluation-of-dwps-microsoft-copilot-365-trial/an-evaluation-of-dwps-microsoft-365-copilot-trial","reason":null},"frequency":{"band":5,"fact":"Of the license holders surveyed, 65% used Copilot daily and another 30% weekly.","quote":"most users (65%) reported daily usage, while an additional 30% indicated weekly usage.","url":"https://www.gov.uk/government/publications/an-evaluation-of-dwps-microsoft-copilot-365-trial/an-evaluation-of-dwps-microsoft-365-copilot-trial","reason":null}},"value":null,"developer_country":"United States","deployer_country":"United Kingdom","unrated_because":null,"brief_notes":null,"brief":null,"revisions":[{"date":"2026-11-01","change":"Added the record from the report of the Department for Work and Pensions.","source":"https://www.gov.uk/government/publications/an-evaluation-of-dwps-microsoft-copilot-365-trial/an-evaluation-of-dwps-microsoft-365-copilot-trial","editor":"AIBD"},{"date":"2026-11-01","change":"Placed the benefit under its broad categories and recorded its reach, duration, distribution and frequency from its sources.","source":null,"editor":"AIBD"}],"confidence":"claimed","shade":"low","claim_status":"The deployer's account","claim_basis":"Sources: the deployer's evaluation report. The cited evidence includes no independent source and no finding by an external body.","case_jurisdictions":["United Kingdom"],"profile":{"case_id":"AIBD-1195","catalog_version":"1.0.0","source_fingerprint":"5412f699060f5c93ec8f2325842b5aa36ceeca2592948a70dda51a9f1614a21d","collection_refs":[{"collection_id":"aibd","version":"2026-10-31"},{"collection_id":"querist","version":"2026-10-25"},{"collection_id":"viator","version":"2026-10-25"}],"source_ids":["AIBD-1195-source-0001"],"families":{"strategic assessments":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"evaluations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"monetary observations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"institutional decisions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]}},"fields":{"actors[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"developer":"Microsoft","deployer":"Department for Work and Pensions (3,549 license holders in central office roles)"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["developer","deployer"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"actors[].ownership_control":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"ai_contribution":{"state":"value_present","value":{"kind":"record_fields","fields":{"ai_role":{"status":"assessed","statement":"The evaluation compared license holders with staff without licenses and controlled for demographic, occupational and AI-interest variables. It credits the 19-minute saving to Copilot. Licenses were not allocated at random, outcomes were self-reported and there was no pre-trial baseline. The document calls Copilot a generative AI tool."}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ai_role"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"ai_relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"category":"aggregate result","ai_role":{"status":"assessed","statement":"The evaluation compared license holders with staff without licenses and controlled for demographic, occupational and AI-interest variables. It credits the 19-minute saving to Copilot. Licenses were not allocated at random, outcomes were self-reported and there was no pre-trial baseline. The document calls Copilot a generative AI tool."}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ai_role","category"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].alternatives":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].assessor_date":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].depth":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":1,"reason":"Licence holders were estimated to save 19 minutes a day on eight routine tasks, with a 95% confidence interval of 17 to 22 minutes, from self-reported time categories."},{"group":"personal","depth":1,"reason":"Users reported higher job satisfaction, estimated at 0.56 points on a 7-point scale against non-users, and 65% said that they felt more fulfilled at work."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].display_confidence":{"state":"value_present","value":{"kind":"structured","data":{"confidence":"low","evidence_word":"claimed","claim_status":"The deployer's account","basis":"Sources: the deployer's evaluation report. The cited evidence includes no independent source and no finding by an external body.","interpretation":"Existing display rule preserved; the richer outcome-specific confidence question still needs review."}},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rationale":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":1,"reason":"Licence holders were estimated to save 19 minutes a day on eight routine tasks, with a 95% confidence interval of 17 to 22 minutes, from self-reported time categories."},{"group":"personal","depth":1,"reason":"Users reported higher job satisfaction, estimated at 0.56 points on a 7-point scale against non-users, and 65% said that they felt more fulfilled at work."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rubric_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].status_basis":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].target":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":1,"reason":"Licence holders were estimated to save 19 minutes a day on eight routine tasks, with a 95% confidence interval of 17 to 22 minutes, from self-reported time categories."},{"group":"personal","depth":1,"reason":"Users reported higher job satisfaction, estimated at 0.56 points on a 7-point scale against non-users, and 65% said that they felt more fulfilled at work."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"availability":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"brief":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_kind":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_links[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_links":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_strength":{"state":"value_present","value":{"kind":"structured","data":{"answer":"The deployer's account. Sources: the deployer's evaluation report. The cited evidence includes no independent source and no finding by an external body.","evidence_word":"claimed","claim_status":"The deployer's account"}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-1195-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"The deployer's account. Sources: the deployer's evaluation report. The cited evidence includes no independent source and no finding by an external body.","inferred":false}},"claims[].missingness":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].proposition":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"cross_border_flows[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"decisions[].action_outcome":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].grounds":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].institution_task":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].success_criterion":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"deployment_stage":{"state":"value_present","value":{"kind":"structured","data":{"classification":"pilot","answer":"The system was used in a pilot. DWP ran the licensed version as a trial with 3,549 licenses from October 2024 to March 2025, and the free version was later rolled out to all staff outside the evaluation.","scope":"The period and activity described in the case."}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["account","evidence"],"source_refs":["AIBD-1195-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"The system was used in a pilot. DWP ran the licensed version as a trial with 3,549 licenses from October 2024 to March 2025, and the free version was later rolled out to all staff outside the evaluation.","inferred":false}},"economics[].amount":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].costs[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].counterfactual":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].currency_price_basis":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].gross_net":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].measure_type":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].period_unit":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].realization":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].recipient_payer":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].return_payback":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].valuation_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"evaluations[].ai_uplift":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].comparator":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].design":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].effect":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].exposure":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].id":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].measurement_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].metric":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].reproduction_materials":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].setting_sample":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].uncertainty_limitations":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"external_references[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"follow_up[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"human_oversight":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"id":{"state":"value_present","value":{"kind":"record_fields","fields":{"id":"AIBD-1195"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["id"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"infrastructure_dependencies[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiaries":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiary_count":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].benefit_type":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_type":"Reduced Task Time"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].claim":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"The Department for Work and Pensions trialed the licensed version of Microsoft 365 Copilot, a generative AI tool, from October 2024 to March 2025. It allocated 3,549 licenses to central office staff. DWP's own analysts published their evaluation on 29 January 2026. They surveyed all license holders in February 2025, with 1,716 responses, and a stratified random sample of staff without licenses in March 2025, with 2,535 responses. A Seemingly Unrelated Regression compared the two groups on task efficiency, job satisfaction and work quality. With controls for grade, gender, age, job category, health condition and interest in AI, license holders saved an estimated 19 minutes a day across eight routine tasks. The 95% confidence interval was 17 to 22 minutes. The largest savings were 26 minutes on searching for information, 25 minutes on writing emails and 24 minutes on summarizing. Job satisfaction rose by 0.56 points and work quality by 0.49 points on a 7-point scale. The evaluators note that licenses were not allocated at random, that time was self-reported and that there was no pre-trial baseline.","benefit_type":"Reduced Task Time"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].distribution":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].duration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].id":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].stakeholder_group":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":1,"reason":"Licence holders were estimated to save 19 minutes a day on eight routine tasks, with a 95% confidence interval of 17 to 22 minutes, from self-reported time categories."},{"group":"personal","depth":1,"reason":"Users reported higher job satisfaction, estimated at 0.56 points on a 7-point scale against non-users, and 65% said that they felt more fulfilled at work."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].status":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_status":"reported"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_status"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].tradeoffs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].unexpected":{"state":"value_present","value":{"kind":"record_fields","fields":{"unexpected":false,"purpose":"Microsoft built Microsoft 365 Copilot as a generative AI assistant inside its Microsoft 365 applications, to draft, summarize and search for its users."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["unexpected","purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"places[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"location":"United Kingdom","developer_country":"United States","deployer_country":"United Kingdom"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["location","developer_country","deployer_country"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"purpose":{"state":"value_present","value":{"kind":"record_fields","fields":{"purpose":"Microsoft built Microsoft 365 Copilot as a generative AI assistant inside its Microsoft 365 applications, to draft, summarize and search for its users."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"record_dates":{"state":"value_present","value":{"kind":"record_fields","fields":{"date_observed":"2025-03-01","date_basis":"event","date_precision":"month","revisions":[{"date":"2026-11-01","change":"Added the record from the report of the Department for Work and Pensions.","source":"https://www.gov.uk/government/publications/an-evaluation-of-dwps-microsoft-copilot-365-trial/an-evaluation-of-dwps-microsoft-365-copilot-trial","editor":"AIBD"},{"date":"2026-11-01","change":"Placed the benefit under its broad categories and recorded its reach, duration, distribution and frequency from its sources.","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["date_observed","date_basis","date_precision","revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"replication.attempts[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"replication.conditions":{"state":"value_present","value":{"kind":"record_fields","fields":{"replication":{"produced_by":["DWP allocated 3,549 Copilot licenses to staff in central office roles through volunteers and peer nominations, in 12 license groups by business area.","Most users learned the tool by trial and error, online resources and peer support, and nearly two-thirds used it daily.","The evaluation compared license holders with a stratified random sample of non-users and controlled for grade, gender, age, job category, health condition and interest in AI."],"must_hold":["Users must still check and edit Copilot's outputs, which they described as a starting point.","Staff need training and role-specific guidance to use the tool well.","The estimate rests on self-reported time and a self-selected treatment group, so it may not hold for the wider workforce."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"revision_history[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"revisions":[{"date":"2026-11-01","change":"Added the record from the report of the Department for Work and Pensions.","source":"https://www.gov.uk/government/publications/an-evaluation-of-dwps-microsoft-copilot-365-trial/an-evaluation-of-dwps-microsoft-365-copilot-trial","editor":"AIBD"},{"date":"2026-11-01","change":"Placed the benefit under its broad categories and recorded its reach, duration, distribution and frequency from its sources.","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sector":{"state":"value_present","value":{"kind":"record_fields","fields":{"domain":"Public administration"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["domain"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].access_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].citation_locator":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"evaluation report","citation":"Arzilli, F., Lynch, C. S. and Page, L., Department for Work and Pensions. An Evaluation of DWP's Microsoft 365 Copilot Trial. Research and analysis, GOV.UK, 29 January 2026.","title":"An Evaluation of DWP's Microsoft 365 Copilot Trial","url":"https://www.gov.uk/government/publications/an-evaluation-of-dwps-microsoft-copilot-365-trial/an-evaluation-of-dwps-microsoft-365-copilot-trial","date":"2026-01-29","written_by":"deployer","quote":"The analysis estimated that users in the treatment group saved an average of 19 minutes per day across eight routine tasks when controlling for all demographic, occupational, and"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].id":{"state":"value_present","value":{"kind":"identifiers","identifiers":["AIBD-1195-source-0001"],"role":"Existing evidence items, in their original order"},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"sources[].language":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"evaluation report","citation":"Arzilli, F., Lynch, C. S. and Page, L., Department for Work and Pensions. An Evaluation of DWP's Microsoft 365 Copilot Trial. Research and analysis, GOV.UK, 29 January 2026.","title":"An Evaluation of DWP's Microsoft 365 Copilot Trial","url":"https://www.gov.uk/government/publications/an-evaluation-of-dwps-microsoft-copilot-365-trial/an-evaluation-of-dwps-microsoft-365-copilot-trial","date":"2026-01-29","written_by":"deployer","quote":"The analysis estimated that users in the treatment group saved an average of 19 minutes per day across eight routine tasks when controlling for all demographic, occupational, and"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].upstream_sources":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"strategic_assessments[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"strategic assessments"},"summary":{"state":"value_present","value":{"kind":"record_fields","fields":{"summary":"DWP's evaluation of its Microsoft 365 Copilot trial estimated that license holders saved an average of 19 minutes a day across eight routine tasks, against a comparison group without licenses.","account":"The Department for Work and Pensions trialed the licensed version of Microsoft 365 Copilot, a generative AI tool, from October 2024 to March 2025. It allocated 3,549 licenses to central office staff. DWP's own analysts published their evaluation on 29 January 2026. They surveyed all license holders in February 2025, with 1,716 responses, and a stratified random sample of staff without licenses in March 2025, with 2,535 responses. A Seemingly Unrelated Regression compared the two groups on task efficiency, job satisfaction and work quality. With controls for grade, gender, age, job category, health condition and interest in AI, license holders saved an estimated 19 minutes a day across eight routine tasks. The 95% confidence interval was 17 to 22 minutes. The largest savings were 26 minutes on searching for information, 25 minutes on writing emails and 24 minutes on summarizing. Job satisfaction rose by 0.56 points and work quality by 0.49 points on a 7-point scale. The evaluators note that licenses were not allocated at random, that time was self-reported and that there was no pre-trial baseline."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["summary","account"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].autonomy_permissions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].component_role":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].deployment_configuration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].inputs_outputs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_name":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].product_name":{"state":"value_present","value":{"kind":"record_fields","fields":{"system":"Microsoft 365 Copilot"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["system"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].provider":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"taxonomy_crosswalks[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"title":{"state":"value_present","value":{"kind":"record_fields","fields":{"title":"DWP's evaluation of its Microsoft 365 Copilot trial estimates that license holders saved 19 minutes a day on routine tasks against non-users","headline":"*Microsoft 365 Copilot* saves DWP staff 19 minutes a day in a trial"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["title","headline"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"version":{"state":"value_present","value":{"kind":"identifiers","identifiers":["eab0bba4f92086fb14c206d4d99fe5580ab7ee1da2705388e3ca4cdd41b39b3f"],"role":"SHA-256 of the complete public record and its assessments"},"provenance":{"kind":"curatorial","basis":"SHA-256 of the public record, its assessments, and its displayed answers and notes, excluding its own identifier and the derived coverage summary.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"workflow":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"The Department for Work and Pensions trialed the licensed version of Microsoft 365 Copilot, a generative AI tool, from October 2024 to March 2025. It allocated 3,549 licenses to central office staff. DWP's own analysts published their evaluation on 29 January 2026. They surveyed all license holders in February 2025, with 1,716 responses, and a stratified random sample of staff without licenses in March 2025, with 2,535 responses. A Seemingly Unrelated Regression compared the two groups on task efficiency, job satisfaction and work quality. With controls for grade, gender, age, job category, health condition and interest in AI, license holders saved an estimated 19 minutes a day across eight routine tasks. The 95% confidence interval was 17 to 22 minutes. The largest savings were 26 minutes on searching for information, 25 minutes on writing emails and 24 minutes on summarizing. Job satisfaction rose by 0.56 points and work quality by 0.49 points on a 7-point scale. The evaluators note that licenses were not allocated at random, that time was self-reported and that there was no pre-trial baseline.","replication":{"produced_by":["DWP allocated 3,549 Copilot licenses to staff in central office roles through volunteers and peer nominations, in 12 license groups by business area.","Most users learned the tool by trial and error, online resources and peer support, and nearly two-thirds used it daily.","The evaluation compared license holders with a stratified random sample of non-users and controlled for grade, gender, age, job category, health condition and interest in AI."],"must_hold":["Users must still check and edit Copilot's outputs, which they described as a starting point.","Staff need training and role-specific guidance to use the tool well.","The estimate rests on self-reported time and a self-selected treatment group, so it may not hold for the wider workforce."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"}},"summary":{"total":91,"addressed":91,"known":29,"reviewed":2,"reviewed_complete":2,"reviewed_partial":0,"record_mapped":27,"review_not_assessed":62,"not_assessed":0,"complete":false,"by_state":{"value_present":29,"not_reported":0,"unresolved":62,"not_assessed":0,"not_applicable":0,"withheld":0,"source_unavailable":0}}},"presentation_version":"85c81096f535d95b72af6a22e09ad65b360706f2746a26fbfdac102f2de04f20"}