{"id":"AIBD-0654","title":"NICE concludes that AI autocontouring is quicker than manual contouring for radiotherapy planning and allows nine systems in the NHS","summary":"NICE reviewed 79 studies and concluded that AI autocontouring with clinician review, by systems such as MVision and Limbus Contour, is likely equivalent to manual contouring and quicker.","date_observed":"2023-09-27","date_basis":"source publication","date_precision":"day","benefit_status":"reported","source_collection":null,"source_entry":null,"account":"Before radiotherapy, staff outline the tumor and nearby organs on scans, a slow manual task called contouring. The National Institute for Health and Care Excellence (NICE) assessed AI software that draws these outlines for a healthcare professional to check and edit. Its external assessment group found 79 studies, 52 of them conference abstracts, and extracted data from 15 priority studies, 8 of them prospective. The evidence showed that AI contours were generally similar to manual ones, with most rated clinically acceptable or needing only minor edits, and that AI contouring was consistently quicker even when review and editing were counted. Reported time savings ranged from 3 to 80 minutes, though some figures left out review time, and clinical experts estimated 10 to 30 minutes. In guidance published on 27 September 2023, the committee concluded that AI autocontouring with review was likely to be clinically equivalent to manual contouring and quicker to do, and it allowed nine systems in the NHS while more evidence is generated. AI outlines of small structures such as the optic nerve and the pituitary gland often needed major edits or were unusable.","category":"general benefit","unexpected":false,"purpose":"The systems were built to draw organ and target outlines for radiotherapy planning so that staff spend less time contouring. The time saving is that purpose.","system":"AI autocontouring software: AI-Rad Companion Organs RT, ART-Plan, DLCExpert, INTContour, Limbus Contour, MIM Contour ProtégéAI, MRCAT Prostate plus Auto-contouring, MVision Segmentation Service and RayStation","model_version":null,"developer":"Siemens Healthineers, TheraPanacea, Mirada Medical, Carina Medical, Limbus AI, MIM Software, Philips, MVision AI and RaySearch","deployer":"Radiotherapy centers in the studies reviewed by NICE; NHS radiotherapy services in England","location":"Multiple countries (studies); England, United Kingdom (guidance)","domain":"Healthcare","segment":null,"benefit_type":"Reduced Task Time","taxonomy_note":null,"registry_ids":{},"ratings":[{"group":"organizational","depth":1,"reason":"Studies reported time savings of 3 to 80 minutes, and experts estimated 10 to 30 minutes, with contours of similar quality."}],"ai_role":{"status":"assessed","statement":"The reviewed studies compared AI contours, after review and edits, with manual contours of the same structures."},"evidence":[{"kind":"regulatory document","citation":"National Institute for Health and Care Excellence. Artificial intelligence (AI) technologies to aid contouring for radiotherapy treatment planning: early value assessment. HealthTech guidance HTG695 (formerly HTE11), section 3: Committee discussion. 27 September 2023.","title":"Artificial intelligence (AI) technologies to aid contouring for radiotherapy treatment planning: committee discussion","url":"https://www.nice.org.uk/guidance/htg695/chapter/3-Committee-discussion","date":"2023-09-27","written_by":"independent","quote":"The committee concluded that AI autocontouring with healthcare professional review and edits was likely to be clinically equivalent to manual contouring and quicker to do."},{"kind":"regulatory document","citation":"National Institute for Health and Care Excellence. HTG695, section 1: Recommendations. 27 September 2023.","title":"Artificial intelligence (AI) technologies to aid contouring for radiotherapy treatment planning: recommendations","url":"https://www.nice.org.uk/guidance/htg695/chapter/1-Recommendations","date":"2023-09-27","written_by":"independent","quote":"Nine artificial intelligence (AI) technologies can be used in the NHS while more evidence is generated to aid contouring for radiotherapy treatment planning in people having external beam radiotherapy."}],"replication":{"produced_by":["A trained healthcare professional reviewed and edited every AI contour.","The software read standard DICOM images from the planning scan."],"must_hold":["Review and editing stay in place.","Staff keep the contouring skills that they need to judge AI outlines."],"echoes":[]},"paired_incident":null,"headline":"NICE finds AI outlining quicker for radiotherapy planning","metric":"Reported time savings ranged from 3 to 80 minutes","comparator":{"against":"Manual contouring by radiotherapy staff","before":"Manual contouring time","after":"3 to 80 minutes saved in studies; experts estimated 10 to 30 minutes","basis":"measured","quote":"The clinical evidence reported time savings ranging from 3 minutes to 80 minutes, but the EAG advised that these savings did not always include the time for healthcare professional review and edits. The clinical experts estimated time saving of 10 minutes to 30 minutes depending on the amount of editing needed.","url":"https://www.nice.org.uk/guidance/htg695/chapter/3-Committee-discussion"},"later":null,"value":null,"developer_country":"Multiple: Germany, France, United Kingdom, United States, Canada, Netherlands, Finland, Sweden","deployer_country":"Multiple","unrated_because":null,"brief_notes":null,"brief":null,"revisions":[{"date":"2026-10-29","change":"Added the case.","source":"https://www.nice.org.uk/guidance/htg695/chapter/3-Committee-discussion","editor":"AIBD"}],"confidence":"found","shade":"high","claim_status":"Found by a regulator","claim_basis":"Sources: two independent regulatory documents. The cited evidence includes no independent study or report.","case_jurisdictions":["United Kingdom"],"profile":{"case_id":"AIBD-0654","catalog_version":"1.0.0","source_fingerprint":"0c8eb9b9949d603bf5bdfbc66f6ac7ec11f6477637332270ab70c7e6d37699da","collection_refs":[{"collection_id":"aibd","version":"2026-10-29"},{"collection_id":"querist","version":"2026-10-25"}],"source_ids":["AIBD-0654-source-0001","AIBD-0654-source-0002"],"families":{"strategic assessments":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"evaluations":{"state":"value_present","value":{"kind":"identifiers","identifiers":["AIBD-0654-evaluation-1"],"role":"Evaluations of the benefit"},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":[],"source_refs":["AIBD-0654-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"partial","record_ids":["AIBD-0654-evaluation-1"]},"monetary observations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"institutional decisions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]}},"fields":{"actors[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"developer":"Siemens Healthineers, TheraPanacea, Mirada Medical, Carina Medical, Limbus AI, MIM Software, Philips, MVision AI and RaySearch","deployer":"Radiotherapy centers in the studies reviewed by NICE; NHS radiotherapy services in England"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["developer","deployer"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"actors[].ownership_control":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"ai_contribution":{"state":"value_present","value":{"kind":"record_fields","fields":{"ai_role":{"status":"assessed","statement":"The reviewed studies compared AI contours, after review and edits, with manual contours of the same structures."}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ai_role"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"ai_relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"category":"general benefit","ai_role":{"status":"assessed","statement":"The reviewed studies compared AI contours, after review and edits, with manual contours of the same structures."}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ai_role","category"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].alternatives":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].assessor_date":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].depth":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":1,"reason":"Studies reported time savings of 3 to 80 minutes, and experts estimated 10 to 30 minutes, with contours of similar quality."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].display_confidence":{"state":"value_present","value":{"kind":"structured","data":{"confidence":"high","evidence_word":"found","claim_status":"Found by a regulator","basis":"Sources: two independent regulatory documents. The cited evidence includes no independent study or report.","interpretation":"Existing display rule preserved; the richer outcome-specific confidence question still needs review."}},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rationale":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":1,"reason":"Studies reported time savings of 3 to 80 minutes, and experts estimated 10 to 30 minutes, with contours of similar quality."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rubric_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].status_basis":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].target":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":1,"reason":"Studies reported time savings of 3 to 80 minutes, and experts estimated 10 to 30 minutes, with contours of similar quality."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"availability":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"brief":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_kind":{"state":"value_present","value":{"kind":"structured","data":{"classification":"evaluation or study","answer":"The case describes an evaluation or a study. A health technology assessment of many studies.","scope":"The period and activity described in the case."}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["account","evidence"],"source_refs":["AIBD-0654-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"The case describes an evaluation or a study. A health technology assessment of many studies.","inferred":false}},"case_links[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Compared with the incidents in the AI Incident Database snapshot of 26 October 2026.","record_fields":["paired_incident"],"source_refs":[]},"reason":"No incident in the AI Incident Database snapshot of 26 October 2026 concerns the same kind of system harming the same kind of stakeholder.","review_state":"reviewed","coverage":"partial"},"claims[].evidence_links":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_strength":{"state":"value_present","value":{"kind":"structured","data":{"answer":"Found by a regulator. Sources: two independent regulatory documents. The cited evidence includes no independent study or report.","evidence_word":"found","claim_status":"Found by a regulator"}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0654-source-0001","AIBD-0654-source-0002"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Found by a regulator. Sources: two independent regulatory documents. The cited evidence includes no independent study or report.","inferred":false}},"claims[].missingness":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].proposition":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"cross_border_flows[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"decisions[].action_outcome":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].grounds":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].institution_task":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].success_criterion":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"deployment_stage":{"state":"value_present","value":{"kind":"structured","data":{"classification":"routine use","answer":"The system was in routine use. Prospective studies used the software in clinical planning, and NICE allows NHS use during evidence generation.","scope":"The period and activity described in the case."}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["account","evidence"],"source_refs":["AIBD-0654-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"The system was in routine use. Prospective studies used the software in clinical planning, and NICE allows NHS use during evidence generation.","inferred":false}},"economics[].amount":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].costs[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].counterfactual":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].currency_price_basis":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].gross_net":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].measure_type":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].period_unit":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].realization":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].recipient_payer":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].return_payback":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].valuation_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"evaluations[].ai_uplift":{"state":"value_present","value":{"kind":"text","text":"3 to 80 minutes saved."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0654-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"3 to 80 minutes saved.","inferred":false}},"evaluations[].comparator":{"state":"value_present","value":{"kind":"text","text":"Manual contouring."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0654-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Manual contouring.","inferred":false}},"evaluations[].design":{"state":"value_present","value":{"kind":"text","text":"Controlled observational."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0654-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Controlled observational.","inferred":false}},"evaluations[].effect":{"state":"value_present","value":{"kind":"text","text":"AI contouring consistently quicker; contours generally similar."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0654-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"AI contouring consistently quicker; contours generally similar.","inferred":false}},"evaluations[].exposure":{"state":"value_present","value":{"kind":"text","text":"Radiotherapy plans contoured with AI and reviewed by staff."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0654-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Radiotherapy plans contoured with AI and reviewed by staff.","inferred":false}},"evaluations[].id":{"state":"value_present","value":{"kind":"identifiers","identifiers":["AIBD-0654-evaluation-1"],"role":"Evaluations of the benefit"},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0654-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Controlled observational.","inferred":false}},"evaluations[].measurement_method":{"state":"value_present","value":{"kind":"text","text":"Review of contour quality ratings and contouring time with AI and with manual methods."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0654-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Review of contour quality ratings and contouring time with AI and with manual methods.","inferred":false}},"evaluations[].metric":{"state":"value_present","value":{"kind":"text","text":"Contouring time; clinical acceptability of contours."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0654-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Contouring time; clinical acceptability of contours.","inferred":false}},"evaluations[].reproduction_materials":{"state":"value_present","value":{"kind":"text","text":"External assessment group report on the NICE website."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0654-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"External assessment group report on the NICE website.","inferred":false}},"evaluations[].setting_sample":{"state":"value_present","value":{"kind":"text","text":"79 studies; data extracted from 15 priority studies, 8 prospective."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0654-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"79 studies; data extracted from 15 priority studies, 8 prospective.","inferred":false}},"evaluations[].uncertainty_limitations":{"state":"value_present","value":{"kind":"text","text":"Some time savings excluded review time; small structures often needed major edits; limited cost evidence."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0654-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Some time savings excluded review time; small structures often needed major edits; limited cost evidence.","inferred":false}},"external_references[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"follow_up[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"human_oversight":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"id":{"state":"value_present","value":{"kind":"record_fields","fields":{"id":"AIBD-0654"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["id"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"infrastructure_dependencies[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiaries":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiary_count":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].benefit_type":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_type":"Reduced Task Time"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].claim":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"Before radiotherapy, staff outline the tumor and nearby organs on scans, a slow manual task called contouring. The National Institute for Health and Care Excellence (NICE) assessed AI software that draws these outlines for a healthcare professional to check and edit. Its external assessment group found 79 studies, 52 of them conference abstracts, and extracted data from 15 priority studies, 8 of them prospective. The evidence showed that AI contours were generally similar to manual ones, with most rated clinically acceptable or needing only minor edits, and that AI contouring was consistently quicker even when review and editing were counted. Reported time savings ranged from 3 to 80 minutes, though some figures left out review time, and clinical experts estimated 10 to 30 minutes. In guidance published on 27 September 2023, the committee concluded that AI autocontouring with review was likely to be clinically equivalent to manual contouring and quicker to do, and it allowed nine systems in the NHS while more evidence is generated. AI outlines of small structures such as the optic nerve and the pituitary gland often needed major edits or were unusable.","benefit_type":"Reduced Task Time"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].distribution":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].duration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].id":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].stakeholder_group":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":1,"reason":"Studies reported time savings of 3 to 80 minutes, and experts estimated 10 to 30 minutes, with contours of similar quality."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].status":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_status":"reported"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_status"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].tradeoffs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].unexpected":{"state":"value_present","value":{"kind":"record_fields","fields":{"unexpected":false,"purpose":"The systems were built to draw organ and target outlines for radiotherapy planning so that staff spend less time contouring. The time saving is that purpose."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["unexpected","purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"places[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"location":"Multiple countries (studies); England, United Kingdom (guidance)","developer_country":"Multiple: Germany, France, United Kingdom, United States, Canada, Netherlands, Finland, Sweden","deployer_country":"Multiple"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["location","developer_country","deployer_country"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"purpose":{"state":"value_present","value":{"kind":"record_fields","fields":{"purpose":"The systems were built to draw organ and target outlines for radiotherapy planning so that staff spend less time contouring. The time saving is that purpose."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"record_dates":{"state":"value_present","value":{"kind":"record_fields","fields":{"date_observed":"2023-09-27","date_basis":"source publication","date_precision":"day","revisions":[{"date":"2026-10-29","change":"Added the case.","source":"https://www.nice.org.uk/guidance/htg695/chapter/3-Committee-discussion","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["date_observed","date_basis","date_precision","revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"replication.attempts[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"replication.conditions":{"state":"value_present","value":{"kind":"record_fields","fields":{"replication":{"produced_by":["A trained healthcare professional reviewed and edited every AI contour.","The software read standard DICOM images from the planning scan."],"must_hold":["Review and editing stay in place.","Staff keep the contouring skills that they need to judge AI outlines."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"revision_history[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"revisions":[{"date":"2026-10-29","change":"Added the case.","source":"https://www.nice.org.uk/guidance/htg695/chapter/3-Committee-discussion","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sector":{"state":"value_present","value":{"kind":"record_fields","fields":{"domain":"Healthcare"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["domain"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].access_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].citation_locator":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"regulatory document","citation":"National Institute for Health and Care Excellence. Artificial intelligence (AI) technologies to aid contouring for radiotherapy treatment planning: early value assessment. HealthTech guidance HTG695 (formerly HTE11), section 3: Committee discussion. 27 September 2023.","title":"Artificial intelligence (AI) technologies to aid contouring for radiotherapy treatment planning: committee discussion","url":"https://www.nice.org.uk/guidance/htg695/chapter/3-Committee-discussion","date":"2023-09-27","written_by":"independent","quote":"The committee concluded that AI autocontouring with healthcare professional review and edits was likely to be clinically equivalent to manual contouring and quicker to do."},{"kind":"regulatory document","citation":"National Institute for Health and Care Excellence. HTG695, section 1: Recommendations. 27 September 2023.","title":"Artificial intelligence (AI) technologies to aid contouring for radiotherapy treatment planning: recommendations","url":"https://www.nice.org.uk/guidance/htg695/chapter/1-Recommendations","date":"2023-09-27","written_by":"independent","quote":"Nine artificial intelligence (AI) technologies can be used in the NHS while more evidence is generated to aid contouring for radiotherapy treatment planning in people having external beam radiotherapy."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].id":{"state":"value_present","value":{"kind":"identifiers","identifiers":["AIBD-0654-source-0001","AIBD-0654-source-0002"],"role":"Existing evidence items, in their original order"},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"sources[].language":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"regulatory document","citation":"National Institute for Health and Care Excellence. Artificial intelligence (AI) technologies to aid contouring for radiotherapy treatment planning: early value assessment. HealthTech guidance HTG695 (formerly HTE11), section 3: Committee discussion. 27 September 2023.","title":"Artificial intelligence (AI) technologies to aid contouring for radiotherapy treatment planning: committee discussion","url":"https://www.nice.org.uk/guidance/htg695/chapter/3-Committee-discussion","date":"2023-09-27","written_by":"independent","quote":"The committee concluded that AI autocontouring with healthcare professional review and edits was likely to be clinically equivalent to manual contouring and quicker to do."},{"kind":"regulatory document","citation":"National Institute for Health and Care Excellence. HTG695, section 1: Recommendations. 27 September 2023.","title":"Artificial intelligence (AI) technologies to aid contouring for radiotherapy treatment planning: recommendations","url":"https://www.nice.org.uk/guidance/htg695/chapter/1-Recommendations","date":"2023-09-27","written_by":"independent","quote":"Nine artificial intelligence (AI) technologies can be used in the NHS while more evidence is generated to aid contouring for radiotherapy treatment planning in people having external beam radiotherapy."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].upstream_sources":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"strategic_assessments[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"strategic assessments"},"summary":{"state":"value_present","value":{"kind":"record_fields","fields":{"summary":"NICE reviewed 79 studies and concluded that AI autocontouring with clinician review, by systems such as MVision and Limbus Contour, is likely equivalent to manual contouring and quicker.","account":"Before radiotherapy, staff outline the tumor and nearby organs on scans, a slow manual task called contouring. The National Institute for Health and Care Excellence (NICE) assessed AI software that draws these outlines for a healthcare professional to check and edit. Its external assessment group found 79 studies, 52 of them conference abstracts, and extracted data from 15 priority studies, 8 of them prospective. The evidence showed that AI contours were generally similar to manual ones, with most rated clinically acceptable or needing only minor edits, and that AI contouring was consistently quicker even when review and editing were counted. Reported time savings ranged from 3 to 80 minutes, though some figures left out review time, and clinical experts estimated 10 to 30 minutes. In guidance published on 27 September 2023, the committee concluded that AI autocontouring with review was likely to be clinically equivalent to manual contouring and quicker to do, and it allowed nine systems in the NHS while more evidence is generated. AI outlines of small structures such as the optic nerve and the pituitary gland often needed major edits or were unusable."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["summary","account"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].autonomy_permissions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].component_role":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].deployment_configuration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].inputs_outputs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_name":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].product_name":{"state":"value_present","value":{"kind":"record_fields","fields":{"system":"AI autocontouring software: AI-Rad Companion Organs RT, ART-Plan, DLCExpert, INTContour, Limbus Contour, MIM Contour ProtégéAI, MRCAT Prostate plus Auto-contouring, MVision Segmentation Service and RayStation"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["system"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].provider":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"taxonomy_crosswalks[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"title":{"state":"value_present","value":{"kind":"record_fields","fields":{"title":"NICE concludes that AI autocontouring is quicker than manual contouring for radiotherapy planning and allows nine systems in the NHS","headline":"NICE finds AI outlining quicker for radiotherapy planning"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["title","headline"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"version":{"state":"value_present","value":{"kind":"identifiers","identifiers":["5385144e1bf3c78419f426b4af391c0712d759bff2f3321e9878b741e434b47c"],"role":"SHA-256 of the complete public case and its assessments"},"provenance":{"kind":"curatorial","basis":"SHA-256 of the public case, its assessments, and its displayed answers and notes, excluding its own identifier and the derived coverage summary.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"workflow":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"Before radiotherapy, staff outline the tumor and nearby organs on scans, a slow manual task called contouring. The National Institute for Health and Care Excellence (NICE) assessed AI software that draws these outlines for a healthcare professional to check and edit. Its external assessment group found 79 studies, 52 of them conference abstracts, and extracted data from 15 priority studies, 8 of them prospective. The evidence showed that AI contours were generally similar to manual ones, with most rated clinically acceptable or needing only minor edits, and that AI contouring was consistently quicker even when review and editing were counted. Reported time savings ranged from 3 to 80 minutes, though some figures left out review time, and clinical experts estimated 10 to 30 minutes. In guidance published on 27 September 2023, the committee concluded that AI autocontouring with review was likely to be clinically equivalent to manual contouring and quicker to do, and it allowed nine systems in the NHS while more evidence is generated. AI outlines of small structures such as the optic nerve and the pituitary gland often needed major edits or were unusable.","replication":{"produced_by":["A trained healthcare professional reviewed and edited every AI contour.","The software read standard DICOM images from the planning scan."],"must_hold":["Review and editing stay in place.","Staff keep the contouring skills that they need to judge AI outlines."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"}},"summary":{"total":91,"addressed":91,"known":41,"reviewed":15,"reviewed_complete":14,"reviewed_partial":1,"record_mapped":27,"review_not_assessed":49,"not_assessed":0,"complete":false,"by_state":{"value_present":41,"not_reported":0,"unresolved":50,"not_assessed":0,"not_applicable":0,"withheld":0,"source_unavailable":0}}},"presentation_version":"c240cb42d29e976e6fef56742c06cc787ffed826236fefbed83a524495075491"}