{"id":"AIBD-1140","title":"The EU's ECIBC guideline group suggests AI-supported double reading of mammograms, finding that it may detect one more cancer per 1,000 women","summary":"In July 2023, the ECIBC guideline group suggested AI-supported double reading of screening mammograms. It found that AI support may detect one more breast cancer for every 1,000 women screened.","date_observed":"2023-07-01","date_basis":"source publication","date_precision":"month","benefit_status":"mixed","source_collection":null,"source_entry":null,"account":"The Joint Research Centre convenes the guideline group of the European Commission Initiative on Breast Cancer (ECIBC). In July 2023, after updating its evidence review, the group revised its advice on AI in screening. It suggested adding AI support to double reading, in which two readers assess each mammogram, in a conditional recommendation on evidence of very low certainty. It found that AI support may detect one more breast cancer for every 1,000 women screened, with slightly more false positives. Its figures for AI support came from one Stockholm study, which simulated adding three commercial algorithms to radiologists' past readings. Their vendors asked to remain anonymous. Figures without AI came from that study and five others, which tested Transpara, Lunit INSIGHT MMG, Mia and a DeepHealth model. Among members without conflicts of interest, six voted for it, two for either option and two abstained. No study tested the readings in a screening program or followed women over time. The group warned that AI support may raise costs. It also suggested that programs not switch to single reading supported by AI.","category":"aggregate result","unexpected":false,"purpose":"Commercial vendors, including ScreenPoint Medical, Lunit, Kheiron Medical Technologies and DeepHealth, built AI software to score screening mammograms for the suspicion of cancer.","system":"AI support for double reading of screening mammograms: three commercial algorithms kept anonymous in the study behind the estimate, with Transpara, Lunit INSIGHT MMG, Mia and a DeepHealth model in the other studies reviewed","model_version":null,"developer":"Three vendors that asked to remain anonymous in the study behind the estimate, with ScreenPoint Medical (Transpara), Lunit (INSIGHT MMG), Kheiron Medical Technologies (Mia) and DeepHealth in the other studies reviewed","deployer":"Screening services in the studies that the ECIBC guideline group reviewed, with Karolinska University Hospital's archived examinations behind the estimate and organized screening programs in the EU as intended users","location":"European Union (guideline), with the study behind the estimate in Stockholm, Sweden","domain":"Healthcare","segment":null,"benefit_type":"Improved Task Accuracy","work_activities":["4.A.1.b.1"],"taxonomy_note":null,"registry_ids":{},"ratings":[{"group":"organizational","depth":2,"reason":"The group found that double reading with AI support may detect one more breast cancer for every 1,000 women screened, an estimate that rests on a simulation with archived examinations."}],"ai_role":{"status":"assessed","statement":"The group compared double reading with and without AI support. Its figures with AI came from a simulation on archived examinations, and its figures without AI were pooled from six studies. The group advises programs to check vendor data such as the number of images used to train the algorithm, which means that the systems learn from data."},"evidence":[{"kind":"assessment report","citation":"European Commission Initiative on Breast Cancer (ECIBC), Guidelines Development Group, European Commission Joint Research Centre. European guidelines on breast cancer screening and diagnosis, printed overview of the recommendations. Breast cancer screening, 4. Use of artificial intelligence, recommendation 4.2. Issued July 2023.","title":"European guidelines on breast cancer screening and diagnosis","url":"https://cancer-screening-and-care.jrc.ec.europa.eu/en/ecibc/recommendations/print","date":null,"written_by":"independent","quote":"The ECIBC's Guidelines Development Group (GDG) suggests to use double reading (with consensus or arbitration for discordant readings) supported by artificial intelligence (AI) over double reading (with consensus or arbitration for discordant readings) without AI support"},{"kind":"assessment report","citation":"European Commission Initiative on Breast Cancer (ECIBC), Guidelines Development Group. European guidelines on breast cancer screening and diagnosis, 4. Use of artificial intelligence, recommendations 4.1 and 4.2 with their justifications. Issued July 2023. Supporting material: GRADE Evidence-to-Decision Framework for recommendation 4.2 (https://dbep.ec.gdt.evidenceprime.com/profile/PNED9kXB-h0), which cites Salim et al. 2020 for double reading with AI support and pools that study with Dahlblom et al. 2022, Dembrower et al. 2023, Larsen et al. 2022, Marinovich et al. 2023 and Sharma et al. 2023 for double reading without it.","title":"European Breast Cancer Guidelines: 4. Use of artificial intelligence","url":"https://cancer-screening-and-care.jrc.ec.europa.eu/en/ecibc/european-breast-cancer-guidelines?topic=64&usertype=60","date":null,"written_by":"independent","quote":"However, there may be one more breast cancer detected for every 1 000 women screened when double reading is supported by AI, which outweighed the false positives."},{"kind":"peer-reviewed study","citation":"Salim M, Wåhlin E, Dembrower K, Azavedo E, Foukakis T, Liu Y, Smith K, Eklund M, Strand F. External Evaluation of 3 Commercial Artificial Intelligence Algorithms for Independent Assessment of Screening Mammograms. JAMA Oncology 2020;6(10):1581-1588, published online 27 August 2020. doi:10.1001/jamaoncol.2020.3321. Methods and Table 3. Funded by Stockholm County Council. The three developers provided their algorithms with no exchange of funds.","title":"External Evaluation of 3 Commercial Artificial Intelligence Algorithms for Independent Assessment of Screening Mammograms","url":"https://pmc.ncbi.nlm.nih.gov/articles/PMC7453345/","date":"2020-08-27","written_by":"independent","quote":"The vendors asked to remain anonymous, with the possibility for each vendor to later decide to waive anonymity.","supports_benefit":false}],"replication":{"produced_by":["Commercial algorithms scored archived screening mammograms from Karolinska University Hospital for the suspicion of cancer.","The study counted an examination as abnormal when an algorithm or either radiologist flagged it."],"must_hold":["Programs check the legal context and run quality control of the AI system before they adopt it.","Programs can sustain the added cost of AI support."],"echoes":[]},"paired_incident":null,"headline":"EU guideline group backs *AI-supported double reading* of mammograms","metric":"one more breast cancer for every 1,000 women screened","comparator":{"against":"Double reading without AI support, pooled from six studies that the guideline group reviewed","before":null,"after":"one more breast cancer detected for every 1 000 women screened","basis":"measured","quote":"The evidence shows that when using double reading supported by AI, there may be slightly more false positives than double reading without support. However, there may be one more breast cancer detected for every 1 000 women screened when double reading is supported by AI, which outweighed the false positives.","url":"https://cancer-screening-and-care.jrc.ec.europa.eu/en/ecibc/european-breast-cancer-guidelines?topic=64&usertype=60"},"later":null,"value":null,"developer_country":"Multiple: Netherlands, South Korea, United Kingdom, United States","deployer_country":"Multiple","unrated_because":null,"brief_notes":null,"brief":null,"revisions":[{"date":"2026-11-01","change":"Added the record from the finding of the Guidelines Development Group of the European Commission Initiative on Breast Cancer.","source":"https://cancer-screening-and-care.jrc.ec.europa.eu/en/ecibc/recommendations/print","editor":"AIBD"}],"confidence":"found","shade":"high","claim_status":"Found by an assessment body","claim_basis":"Sources: two independent assessment reports and one independent peer-reviewed study. For the benefit itself, the cited sources include no independent study or report.","case_jurisdictions":["Sweden"],"profile":{"case_id":"AIBD-1140","catalog_version":"1.0.0","source_fingerprint":"fd60434af346791fe478b48d8bb0602bbd0531cd44fca52866fb27bbbd132390","collection_refs":[{"collection_id":"aibd","version":"2026-10-31"},{"collection_id":"querist","version":"2026-10-25"}],"source_ids":["AIBD-1140-source-0001","AIBD-1140-source-0002","AIBD-1140-source-0003"],"families":{"strategic assessments":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"evaluations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"monetary observations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"institutional decisions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]}},"fields":{"actors[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"developer":"Three vendors that asked to remain anonymous in the study behind the estimate, with ScreenPoint Medical (Transpara), Lunit (INSIGHT MMG), Kheiron Medical Technologies (Mia) and DeepHealth in the other studies reviewed","deployer":"Screening services in the studies that the ECIBC guideline group reviewed, with Karolinska University Hospital's archived examinations behind the estimate and organized screening programs in the EU as intended users"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["developer","deployer"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"actors[].ownership_control":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"ai_contribution":{"state":"value_present","value":{"kind":"record_fields","fields":{"ai_role":{"status":"assessed","statement":"The group compared double reading with and without AI support. Its figures with AI came from a simulation on archived examinations, and its figures without AI were pooled from six studies. The group advises programs to check vendor data such as the number of images used to train the algorithm, which means that the systems learn from data."}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ai_role"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"ai_relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"category":"aggregate result","ai_role":{"status":"assessed","statement":"The group compared double reading with and without AI support. Its figures with AI came from a simulation on archived examinations, and its figures without AI were pooled from six studies. The group advises programs to check vendor data such as the number of images used to train the algorithm, which means that the systems learn from data."}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ai_role","category"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].alternatives":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].assessor_date":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].depth":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":2,"reason":"The group found that double reading with AI support may detect one more breast cancer for every 1,000 women screened, an estimate that rests on a simulation with archived examinations."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].display_confidence":{"state":"value_present","value":{"kind":"structured","data":{"confidence":"high","evidence_word":"found","claim_status":"Found by an assessment body","basis":"Sources: two independent assessment reports and one independent peer-reviewed study. For the benefit itself, the cited sources include no independent study or report.","interpretation":"Existing display rule preserved; the richer outcome-specific confidence question still needs review."}},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rationale":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":2,"reason":"The group found that double reading with AI support may detect one more breast cancer for every 1,000 women screened, an estimate that rests on a simulation with archived examinations."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rubric_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].status_basis":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].target":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":2,"reason":"The group found that double reading with AI support may detect one more breast cancer for every 1,000 women screened, an estimate that rests on a simulation with archived examinations."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"availability":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"brief":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_kind":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_links[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_links":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_strength":{"state":"value_present","value":{"kind":"structured","data":{"answer":"Found by an assessment body. Sources: two independent assessment reports and one independent peer-reviewed study. For the benefit itself, the cited sources include no independent study or report.","evidence_word":"found","claim_status":"Found by an assessment body"}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-1140-source-0001","AIBD-1140-source-0002","AIBD-1140-source-0003"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Found by an assessment body. Sources: two independent assessment reports and one independent peer-reviewed study. For the benefit itself, the cited sources include no independent study or report.","inferred":false}},"claims[].missingness":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].proposition":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"cross_border_flows[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"decisions[].action_outcome":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].grounds":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].institution_task":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].success_criterion":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"deployment_stage":{"state":"value_present","value":{"kind":"structured","data":{"classification":"simulated","answer":"The benefit was shown in a simulation. The estimate rests on a simulation that combined commercial algorithms with radiologists' past readings, and no study tested AI support in a running screening program.","scope":"The period and activity described in the case."}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["account","evidence"],"source_refs":["AIBD-1140-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"The benefit was shown in a simulation. The estimate rests on a simulation that combined commercial algorithms with radiologists' past readings, and no study tested AI support in a running screening program.","inferred":false}},"economics[].amount":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].costs[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].counterfactual":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].currency_price_basis":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].gross_net":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].measure_type":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].period_unit":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].realization":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].recipient_payer":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].return_payback":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].valuation_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"evaluations[].ai_uplift":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].comparator":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].design":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].effect":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].exposure":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].id":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].measurement_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].metric":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].reproduction_materials":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].setting_sample":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].uncertainty_limitations":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"external_references[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"follow_up[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"human_oversight":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"id":{"state":"value_present","value":{"kind":"record_fields","fields":{"id":"AIBD-1140"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["id"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"infrastructure_dependencies[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiaries":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiary_count":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].benefit_type":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_type":"Improved Task Accuracy"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].claim":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"The Joint Research Centre convenes the guideline group of the European Commission Initiative on Breast Cancer (ECIBC). In July 2023, after updating its evidence review, the group revised its advice on AI in screening. It suggested adding AI support to double reading, in which two readers assess each mammogram, in a conditional recommendation on evidence of very low certainty. It found that AI support may detect one more breast cancer for every 1,000 women screened, with slightly more false positives. Its figures for AI support came from one Stockholm study, which simulated adding three commercial algorithms to radiologists' past readings. Their vendors asked to remain anonymous. Figures without AI came from that study and five others, which tested Transpara, Lunit INSIGHT MMG, Mia and a DeepHealth model. Among members without conflicts of interest, six voted for it, two for either option and two abstained. No study tested the readings in a screening program or followed women over time. The group warned that AI support may raise costs. It also suggested that programs not switch to single reading supported by AI.","benefit_type":"Improved Task Accuracy"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].distribution":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].duration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].id":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].stakeholder_group":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":2,"reason":"The group found that double reading with AI support may detect one more breast cancer for every 1,000 women screened, an estimate that rests on a simulation with archived examinations."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].status":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_status":"mixed"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_status"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].tradeoffs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].unexpected":{"state":"value_present","value":{"kind":"record_fields","fields":{"unexpected":false,"purpose":"Commercial vendors, including ScreenPoint Medical, Lunit, Kheiron Medical Technologies and DeepHealth, built AI software to score screening mammograms for the suspicion of cancer."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["unexpected","purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"places[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"location":"European Union (guideline), with the study behind the estimate in Stockholm, Sweden","developer_country":"Multiple: Netherlands, South Korea, United Kingdom, United States","deployer_country":"Multiple"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["location","developer_country","deployer_country"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"purpose":{"state":"value_present","value":{"kind":"record_fields","fields":{"purpose":"Commercial vendors, including ScreenPoint Medical, Lunit, Kheiron Medical Technologies and DeepHealth, built AI software to score screening mammograms for the suspicion of cancer."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"record_dates":{"state":"value_present","value":{"kind":"record_fields","fields":{"date_observed":"2023-07-01","date_basis":"source publication","date_precision":"month","revisions":[{"date":"2026-11-01","change":"Added the record from the finding of the Guidelines Development Group of the European Commission Initiative on Breast Cancer.","source":"https://cancer-screening-and-care.jrc.ec.europa.eu/en/ecibc/recommendations/print","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["date_observed","date_basis","date_precision","revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"replication.attempts[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"replication.conditions":{"state":"value_present","value":{"kind":"record_fields","fields":{"replication":{"produced_by":["Commercial algorithms scored archived screening mammograms from Karolinska University Hospital for the suspicion of cancer.","The study counted an examination as abnormal when an algorithm or either radiologist flagged it."],"must_hold":["Programs check the legal context and run quality control of the AI system before they adopt it.","Programs can sustain the added cost of AI support."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"revision_history[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"revisions":[{"date":"2026-11-01","change":"Added the record from the finding of the Guidelines Development Group of the European Commission Initiative on Breast Cancer.","source":"https://cancer-screening-and-care.jrc.ec.europa.eu/en/ecibc/recommendations/print","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sector":{"state":"value_present","value":{"kind":"record_fields","fields":{"domain":"Healthcare"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["domain"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].access_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].citation_locator":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"assessment report","citation":"European Commission Initiative on Breast Cancer (ECIBC), Guidelines Development Group, European Commission Joint Research Centre. European guidelines on breast cancer screening and diagnosis, printed overview of the recommendations. Breast cancer screening, 4. Use of artificial intelligence, recommendation 4.2. Issued July 2023.","title":"European guidelines on breast cancer screening and diagnosis","url":"https://cancer-screening-and-care.jrc.ec.europa.eu/en/ecibc/recommendations/print","written_by":"independent","quote":"The ECIBC's Guidelines Development Group (GDG) suggests to use double reading (with consensus or arbitration for discordant readings) supported by artificial intelligence (AI) over double reading (with consensus or arbitration for discordant readings) without AI support"},{"kind":"assessment report","citation":"European Commission Initiative on Breast Cancer (ECIBC), Guidelines Development Group. European guidelines on breast cancer screening and diagnosis, 4. Use of artificial intelligence, recommendations 4.1 and 4.2 with their justifications. Issued July 2023. Supporting material: GRADE Evidence-to-Decision Framework for recommendation 4.2 (https://dbep.ec.gdt.evidenceprime.com/profile/PNED9kXB-h0), which cites Salim et al. 2020 for double reading with AI support and pools that study with Dahlblom et al. 2022, Dembrower et al. 2023, Larsen et al. 2022, Marinovich et al. 2023 and Sharma et al. 2023 for double reading without it.","title":"European Breast Cancer Guidelines: 4. Use of artificial intelligence","url":"https://cancer-screening-and-care.jrc.ec.europa.eu/en/ecibc/european-breast-cancer-guidelines?topic=64&usertype=60","written_by":"independent","quote":"However, there may be one more breast cancer detected for every 1 000 women screened when double reading is supported by AI, which outweighed the false positives."},{"kind":"peer-reviewed study","citation":"Salim M, Wåhlin E, Dembrower K, Azavedo E, Foukakis T, Liu Y, Smith K, Eklund M, Strand F. External Evaluation of 3 Commercial Artificial Intelligence Algorithms for Independent Assessment of Screening Mammograms. JAMA Oncology 2020;6(10):1581-1588, published online 27 August 2020. doi:10.1001/jamaoncol.2020.3321. Methods and Table 3. Funded by Stockholm County Council. The three developers provided their algorithms with no exchange of funds.","title":"External Evaluation of 3 Commercial Artificial Intelligence Algorithms for Independent Assessment of Screening Mammograms","url":"https://pmc.ncbi.nlm.nih.gov/articles/PMC7453345/","date":"2020-08-27","written_by":"independent","quote":"The vendors asked to remain anonymous, with the possibility for each vendor to later decide to waive anonymity.","supports_benefit":false}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].id":{"state":"value_present","value":{"kind":"identifiers","identifiers":["AIBD-1140-source-0001","AIBD-1140-source-0002","AIBD-1140-source-0003"],"role":"Existing evidence items, in their original order"},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"sources[].language":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"assessment report","citation":"European Commission Initiative on Breast Cancer (ECIBC), Guidelines Development Group, European Commission Joint Research Centre. European guidelines on breast cancer screening and diagnosis, printed overview of the recommendations. Breast cancer screening, 4. Use of artificial intelligence, recommendation 4.2. Issued July 2023.","title":"European guidelines on breast cancer screening and diagnosis","url":"https://cancer-screening-and-care.jrc.ec.europa.eu/en/ecibc/recommendations/print","written_by":"independent","quote":"The ECIBC's Guidelines Development Group (GDG) suggests to use double reading (with consensus or arbitration for discordant readings) supported by artificial intelligence (AI) over double reading (with consensus or arbitration for discordant readings) without AI support"},{"kind":"assessment report","citation":"European Commission Initiative on Breast Cancer (ECIBC), Guidelines Development Group. European guidelines on breast cancer screening and diagnosis, 4. Use of artificial intelligence, recommendations 4.1 and 4.2 with their justifications. Issued July 2023. Supporting material: GRADE Evidence-to-Decision Framework for recommendation 4.2 (https://dbep.ec.gdt.evidenceprime.com/profile/PNED9kXB-h0), which cites Salim et al. 2020 for double reading with AI support and pools that study with Dahlblom et al. 2022, Dembrower et al. 2023, Larsen et al. 2022, Marinovich et al. 2023 and Sharma et al. 2023 for double reading without it.","title":"European Breast Cancer Guidelines: 4. Use of artificial intelligence","url":"https://cancer-screening-and-care.jrc.ec.europa.eu/en/ecibc/european-breast-cancer-guidelines?topic=64&usertype=60","written_by":"independent","quote":"However, there may be one more breast cancer detected for every 1 000 women screened when double reading is supported by AI, which outweighed the false positives."},{"kind":"peer-reviewed study","citation":"Salim M, Wåhlin E, Dembrower K, Azavedo E, Foukakis T, Liu Y, Smith K, Eklund M, Strand F. External Evaluation of 3 Commercial Artificial Intelligence Algorithms for Independent Assessment of Screening Mammograms. JAMA Oncology 2020;6(10):1581-1588, published online 27 August 2020. doi:10.1001/jamaoncol.2020.3321. Methods and Table 3. Funded by Stockholm County Council. The three developers provided their algorithms with no exchange of funds.","title":"External Evaluation of 3 Commercial Artificial Intelligence Algorithms for Independent Assessment of Screening Mammograms","url":"https://pmc.ncbi.nlm.nih.gov/articles/PMC7453345/","date":"2020-08-27","written_by":"independent","quote":"The vendors asked to remain anonymous, with the possibility for each vendor to later decide to waive anonymity.","supports_benefit":false}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].upstream_sources":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"strategic_assessments[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"strategic assessments"},"summary":{"state":"value_present","value":{"kind":"record_fields","fields":{"summary":"In July 2023, the ECIBC guideline group suggested AI-supported double reading of screening mammograms. It found that AI support may detect one more breast cancer for every 1,000 women screened.","account":"The Joint Research Centre convenes the guideline group of the European Commission Initiative on Breast Cancer (ECIBC). In July 2023, after updating its evidence review, the group revised its advice on AI in screening. It suggested adding AI support to double reading, in which two readers assess each mammogram, in a conditional recommendation on evidence of very low certainty. It found that AI support may detect one more breast cancer for every 1,000 women screened, with slightly more false positives. Its figures for AI support came from one Stockholm study, which simulated adding three commercial algorithms to radiologists' past readings. Their vendors asked to remain anonymous. Figures without AI came from that study and five others, which tested Transpara, Lunit INSIGHT MMG, Mia and a DeepHealth model. Among members without conflicts of interest, six voted for it, two for either option and two abstained. No study tested the readings in a screening program or followed women over time. The group warned that AI support may raise costs. It also suggested that programs not switch to single reading supported by AI."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["summary","account"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].autonomy_permissions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].component_role":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].deployment_configuration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].inputs_outputs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_name":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].product_name":{"state":"value_present","value":{"kind":"record_fields","fields":{"system":"AI support for double reading of screening mammograms: three commercial algorithms kept anonymous in the study behind the estimate, with Transpara, Lunit INSIGHT MMG, Mia and a DeepHealth model in the other studies reviewed"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["system"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].provider":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"taxonomy_crosswalks[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"title":{"state":"value_present","value":{"kind":"record_fields","fields":{"title":"The EU's ECIBC guideline group suggests AI-supported double reading of mammograms, finding that it may detect one more cancer per 1,000 women","headline":"EU guideline group backs *AI-supported double reading* of mammograms"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["title","headline"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"version":{"state":"value_present","value":{"kind":"identifiers","identifiers":["b7ed43d009edb82234d9acf7a58537825d398027568158eadb9b3698848a4384"],"role":"SHA-256 of the complete public record and its assessments"},"provenance":{"kind":"curatorial","basis":"SHA-256 of the public record, its assessments, and its displayed answers and notes, excluding its own identifier and the derived coverage summary.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"workflow":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"The Joint Research Centre convenes the guideline group of the European Commission Initiative on Breast Cancer (ECIBC). In July 2023, after updating its evidence review, the group revised its advice on AI in screening. It suggested adding AI support to double reading, in which two readers assess each mammogram, in a conditional recommendation on evidence of very low certainty. It found that AI support may detect one more breast cancer for every 1,000 women screened, with slightly more false positives. Its figures for AI support came from one Stockholm study, which simulated adding three commercial algorithms to radiologists' past readings. Their vendors asked to remain anonymous. Figures without AI came from that study and five others, which tested Transpara, Lunit INSIGHT MMG, Mia and a DeepHealth model. Among members without conflicts of interest, six voted for it, two for either option and two abstained. No study tested the readings in a screening program or followed women over time. The group warned that AI support may raise costs. It also suggested that programs not switch to single reading supported by AI.","replication":{"produced_by":["Commercial algorithms scored archived screening mammograms from Karolinska University Hospital for the suspicion of cancer.","The study counted an examination as abnormal when an algorithm or either radiologist flagged it."],"must_hold":["Programs check the legal context and run quality control of the AI system before they adopt it.","Programs can sustain the added cost of AI support."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"}},"summary":{"total":91,"addressed":91,"known":29,"reviewed":2,"reviewed_complete":2,"reviewed_partial":0,"record_mapped":27,"review_not_assessed":62,"not_assessed":0,"complete":false,"by_state":{"value_present":29,"not_reported":0,"unresolved":62,"not_assessed":0,"not_applicable":0,"withheld":0,"source_unavailable":0}}},"presentation_version":"76274df67ced2e0dd9bd3472023b999c634c1030d14c9c1ff345b7090d1b97d6"}