{"id":"AIBD-0643","title":"ScreenTrustCAD at Capio Sankt Göran Hospital, Stockholm: Lunit Insight MMG as a third reader leads to 19 more screen-detected breast cancers than two radiologists","summary":"At Capio Sankt Göran Hospital, Lunit's Insight MMG read 55,581 mammograms beside two radiologists; the three together found 269 cancers against 250 by the radiologists alone.","date_observed":"2022-06-09","date_basis":"event","date_precision":"day","benefit_status":"reported","source_collection":null,"source_entry":null,"account":"Karolinska Institutet researchers ran the ScreenTrustCAD study at Capio Sankt Göran Hospital in Stockholm, Sweden, from 1 April 2021 to 9 June 2022. Lunit's Insight MMG, version 1.1.6, read every screening mammogram in the background as an independent reader beside the usual two radiologists. If any of the three readers flagged an examination, it went to a consensus discussion, where two radiologists saw the AI score and the marked area and decided whether to recall the woman. Among 55,581 women aged 40 to 74, the two radiologists alone would have found 250 cancers. With the AI as a third reader, 269 cancers were found, a relative proportion of 1.08. The study also showed that one radiologist plus AI was non-inferior to two radiologists, with 261 cancers against 250. The study was paired, so every woman was read by every strategy, and it ran at one hospital with one mammography vendor. Lunit was one of the funders; the paper states that the funders had no role in the study.","category":"general benefit","unexpected":false,"purpose":"Insight MMG was built to detect breast cancer on mammograms. In ScreenTrustCAD it served as an independent reader; the extra cancers found were that purpose.","system":"Lunit INSIGHT MMG","model_version":"1.1.6","developer":"Lunit","deployer":"Capio Sankt Göran Hospital with Karolinska Institutet (ScreenTrustCAD study)","location":"Stockholm, Sweden","domain":"Healthcare","segment":null,"benefit_type":"Improved Task Accuracy","taxonomy_note":null,"registry_ids":{},"ratings":[{"group":"personal","depth":4,"reason":"Nineteen women had breast cancer found at screening only because the AI flagged their examinations (269 cancers with AI against 250 without)."}],"ai_role":{"status":"assessed","statement":"In a paired design, every examination was read by two radiologists and by the AI, and the authors counted the cancers found by each reader combination, so the cancers that only the AI flagged are attributable to it."},"evidence":[{"kind":"peer-reviewed study","citation":"Sossavi E, Roy C, Molière S. Artificial intelligence in breast cancer screening: a systematic review and meta-analysis of integration strategies. Eur J Radiol Open. 2026;16:100727. doi:10.1016/j.ejro.2026.100727","title":"Artificial intelligence in breast cancer screening: A systematic review and meta-analysis of integration strategies","url":"https://pmc.ncbi.nlm.nih.gov/articles/PMC12818982/","date":"2026-01-10","written_by":"independent","quote":"Dembrower 2023 AI + R1 + R2 (triple) 4.84 / 4.50 p < 0.0001"},{"kind":"peer-reviewed study","citation":"Ferre R, Benefield T, Kuzmiak CM. Artificial intelligence-supported double reading in European population breast cancer screening: a systematic review and meta-analysis of prospective programs. Clin Imaging. 2026;139:110923. doi:10.1016/j.clinimag.2026.110923","title":"Artificial intelligence-supported double reading in European population breast cancer screening: A systematic review and meta-analysis of prospective programs","url":"https://pubmed.ncbi.nlm.nih.gov/42617468/","date":"2026-08-11","written_by":"independent","quote":"MASAI (randomized AI-supported risk triage within a national program), ScreenTrustCAD (prospective paired-reader evaluation with AI as an independent reader in a double-reading framework), and PRAIM (nationwide decision-referral implementation)"},{"kind":"peer-reviewed study","citation":"Dembrower K, Crippa A, Colón E, Eklund M, Strand F; ScreenTrustCAD Trial Consortium. Artificial intelligence for breast cancer detection in screening mammography in Sweden: a prospective, population-based, paired-reader, non-inferiority study. Lancet Digit Health. 2023;5(10):e703-e711. doi:10.1016/S2589-7500(23)00153-X","title":"Artificial intelligence for breast cancer detection in screening mammography in Sweden: a prospective, population-based, paired-reader, non-inferiority study","url":"https://pubmed.ncbi.nlm.nih.gov/37690911/","date":"2023-09-08","written_by":"makers","quote":"triple reading by two radiologists plus AI (269 [0·5%] vs 250 [0·4%] detected cases; relative proportion 1·08 [1·04-1·11]) were also non-inferior to double reading by two radiologists"},{"kind":"peer-reviewed study","citation":"Dembrower K, et al. Lancet Digit Health. 2023. Full text (archived copy)","title":"Artificial intelligence for breast cancer detection in screening mammography in Sweden (full text)","url":"https://web.archive.org/web/2025/https://www.thelancet.com/journals/landig/article/PIIS2589-7500(23)00153-X/fulltext","date":"2023-09-08","written_by":"makers","quote":"For the reading by AI, the Insight MMG AI system (version 1.1.6; Lunit, Seoul, South Korea) 4 was used"}],"replication":{"produced_by":["The AI read every examination as an independent reader alongside two radiologists.","Any abnormal read by any reader sent the examination to a consensus discussion.","Radiologists in the consensus discussion saw the AI score and the marked area."],"must_hold":["A consensus step must exist where AI-flagged cases are reviewed by radiologists.","The AI threshold must be set to match radiologist sensitivity on local data.","The AI must perform on the local equipment as it did on Philips mammography units."],"echoes":[{"date":"2022-12-07","setting":"MASAI randomized trial, southwest Sweden (Transpara)","model_version":null,"outcome":"recurred","source":"https://pubmed.ncbi.nlm.nih.gov/39904652/"},{"date":"2023-10-05","setting":"GEMINI, NHS Grampian, Aberdeen (Mia as additional reader)","model_version":null,"outcome":"recurred","source":"https://pmc.ncbi.nlm.nih.gov/articles/PMC13035467/"}]},"paired_incident":null,"headline":"*Insight MMG* as a third reader finds more breast cancers in Stockholm","metric":"the three together found 269 cancers against 250 by the radiologists alone","comparator":{"against":"Standard double reading by two radiologists","before":"250 screen-detected cancers","after":"269 screen-detected cancers with AI as a third reader","basis":"measured","quote":"triple reading by two radiologists plus AI (269 [0·5%] vs 250 [0·4%] detected cases; relative proportion 1·08 [1·04-1·11])","url":"https://pubmed.ncbi.nlm.nih.gov/37690911/"},"later":null,"value":null,"developer_country":"South Korea","deployer_country":"Sweden","unrated_because":null,"brief_notes":null,"brief":null,"revisions":[{"date":"2026-10-29","change":"Added the case.","source":"https://pmc.ncbi.nlm.nih.gov/articles/PMC12818982/","editor":"AIBD"}],"confidence":"studied","shade":"high","claim_status":"Independently studied","claim_basis":"Sources: two independent peer-reviewed studies and two peer-reviewed studies from the makers. The cited evidence includes no finding by a regulator or court.","case_jurisdictions":["Sweden"],"profile":{"case_id":"AIBD-0643","catalog_version":"1.0.0","source_fingerprint":"9d1f7e601b7e7c6f072558f6df3506e81a260367ccc092b2c8db2e1d04af06d9","collection_refs":[{"collection_id":"aibd","version":"2026-10-29"},{"collection_id":"viator","version":"2026-10-25"}],"source_ids":["AIBD-0643-source-0001","AIBD-0643-source-0002","AIBD-0643-source-0003","AIBD-0643-source-0004"],"families":{"strategic assessments":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"evaluations":{"state":"value_present","value":{"kind":"identifiers","identifiers":["AIBD-0643-evaluation-1"],"role":"Evaluations of the benefit"},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":[],"source_refs":["AIBD-0643-source-0003"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"partial","record_ids":["AIBD-0643-evaluation-1"]},"monetary observations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"institutional decisions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]}},"fields":{"actors[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"developer":"Lunit","deployer":"Capio Sankt Göran Hospital with Karolinska Institutet (ScreenTrustCAD study)"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["developer","deployer"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"actors[].ownership_control":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"ai_contribution":{"state":"value_present","value":{"kind":"record_fields","fields":{"ai_role":{"status":"assessed","statement":"In a paired design, every examination was read by two radiologists and by the AI, and the authors counted the cancers found by each reader combination, so the cancers that only the AI flagged are attributable to it."}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ai_role"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"ai_relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"category":"general benefit","ai_role":{"status":"assessed","statement":"In a paired design, every examination was read by two radiologists and by the AI, and the authors counted the cancers found by each reader combination, so the cancers that only the AI flagged are attributable to it."}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ai_role","category"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].alternatives":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].assessor_date":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].depth":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"personal","depth":4,"reason":"Nineteen women had breast cancer found at screening only because the AI flagged their examinations (269 cancers with AI against 250 without)."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].display_confidence":{"state":"value_present","value":{"kind":"structured","data":{"confidence":"high","evidence_word":"studied","claim_status":"Independently studied","basis":"Sources: two independent peer-reviewed studies and two peer-reviewed studies from the makers. The cited evidence includes no finding by a regulator or court.","interpretation":"Existing display rule preserved; the richer outcome-specific confidence question still needs review."}},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rationale":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"personal","depth":4,"reason":"Nineteen women had breast cancer found at screening only because the AI flagged their examinations (269 cancers with AI against 250 without)."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rubric_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].status_basis":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].target":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"personal","depth":4,"reason":"Nineteen women had breast cancer found at screening only because the AI flagged their examinations (269 cancers with AI against 250 without)."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"availability":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"brief":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_kind":{"state":"value_present","value":{"kind":"structured","data":{"classification":"evaluation or study","answer":"The case describes an evaluation or a study. A prospective paired-reader non-inferiority study.","scope":"The period and activity described in the case."}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["account","evidence"],"source_refs":["AIBD-0643-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"The case describes an evaluation or a study. A prospective paired-reader non-inferiority study.","inferred":false}},"case_links[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Compared with the incidents in the AI Incident Database snapshot of 26 October 2026.","record_fields":["paired_incident"],"source_refs":[]},"reason":"No incident in the AI Incident Database snapshot of 26 October 2026 concerns the same kind of system harming the same kind of stakeholder.","review_state":"reviewed","coverage":"partial"},"claims[].evidence_links":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_strength":{"state":"value_present","value":{"kind":"structured","data":{"answer":"Independently studied. Sources: two independent peer-reviewed studies and two peer-reviewed studies from the makers. The cited evidence includes no finding by a regulator or court.","evidence_word":"studied","claim_status":"Independently studied"}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0643-source-0001","AIBD-0643-source-0002","AIBD-0643-source-0003","AIBD-0643-source-0004"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Independently studied. Sources: two independent peer-reviewed studies and two peer-reviewed studies from the makers. The cited evidence includes no finding by a regulator or court.","inferred":false}},"claims[].missingness":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].proposition":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"cross_border_flows[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"decisions[].action_outcome":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].grounds":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].institution_task":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].success_criterion":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"deployment_stage":{"state":"value_present","value":{"kind":"structured","data":{"classification":"pilot","answer":"The system was used in a pilot. A prospective clinical study at one hospital within population screening.","scope":"The period and activity described in the case."}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["account","evidence"],"source_refs":["AIBD-0643-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"The system was used in a pilot. A prospective clinical study at one hospital within population screening.","inferred":false}},"economics[].amount":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].costs[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].counterfactual":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].currency_price_basis":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].gross_net":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].measure_type":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].period_unit":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].realization":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].recipient_payer":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].return_payback":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].valuation_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"evaluations[].ai_uplift":{"state":"value_present","value":{"kind":"text","text":"19 additional cancers."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0643-source-0003"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"19 additional cancers.","inferred":false}},"evaluations[].comparator":{"state":"value_present","value":{"kind":"text","text":"Double reading by two radiologists."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0643-source-0003"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Double reading by two radiologists.","inferred":false}},"evaluations[].design":{"state":"value_present","value":{"kind":"text","text":"Controlled observational."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0643-source-0003"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Controlled observational.","inferred":false}},"evaluations[].effect":{"state":"value_present","value":{"kind":"text","text":"269 vs 250 cancers with AI as third reader (relative proportion 1.08); 261 vs 250 for one radiologist plus AI."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0643-source-0003"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"269 vs 250 cancers with AI as third reader (relative proportion 1.08); 261 vs 250 for one radiologist plus AI.","inferred":false}},"evaluations[].exposure":{"state":"value_present","value":{"kind":"text","text":"AI read every examination."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0643-source-0003"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"AI read every examination.","inferred":false}},"evaluations[].id":{"state":"value_present","value":{"kind":"identifiers","identifiers":["AIBD-0643-evaluation-1"],"role":"Evaluations of the benefit"},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0643-source-0003"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Controlled observational.","inferred":false}},"evaluations[].measurement_method":{"state":"value_present","value":{"kind":"text","text":"Screen-detected cancers within 3 months, by reader combination."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0643-source-0003"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Screen-detected cancers within 3 months, by reader combination.","inferred":false}},"evaluations[].metric":{"state":"value_present","value":{"kind":"text","text":"Screen-detected breast cancers."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0643-source-0003"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Screen-detected breast cancers.","inferred":false}},"evaluations[].reproduction_materials":{"state":"value_present","value":{"kind":"text","text":"Registered as NCT04778670; appendix with protocol."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0643-source-0003"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Registered as NCT04778670; appendix with protocol.","inferred":false}},"evaluations[].setting_sample":{"state":"value_present","value":{"kind":"text","text":"55,581 women aged 40 to 74 screened at Capio Sankt Göran Hospital, 1 April 2021 to 9 June 2022."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0643-source-0003"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"55,581 women aged 40 to 74 screened at Capio Sankt Göran Hospital, 1 April 2021 to 9 June 2022.","inferred":false}},"evaluations[].uncertainty_limitations":{"state":"value_present","value":{"kind":"text","text":"One hospital, one AI product, one mammography vendor; interval cancers not yet reported; Lunit co-funded the study."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0643-source-0003"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"One hospital, one AI product, one mammography vendor; interval cancers not yet reported; Lunit co-funded the study.","inferred":false}},"external_references[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"follow_up[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"human_oversight":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"id":{"state":"value_present","value":{"kind":"record_fields","fields":{"id":"AIBD-0643"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["id"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"infrastructure_dependencies[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiaries":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiary_count":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].benefit_type":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_type":"Improved Task Accuracy"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].claim":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"Karolinska Institutet researchers ran the ScreenTrustCAD study at Capio Sankt Göran Hospital in Stockholm, Sweden, from 1 April 2021 to 9 June 2022. Lunit's Insight MMG, version 1.1.6, read every screening mammogram in the background as an independent reader beside the usual two radiologists. If any of the three readers flagged an examination, it went to a consensus discussion, where two radiologists saw the AI score and the marked area and decided whether to recall the woman. Among 55,581 women aged 40 to 74, the two radiologists alone would have found 250 cancers. With the AI as a third reader, 269 cancers were found, a relative proportion of 1.08. The study also showed that one radiologist plus AI was non-inferior to two radiologists, with 261 cancers against 250. The study was paired, so every woman was read by every strategy, and it ran at one hospital with one mammography vendor. Lunit was one of the funders; the paper states that the funders had no role in the study.","benefit_type":"Improved Task Accuracy"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].distribution":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].duration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].id":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].stakeholder_group":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"personal","depth":4,"reason":"Nineteen women had breast cancer found at screening only because the AI flagged their examinations (269 cancers with AI against 250 without)."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].status":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_status":"reported"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_status"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].tradeoffs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].unexpected":{"state":"value_present","value":{"kind":"record_fields","fields":{"unexpected":false,"purpose":"Insight MMG was built to detect breast cancer on mammograms. In ScreenTrustCAD it served as an independent reader; the extra cancers found were that purpose."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["unexpected","purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"places[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"location":"Stockholm, Sweden","developer_country":"South Korea","deployer_country":"Sweden"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["location","developer_country","deployer_country"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"purpose":{"state":"value_present","value":{"kind":"record_fields","fields":{"purpose":"Insight MMG was built to detect breast cancer on mammograms. In ScreenTrustCAD it served as an independent reader; the extra cancers found were that purpose."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"record_dates":{"state":"value_present","value":{"kind":"record_fields","fields":{"date_observed":"2022-06-09","date_basis":"event","date_precision":"day","revisions":[{"date":"2026-10-29","change":"Added the case.","source":"https://pmc.ncbi.nlm.nih.gov/articles/PMC12818982/","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["date_observed","date_basis","date_precision","revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"replication.attempts[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"replication":{"produced_by":["The AI read every examination as an independent reader alongside two radiologists.","Any abnormal read by any reader sent the examination to a consensus discussion.","Radiologists in the consensus discussion saw the AI score and the marked area."],"must_hold":["A consensus step must exist where AI-flagged cases are reviewed by radiologists.","The AI threshold must be set to match radiologist sensitivity on local data.","The AI must perform on the local equipment as it did on Philips mammography units."],"echoes":[{"date":"2022-12-07","setting":"MASAI randomized trial, southwest Sweden (Transpara)","outcome":"recurred","source":"https://pubmed.ncbi.nlm.nih.gov/39904652/"},{"date":"2023-10-05","setting":"GEMINI, NHS Grampian, Aberdeen (Mia as additional reader)","outcome":"recurred","source":"https://pmc.ncbi.nlm.nih.gov/articles/PMC13035467/"}]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"replication.conditions":{"state":"value_present","value":{"kind":"record_fields","fields":{"replication":{"produced_by":["The AI read every examination as an independent reader alongside two radiologists.","Any abnormal read by any reader sent the examination to a consensus discussion.","Radiologists in the consensus discussion saw the AI score and the marked area."],"must_hold":["A consensus step must exist where AI-flagged cases are reviewed by radiologists.","The AI threshold must be set to match radiologist sensitivity on local data.","The AI must perform on the local equipment as it did on Philips mammography units."],"echoes":[{"date":"2022-12-07","setting":"MASAI randomized trial, southwest Sweden (Transpara)","outcome":"recurred","source":"https://pubmed.ncbi.nlm.nih.gov/39904652/"},{"date":"2023-10-05","setting":"GEMINI, NHS Grampian, Aberdeen (Mia as additional reader)","outcome":"recurred","source":"https://pmc.ncbi.nlm.nih.gov/articles/PMC13035467/"}]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"revision_history[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"revisions":[{"date":"2026-10-29","change":"Added the case.","source":"https://pmc.ncbi.nlm.nih.gov/articles/PMC12818982/","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sector":{"state":"value_present","value":{"kind":"record_fields","fields":{"domain":"Healthcare"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["domain"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].access_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].citation_locator":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"peer-reviewed study","citation":"Sossavi E, Roy C, Molière S. Artificial intelligence in breast cancer screening: a systematic review and meta-analysis of integration strategies. Eur J Radiol Open. 2026;16:100727. doi:10.1016/j.ejro.2026.100727","title":"Artificial intelligence in breast cancer screening: A systematic review and meta-analysis of integration strategies","url":"https://pmc.ncbi.nlm.nih.gov/articles/PMC12818982/","date":"2026-01-10","written_by":"independent","quote":"Dembrower 2023 AI + R1 + R2 (triple) 4.84 / 4.50 p < 0.0001"},{"kind":"peer-reviewed study","citation":"Ferre R, Benefield T, Kuzmiak CM. Artificial intelligence-supported double reading in European population breast cancer screening: a systematic review and meta-analysis of prospective programs. Clin Imaging. 2026;139:110923. doi:10.1016/j.clinimag.2026.110923","title":"Artificial intelligence-supported double reading in European population breast cancer screening: A systematic review and meta-analysis of prospective programs","url":"https://pubmed.ncbi.nlm.nih.gov/42617468/","date":"2026-08-11","written_by":"independent","quote":"MASAI (randomized AI-supported risk triage within a national program), ScreenTrustCAD (prospective paired-reader evaluation with AI as an independent reader in a double-reading framework), and PRAIM (nationwide decision-referral implementation)"},{"kind":"peer-reviewed study","citation":"Dembrower K, Crippa A, Colón E, Eklund M, Strand F; ScreenTrustCAD Trial Consortium. Artificial intelligence for breast cancer detection in screening mammography in Sweden: a prospective, population-based, paired-reader, non-inferiority study. Lancet Digit Health. 2023;5(10):e703-e711. doi:10.1016/S2589-7500(23)00153-X","title":"Artificial intelligence for breast cancer detection in screening mammography in Sweden: a prospective, population-based, paired-reader, non-inferiority study","url":"https://pubmed.ncbi.nlm.nih.gov/37690911/","date":"2023-09-08","written_by":"makers","quote":"triple reading by two radiologists plus AI (269 [0·5%] vs 250 [0·4%] detected cases; relative proportion 1·08 [1·04-1·11]) were also non-inferior to double reading by two radiologists"},{"kind":"peer-reviewed study","citation":"Dembrower K, et al. Lancet Digit Health. 2023. Full text (archived copy)","title":"Artificial intelligence for breast cancer detection in screening mammography in Sweden (full text)","url":"https://web.archive.org/web/2025/https://www.thelancet.com/journals/landig/article/PIIS2589-7500(23)00153-X/fulltext","date":"2023-09-08","written_by":"makers","quote":"For the reading by AI, the Insight MMG AI system (version 1.1.6; Lunit, Seoul, South Korea) 4 was used"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].id":{"state":"value_present","value":{"kind":"identifiers","identifiers":["AIBD-0643-source-0001","AIBD-0643-source-0002","AIBD-0643-source-0003","AIBD-0643-source-0004"],"role":"Existing evidence items, in their original order"},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"sources[].language":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"peer-reviewed study","citation":"Sossavi E, Roy C, Molière S. Artificial intelligence in breast cancer screening: a systematic review and meta-analysis of integration strategies. Eur J Radiol Open. 2026;16:100727. doi:10.1016/j.ejro.2026.100727","title":"Artificial intelligence in breast cancer screening: A systematic review and meta-analysis of integration strategies","url":"https://pmc.ncbi.nlm.nih.gov/articles/PMC12818982/","date":"2026-01-10","written_by":"independent","quote":"Dembrower 2023 AI + R1 + R2 (triple) 4.84 / 4.50 p < 0.0001"},{"kind":"peer-reviewed study","citation":"Ferre R, Benefield T, Kuzmiak CM. Artificial intelligence-supported double reading in European population breast cancer screening: a systematic review and meta-analysis of prospective programs. Clin Imaging. 2026;139:110923. doi:10.1016/j.clinimag.2026.110923","title":"Artificial intelligence-supported double reading in European population breast cancer screening: A systematic review and meta-analysis of prospective programs","url":"https://pubmed.ncbi.nlm.nih.gov/42617468/","date":"2026-08-11","written_by":"independent","quote":"MASAI (randomized AI-supported risk triage within a national program), ScreenTrustCAD (prospective paired-reader evaluation with AI as an independent reader in a double-reading framework), and PRAIM (nationwide decision-referral implementation)"},{"kind":"peer-reviewed study","citation":"Dembrower K, Crippa A, Colón E, Eklund M, Strand F; ScreenTrustCAD Trial Consortium. Artificial intelligence for breast cancer detection in screening mammography in Sweden: a prospective, population-based, paired-reader, non-inferiority study. Lancet Digit Health. 2023;5(10):e703-e711. doi:10.1016/S2589-7500(23)00153-X","title":"Artificial intelligence for breast cancer detection in screening mammography in Sweden: a prospective, population-based, paired-reader, non-inferiority study","url":"https://pubmed.ncbi.nlm.nih.gov/37690911/","date":"2023-09-08","written_by":"makers","quote":"triple reading by two radiologists plus AI (269 [0·5%] vs 250 [0·4%] detected cases; relative proportion 1·08 [1·04-1·11]) were also non-inferior to double reading by two radiologists"},{"kind":"peer-reviewed study","citation":"Dembrower K, et al. Lancet Digit Health. 2023. Full text (archived copy)","title":"Artificial intelligence for breast cancer detection in screening mammography in Sweden (full text)","url":"https://web.archive.org/web/2025/https://www.thelancet.com/journals/landig/article/PIIS2589-7500(23)00153-X/fulltext","date":"2023-09-08","written_by":"makers","quote":"For the reading by AI, the Insight MMG AI system (version 1.1.6; Lunit, Seoul, South Korea) 4 was used"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].upstream_sources":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"strategic_assessments[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"strategic assessments"},"summary":{"state":"value_present","value":{"kind":"record_fields","fields":{"summary":"At Capio Sankt Göran Hospital, Lunit's Insight MMG read 55,581 mammograms beside two radiologists; the three together found 269 cancers against 250 by the radiologists alone.","account":"Karolinska Institutet researchers ran the ScreenTrustCAD study at Capio Sankt Göran Hospital in Stockholm, Sweden, from 1 April 2021 to 9 June 2022. Lunit's Insight MMG, version 1.1.6, read every screening mammogram in the background as an independent reader beside the usual two radiologists. If any of the three readers flagged an examination, it went to a consensus discussion, where two radiologists saw the AI score and the marked area and decided whether to recall the woman. Among 55,581 women aged 40 to 74, the two radiologists alone would have found 250 cancers. With the AI as a third reader, 269 cancers were found, a relative proportion of 1.08. The study also showed that one radiologist plus AI was non-inferior to two radiologists, with 261 cancers against 250. The study was paired, so every woman was read by every strategy, and it ran at one hospital with one mammography vendor. Lunit was one of the funders; the paper states that the funders had no role in the study."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["summary","account"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].autonomy_permissions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].component_role":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].deployment_configuration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].inputs_outputs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_name":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_version":{"state":"value_present","value":{"kind":"record_fields","fields":{"model_version":"1.1.6"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["model_version"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].product_name":{"state":"value_present","value":{"kind":"record_fields","fields":{"system":"Lunit INSIGHT MMG"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["system"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].provider":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"taxonomy_crosswalks[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"title":{"state":"value_present","value":{"kind":"record_fields","fields":{"title":"ScreenTrustCAD at Capio Sankt Göran Hospital, Stockholm: Lunit Insight MMG as a third reader leads to 19 more screen-detected breast cancers than two radiologists","headline":"*Insight MMG* as a third reader finds more breast cancers in Stockholm"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["title","headline"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"version":{"state":"value_present","value":{"kind":"identifiers","identifiers":["1b00fd8af5568c8ba1546b92ab92e7a4f2e6952116321d7563cc1997ab69a179"],"role":"SHA-256 of the complete public case and its assessments"},"provenance":{"kind":"curatorial","basis":"SHA-256 of the public case, its assessments, and its displayed answers and notes, excluding its own identifier and the derived coverage summary.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"workflow":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"Karolinska Institutet researchers ran the ScreenTrustCAD study at Capio Sankt Göran Hospital in Stockholm, Sweden, from 1 April 2021 to 9 June 2022. Lunit's Insight MMG, version 1.1.6, read every screening mammogram in the background as an independent reader beside the usual two radiologists. If any of the three readers flagged an examination, it went to a consensus discussion, where two radiologists saw the AI score and the marked area and decided whether to recall the woman. Among 55,581 women aged 40 to 74, the two radiologists alone would have found 250 cancers. With the AI as a third reader, 269 cancers were found, a relative proportion of 1.08. The study also showed that one radiologist plus AI was non-inferior to two radiologists, with 261 cancers against 250. The study was paired, so every woman was read by every strategy, and it ran at one hospital with one mammography vendor. Lunit was one of the funders; the paper states that the funders had no role in the study.","replication":{"produced_by":["The AI read every examination as an independent reader alongside two radiologists.","Any abnormal read by any reader sent the examination to a consensus discussion.","Radiologists in the consensus discussion saw the AI score and the marked area."],"must_hold":["A consensus step must exist where AI-flagged cases are reviewed by radiologists.","The AI threshold must be set to match radiologist sensitivity on local data.","The AI must perform on the local equipment as it did on Philips mammography units."],"echoes":[{"date":"2022-12-07","setting":"MASAI randomized trial, southwest Sweden (Transpara)","outcome":"recurred","source":"https://pubmed.ncbi.nlm.nih.gov/39904652/"},{"date":"2023-10-05","setting":"GEMINI, NHS Grampian, Aberdeen (Mia as additional reader)","outcome":"recurred","source":"https://pmc.ncbi.nlm.nih.gov/articles/PMC13035467/"}]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"}},"summary":{"total":91,"addressed":91,"known":43,"reviewed":15,"reviewed_complete":14,"reviewed_partial":1,"record_mapped":29,"review_not_assessed":47,"not_assessed":0,"complete":false,"by_state":{"value_present":43,"not_reported":0,"unresolved":48,"not_assessed":0,"not_applicable":0,"withheld":0,"source_unavailable":0}}},"presentation_version":"4a9f72fb5b37a92e310e7deabe59638f9b83a4a9669070f499a5241e1466bcad"}