{"id":"AIBD-0627","title":"FDA De Novo review of OsteoDetect: 24 clinicians detect wrist fractures more accurately with AI","summary":"In the reader study that FDA reviewed for OsteoDetect, 24 clinicians found distal radius fractures with 80.3% sensitivity when aided, against 74.7% unaided.","date_observed":"2018-05-24","date_basis":"source publication","date_precision":"day","benefit_status":"reported","source_collection":null,"source_entry":null,"account":"Imagen Technologies of New York makes OsteoDetect, machine learning software that marks distal radius fractures on wrist X-rays. In a fully crossed reader study, 24 clinicians read 200 cases with and without the software, with at least one month between sessions. The readers were radiologists, orthopedic surgeons, emergency physicians, emergency physician assistants, internists and family physicians. Three hand surgeons set the ground truth. FDA reviewers report that the area under the ROC curve rose from 0.840 unaided to 0.889 aided. Sensitivity rose from 74.7% to 80.3% and specificity from 88.9% to 91.4%. Every type of reader improved. FDA granted the De Novo request on 24 May 2018. The study used archived images, so it measured reader accuracy and did not measure patient outcomes.","category":"general benefit","unexpected":false,"purpose":"OsteoDetect was built to help clinicians detect distal radius fractures on wrist X-rays. Better detection is that purpose.","system":"OsteoDetect","model_version":null,"developer":"Imagen Technologies, Inc.","deployer":"Imagen Technologies (reader study with 24 clinicians)","location":"United States","domain":"Healthcare","segment":null,"benefit_type":"Improved Task Accuracy","taxonomy_note":null,"registry_ids":{},"ratings":[{"group":"organizational","depth":2,"reason":"Aided clinicians reached 80.3% sensitivity and 91.4% specificity against 74.7% and 88.9% unaided."}],"ai_role":{"status":"assessed","statement":"Every reader read every case with and without the software in a crossed design, so the gain is attributed to the software."},"evidence":[{"kind":"regulatory document","citation":"U.S. Food and Drug Administration, Center for Devices and Radiological Health. De Novo classification request for OsteoDetect (DEN180005): decision summary. Granted 2018-05-24.","title":"De Novo classification request for OsteoDetect (DEN180005)","url":"https://www.accessdata.fda.gov/cdrh_docs/reviews/DEN180005.pdf","date":"2018-05-24","written_by":"independent","quote":"By comparison, the study demonstrated non-aided sensitivity and specificity of 74.7% [72.8%,76.5%] and 88.9% [87.6%,90.0%], respectively."},{"kind":"peer-reviewed study","citation":"Lindsey R, Daluiski A, Chopra S, et al. Deep neural network improves fracture detection by clinicians. Proceedings of the National Academy of Sciences 2018;115(45):11591-11596.","title":"Deep neural network improves fracture detection by clinicians","url":"https://pmc.ncbi.nlm.nih.gov/articles/PMC6233134","date":"2018-10-22","written_by":"makers","quote":"The average clinician experienced a relative reduction in misinterpretation rate of 47.0% (95% CI, 37.4-53.9%)."}],"replication":{"produced_by":["Clinicians reviewed the marked images together with the original images.","Cases included PA and lateral wrist views of adults."],"must_hold":["The patient is an adult with a suspected distal radius fracture.","The clinician does not use the software output as the primary interpretation."],"echoes":[{"date":"2018-10-22","setting":"A separate controlled experiment by the developer with emergency medicine clinicians reading wrist radiographs with and without the deep learning model","model_version":null,"outcome":"recurred","source":"https://pmc.ncbi.nlm.nih.gov/articles/PMC6233134"}]},"paired_incident":null,"headline":"*OsteoDetect* helped clinicians spot wrist fractures on X-rays","metric":"Sensitivity rose from 74.7% to 80.3%","comparator":{"against":"The same clinicians reading the same cases without OsteoDetect","before":"Sensitivity 74.7%, specificity 88.9%","after":"Sensitivity 80.3%, specificity 91.4%","basis":"measured","quote":"Specifically, Imagen's study demonstrated a device-aided sensitivity of 80.3%","url":"https://www.accessdata.fda.gov/cdrh_docs/reviews/DEN180005.pdf"},"later":null,"value":null,"developer_country":"United States","deployer_country":"United States","unrated_because":null,"brief_notes":null,"brief":null,"revisions":[{"date":"2026-10-29","change":"Added the case.","source":"https://www.accessdata.fda.gov/cdrh_docs/reviews/DEN180005.pdf","editor":"AIBD"}],"confidence":"found","shade":"high","claim_status":"Found by a regulator","claim_basis":"Sources: one independent regulatory document and the makers' peer-reviewed study. The cited evidence includes no independent study or report.","case_jurisdictions":["United States"],"profile":{"case_id":"AIBD-0627","catalog_version":"1.0.0","source_fingerprint":"1fdeb251830b78a253bfc83f88929adc74a21140c6d1485727a7c9170572ddb9","collection_refs":[{"collection_id":"aibd","version":"2026-10-29"},{"collection_id":"querist","version":"2026-10-25"}],"source_ids":["AIBD-0627-source-0001","AIBD-0627-source-0002"],"families":{"strategic assessments":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"evaluations":{"state":"value_present","value":{"kind":"identifiers","identifiers":["AIBD-0627-evaluation-1"],"role":"Evaluations of the benefit"},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":[],"source_refs":["AIBD-0627-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"partial","record_ids":["AIBD-0627-evaluation-1"]},"monetary observations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"institutional decisions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]}},"fields":{"actors[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"developer":"Imagen Technologies, Inc.","deployer":"Imagen Technologies (reader study with 24 clinicians)"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["developer","deployer"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"actors[].ownership_control":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"ai_contribution":{"state":"value_present","value":{"kind":"record_fields","fields":{"ai_role":{"status":"assessed","statement":"Every reader read every case with and without the software in a crossed design, so the gain is attributed to the software."}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ai_role"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"ai_relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"category":"general benefit","ai_role":{"status":"assessed","statement":"Every reader read every case with and without the software in a crossed design, so the gain is attributed to the software."}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ai_role","category"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].alternatives":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].assessor_date":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].depth":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":2,"reason":"Aided clinicians reached 80.3% sensitivity and 91.4% specificity against 74.7% and 88.9% unaided."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].display_confidence":{"state":"value_present","value":{"kind":"structured","data":{"confidence":"high","evidence_word":"found","claim_status":"Found by a regulator","basis":"Sources: one independent regulatory document and the makers' peer-reviewed study. The cited evidence includes no independent study or report.","interpretation":"Existing display rule preserved; the richer outcome-specific confidence question still needs review."}},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rationale":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":2,"reason":"Aided clinicians reached 80.3% sensitivity and 91.4% specificity against 74.7% and 88.9% unaided."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rubric_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].status_basis":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].target":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":2,"reason":"Aided clinicians reached 80.3% sensitivity and 91.4% specificity against 74.7% and 88.9% unaided."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"availability":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"brief":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_kind":{"state":"value_present","value":{"kind":"structured","data":{"classification":"evaluation or study","answer":"The case describes an evaluation or a study. A regulatory review of a multi-reader study.","scope":"The period and activity described in the case."}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["account","evidence"],"source_refs":["AIBD-0627-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"The case describes an evaluation or a study. A regulatory review of a multi-reader study.","inferred":false}},"case_links[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Compared with the incidents in the AI Incident Database snapshot of 26 October 2026.","record_fields":["paired_incident"],"source_refs":[]},"reason":"No incident in the AI Incident Database snapshot of 26 October 2026 concerns the same kind of system harming the same kind of stakeholder.","review_state":"reviewed","coverage":"partial"},"claims[].evidence_links":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_strength":{"state":"value_present","value":{"kind":"structured","data":{"answer":"Found by a regulator. Sources: one independent regulatory document and the makers' peer-reviewed study. The cited evidence includes no independent study or report.","evidence_word":"found","claim_status":"Found by a regulator"}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0627-source-0001","AIBD-0627-source-0002"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Found by a regulator. Sources: one independent regulatory document and the makers' peer-reviewed study. The cited evidence includes no independent study or report.","inferred":false}},"claims[].missingness":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].proposition":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"cross_border_flows[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"decisions[].action_outcome":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].grounds":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].institution_task":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].success_criterion":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"deployment_stage":{"state":"value_present","value":{"kind":"structured","data":{"classification":"laboratory test","answer":"The system was tested in a laboratory. A retrospective reader study on archived radiographs.","scope":"The period and activity described in the case."}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["account","evidence"],"source_refs":["AIBD-0627-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"The system was tested in a laboratory. A retrospective reader study on archived radiographs.","inferred":false}},"economics[].amount":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].costs[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].counterfactual":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].currency_price_basis":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].gross_net":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].measure_type":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].period_unit":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].realization":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].recipient_payer":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].return_payback":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].valuation_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"evaluations[].ai_uplift":{"state":"value_present","value":{"kind":"text","text":"AUC difference 0.049 (95% CI 0.019 to 0.080)."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0627-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"AUC difference 0.049 (95% CI 0.019 to 0.080).","inferred":false}},"evaluations[].comparator":{"state":"value_present","value":{"kind":"text","text":"Unaided reads by the same clinicians."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0627-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Unaided reads by the same clinicians.","inferred":false}},"evaluations[].design":{"state":"value_present","value":{"kind":"text","text":"Quasi-experimental."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0627-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Quasi-experimental.","inferred":false}},"evaluations[].effect":{"state":"value_present","value":{"kind":"text","text":"AUC 0.840 to 0.889; sensitivity 74.7% to 80.3%; specificity 88.9% to 91.4%."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0627-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"AUC 0.840 to 0.889; sensitivity 74.7% to 80.3%; specificity 88.9% to 91.4%.","inferred":false}},"evaluations[].exposure":{"state":"value_present","value":{"kind":"text","text":"200 aided and 200 unaided reads per clinician."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0627-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"200 aided and 200 unaided reads per clinician.","inferred":false}},"evaluations[].id":{"state":"value_present","value":{"kind":"identifiers","identifiers":["AIBD-0627-evaluation-1"],"role":"Evaluations of the benefit"},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0627-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Quasi-experimental.","inferred":false}},"evaluations[].measurement_method":{"state":"value_present","value":{"kind":"text","text":"Fully crossed multi-reader multi-case study with a one-month washout; ground truth by three hand surgeons."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0627-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Fully crossed multi-reader multi-case study with a one-month washout; ground truth by three hand surgeons.","inferred":false}},"evaluations[].metric":{"state":"value_present","value":{"kind":"text","text":"Reader AUC, sensitivity and specificity."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0627-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Reader AUC, sensitivity and specificity.","inferred":false}},"evaluations[].reproduction_materials":{"state":"value_present","value":{"kind":"text","text":"None public."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0627-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"None public.","inferred":false}},"evaluations[].setting_sample":{"state":"value_present","value":{"kind":"text","text":"24 clinicians of six types; 200 cases."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0627-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"24 clinicians of six types; 200 cases.","inferred":false}},"evaluations[].uncertainty_limitations":{"state":"value_present","value":{"kind":"text","text":"Retrospective archived images; enriched case mix; no patient outcomes."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0627-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Retrospective archived images; enriched case mix; no patient outcomes.","inferred":false}},"external_references[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"follow_up[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"human_oversight":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"id":{"state":"value_present","value":{"kind":"record_fields","fields":{"id":"AIBD-0627"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["id"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"infrastructure_dependencies[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiaries":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiary_count":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].benefit_type":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_type":"Improved Task Accuracy"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].claim":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"Imagen Technologies of New York makes OsteoDetect, machine learning software that marks distal radius fractures on wrist X-rays. In a fully crossed reader study, 24 clinicians read 200 cases with and without the software, with at least one month between sessions. The readers were radiologists, orthopedic surgeons, emergency physicians, emergency physician assistants, internists and family physicians. Three hand surgeons set the ground truth. FDA reviewers report that the area under the ROC curve rose from 0.840 unaided to 0.889 aided. Sensitivity rose from 74.7% to 80.3% and specificity from 88.9% to 91.4%. Every type of reader improved. FDA granted the De Novo request on 24 May 2018. The study used archived images, so it measured reader accuracy and did not measure patient outcomes.","benefit_type":"Improved Task Accuracy"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].distribution":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].duration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].id":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].stakeholder_group":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":2,"reason":"Aided clinicians reached 80.3% sensitivity and 91.4% specificity against 74.7% and 88.9% unaided."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].status":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_status":"reported"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_status"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].tradeoffs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].unexpected":{"state":"value_present","value":{"kind":"record_fields","fields":{"unexpected":false,"purpose":"OsteoDetect was built to help clinicians detect distal radius fractures on wrist X-rays. Better detection is that purpose."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["unexpected","purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"places[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"location":"United States","developer_country":"United States","deployer_country":"United States"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["location","developer_country","deployer_country"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"purpose":{"state":"value_present","value":{"kind":"record_fields","fields":{"purpose":"OsteoDetect was built to help clinicians detect distal radius fractures on wrist X-rays. Better detection is that purpose."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"record_dates":{"state":"value_present","value":{"kind":"record_fields","fields":{"date_observed":"2018-05-24","date_basis":"source publication","date_precision":"day","revisions":[{"date":"2026-10-29","change":"Added the case.","source":"https://www.accessdata.fda.gov/cdrh_docs/reviews/DEN180005.pdf","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["date_observed","date_basis","date_precision","revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"replication.attempts[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"replication":{"produced_by":["Clinicians reviewed the marked images together with the original images.","Cases included PA and lateral wrist views of adults."],"must_hold":["The patient is an adult with a suspected distal radius fracture.","The clinician does not use the software output as the primary interpretation."],"echoes":[{"date":"2018-10-22","setting":"A separate controlled experiment by the developer with emergency medicine clinicians reading wrist radiographs with and without the deep learning model","outcome":"recurred","source":"https://pmc.ncbi.nlm.nih.gov/articles/PMC6233134"}]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"replication.conditions":{"state":"value_present","value":{"kind":"record_fields","fields":{"replication":{"produced_by":["Clinicians reviewed the marked images together with the original images.","Cases included PA and lateral wrist views of adults."],"must_hold":["The patient is an adult with a suspected distal radius fracture.","The clinician does not use the software output as the primary interpretation."],"echoes":[{"date":"2018-10-22","setting":"A separate controlled experiment by the developer with emergency medicine clinicians reading wrist radiographs with and without the deep learning model","outcome":"recurred","source":"https://pmc.ncbi.nlm.nih.gov/articles/PMC6233134"}]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"revision_history[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"revisions":[{"date":"2026-10-29","change":"Added the case.","source":"https://www.accessdata.fda.gov/cdrh_docs/reviews/DEN180005.pdf","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sector":{"state":"value_present","value":{"kind":"record_fields","fields":{"domain":"Healthcare"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["domain"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].access_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].citation_locator":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"regulatory document","citation":"U.S. Food and Drug Administration, Center for Devices and Radiological Health. De Novo classification request for OsteoDetect (DEN180005): decision summary. Granted 2018-05-24.","title":"De Novo classification request for OsteoDetect (DEN180005)","url":"https://www.accessdata.fda.gov/cdrh_docs/reviews/DEN180005.pdf","date":"2018-05-24","written_by":"independent","quote":"By comparison, the study demonstrated non-aided sensitivity and specificity of 74.7% [72.8%,76.5%] and 88.9% [87.6%,90.0%], respectively."},{"kind":"peer-reviewed study","citation":"Lindsey R, Daluiski A, Chopra S, et al. Deep neural network improves fracture detection by clinicians. Proceedings of the National Academy of Sciences 2018;115(45):11591-11596.","title":"Deep neural network improves fracture detection by clinicians","url":"https://pmc.ncbi.nlm.nih.gov/articles/PMC6233134","date":"2018-10-22","written_by":"makers","quote":"The average clinician experienced a relative reduction in misinterpretation rate of 47.0% (95% CI, 37.4-53.9%)."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].id":{"state":"value_present","value":{"kind":"identifiers","identifiers":["AIBD-0627-source-0001","AIBD-0627-source-0002"],"role":"Existing evidence items, in their original order"},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"sources[].language":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"regulatory document","citation":"U.S. Food and Drug Administration, Center for Devices and Radiological Health. De Novo classification request for OsteoDetect (DEN180005): decision summary. Granted 2018-05-24.","title":"De Novo classification request for OsteoDetect (DEN180005)","url":"https://www.accessdata.fda.gov/cdrh_docs/reviews/DEN180005.pdf","date":"2018-05-24","written_by":"independent","quote":"By comparison, the study demonstrated non-aided sensitivity and specificity of 74.7% [72.8%,76.5%] and 88.9% [87.6%,90.0%], respectively."},{"kind":"peer-reviewed study","citation":"Lindsey R, Daluiski A, Chopra S, et al. Deep neural network improves fracture detection by clinicians. Proceedings of the National Academy of Sciences 2018;115(45):11591-11596.","title":"Deep neural network improves fracture detection by clinicians","url":"https://pmc.ncbi.nlm.nih.gov/articles/PMC6233134","date":"2018-10-22","written_by":"makers","quote":"The average clinician experienced a relative reduction in misinterpretation rate of 47.0% (95% CI, 37.4-53.9%)."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].upstream_sources":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"strategic_assessments[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"strategic assessments"},"summary":{"state":"value_present","value":{"kind":"record_fields","fields":{"summary":"In the reader study that FDA reviewed for OsteoDetect, 24 clinicians found distal radius fractures with 80.3% sensitivity when aided, against 74.7% unaided.","account":"Imagen Technologies of New York makes OsteoDetect, machine learning software that marks distal radius fractures on wrist X-rays. In a fully crossed reader study, 24 clinicians read 200 cases with and without the software, with at least one month between sessions. The readers were radiologists, orthopedic surgeons, emergency physicians, emergency physician assistants, internists and family physicians. Three hand surgeons set the ground truth. FDA reviewers report that the area under the ROC curve rose from 0.840 unaided to 0.889 aided. Sensitivity rose from 74.7% to 80.3% and specificity from 88.9% to 91.4%. Every type of reader improved. FDA granted the De Novo request on 24 May 2018. The study used archived images, so it measured reader accuracy and did not measure patient outcomes."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["summary","account"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].autonomy_permissions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].component_role":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].deployment_configuration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].inputs_outputs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_name":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].product_name":{"state":"value_present","value":{"kind":"record_fields","fields":{"system":"OsteoDetect"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["system"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].provider":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"taxonomy_crosswalks[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"title":{"state":"value_present","value":{"kind":"record_fields","fields":{"title":"FDA De Novo review of OsteoDetect: 24 clinicians detect wrist fractures more accurately with AI","headline":"*OsteoDetect* helped clinicians spot wrist fractures on X-rays"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["title","headline"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"version":{"state":"value_present","value":{"kind":"identifiers","identifiers":["9fa13f9faf4d4dd694935f2ac4f77ac1002d5155d1d0fbab69763a50562e9b46"],"role":"SHA-256 of the complete public case and its assessments"},"provenance":{"kind":"curatorial","basis":"SHA-256 of the public case, its assessments, and its displayed answers and notes, excluding its own identifier and the derived coverage summary.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"workflow":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"Imagen Technologies of New York makes OsteoDetect, machine learning software that marks distal radius fractures on wrist X-rays. In a fully crossed reader study, 24 clinicians read 200 cases with and without the software, with at least one month between sessions. The readers were radiologists, orthopedic surgeons, emergency physicians, emergency physician assistants, internists and family physicians. Three hand surgeons set the ground truth. FDA reviewers report that the area under the ROC curve rose from 0.840 unaided to 0.889 aided. Sensitivity rose from 74.7% to 80.3% and specificity from 88.9% to 91.4%. Every type of reader improved. FDA granted the De Novo request on 24 May 2018. The study used archived images, so it measured reader accuracy and did not measure patient outcomes.","replication":{"produced_by":["Clinicians reviewed the marked images together with the original images.","Cases included PA and lateral wrist views of adults."],"must_hold":["The patient is an adult with a suspected distal radius fracture.","The clinician does not use the software output as the primary interpretation."],"echoes":[{"date":"2018-10-22","setting":"A separate controlled experiment by the developer with emergency medicine clinicians reading wrist radiographs with and without the deep learning model","outcome":"recurred","source":"https://pmc.ncbi.nlm.nih.gov/articles/PMC6233134"}]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"}},"summary":{"total":91,"addressed":91,"known":42,"reviewed":15,"reviewed_complete":14,"reviewed_partial":1,"record_mapped":28,"review_not_assessed":48,"not_assessed":0,"complete":false,"by_state":{"value_present":42,"not_reported":0,"unresolved":49,"not_assessed":0,"not_applicable":0,"withheld":0,"source_unavailable":0}}},"presentation_version":"7f670e4fd57b62872ebb01111f5b36d49aa4ab36ebf1afda1b1e5771b93fbe17"}