{"id":"AIBD-0626","title":"FDA De Novo review of Prenosis Sepsis ImmunoScore: AI risk categories track sepsis risk in data from three hospitals","summary":"In FDA's review of the Prenosis Sepsis ImmunoScore, sepsis within 24 hours rose from 3.02% in its low risk category to 69.70% in its very high category; AUROC was 0.81.","date_observed":"2024-04-02","date_basis":"source publication","date_precision":"day","benefit_status":"intended","source_collection":null,"source_entry":null,"account":"Prenosis of Chicago developed the Sepsis ImmunoScore, machine learning software that uses up to 22 inputs from the electronic health record to place a patient in one of four sepsis risk categories. The validation study used prospectively collected data and blood samples from patients with suspected sepsis at Beth Israel Deaconess Medical Center in Boston, the Jesse Brown VA in Chicago and Beaumont in Royal Oak, Michigan. Physicians blinded to the score judged whether each patient had sepsis. FDA reviewers report an area under the ROC curve of 0.81 against the majority judgment, above a goal of 0.75. Sepsis was present in 3.02% of the low risk group and 69.70% of the very high risk group. In-hospital death rose from 0% in the low group to 18.18% in the very high group. FDA granted the De Novo request on 2 April 2024. The study was retrospective, so the score did not guide care, and adjudicators worked at the same hospitals as the patients.","category":"general benefit","unexpected":false,"purpose":"The Sepsis ImmunoScore was built to identify patients at risk of having or developing sepsis within 24 hours. The measured risk stratification is that purpose.","system":"Sepsis ImmunoScore","model_version":null,"developer":"Prenosis, Inc.","deployer":"Prenosis (retrospective validation on data from three US hospitals)","location":"Boston, Massachusetts; Chicago, Illinois; Royal Oak, Michigan, United States","domain":"Healthcare","segment":null,"benefit_type":"Improved Task Accuracy","taxonomy_note":null,"registry_ids":{},"ratings":[{"group":"organizational","depth":null,"reason":"The risk categories were measured on retrospective data, and no hospital used the score to change care."}],"ai_role":{"status":"unassessed","statement":"The study measured the accuracy of the score against physician adjudication. It did not compare care with and without the score."},"evidence":[{"kind":"regulatory document","citation":"U.S. Food and Drug Administration, Center for Devices and Radiological Health. De Novo classification request for Sepsis ImmunoScore (DEN230036): decision summary. Granted 2024-04-02.","title":"De Novo classification request for Sepsis ImmunoScore (DEN230036)","url":"https://www.accessdata.fda.gov/cdrh_docs/reviews/DEN230036.pdf","date":"2024-04-02","written_by":"independent","quote":"The ImmunoScore has demonstrated that an increase in risk score and category is correlated with the increased risk of sepsis."}],"replication":{"produced_by":["The score used up to 22 inputs from the electronic health record, including a blood sample drawn within three hours of the first blood culture order.","Risk thresholds were fixed before the validation study."],"must_hold":["The patient is an adult with suspected sepsis and a blood culture ordered.","Clinicians use the score with other findings and not as the sole basis for a decision."],"echoes":[]},"paired_incident":{"database":"AI Incident Database","identifier":"1374","title":"Purportedly AI-Generated Sepsis Alert Reportedly Prompted Potentially Inappropriate IV Fluid Administration for a Dialysis Patient, Averted by Clinician Intervention","url":"https://incidentdatabase.ai/cite/1374","severity":null,"group":"organizational","basis":"Both records concern an AI model that flags hospital patients at risk of sepsis, and the hospital that relies on its alerts is the stakeholder in each."},"headline":"*Sepsis ImmunoScore* sorted patients by sepsis risk in FDA's review","metric":"an area under the ROC curve of 0.81","comparator":{"against":"Pre-specified AUROC performance goal","before":"Goal of 0.75","after":"0.81 (forced majority adjudication)","basis":"measured","quote":"There was a pre-specified performance goal of 0.75, which was achieved for both schemes","url":"https://www.accessdata.fda.gov/cdrh_docs/reviews/DEN230036.pdf"},"later":null,"value":null,"developer_country":"United States","deployer_country":"United States","unrated_because":"The study was a retrospective validation in which the score guided no care, so no realized outcome is reported for any group.","brief_notes":null,"brief":null,"revisions":[{"date":"2026-10-29","change":"Added the case.","source":"https://www.accessdata.fda.gov/cdrh_docs/reviews/DEN230036.pdf","editor":"AIBD"},{"date":"2026-10-29","change":"Linked a comparable incident in the AI Incident Database (incident 1374).","source":"https://incidentdatabase.ai/cite/1374","editor":"AIBD"},{"date":"2026-10-29","change":"Corrected the benefit status; revised the depth ratings.","source":null,"editor":"AIBD"}],"confidence":"found","shade":"high","claim_status":"Found by a regulator","claim_basis":"Sources: one independent regulatory document. The cited evidence includes no independent study or report.","case_jurisdictions":["United States"],"profile":{"case_id":"AIBD-0626","catalog_version":"1.0.0","source_fingerprint":"6cfaca484b27d9344c07c07411a6dec15843218dd957f7e4ec299f7b09e4bc88","collection_refs":[{"collection_id":"aibd","version":"2026-10-29"},{"collection_id":"querist","version":"2026-10-25"}],"source_ids":["AIBD-0626-source-0001"],"families":{"strategic assessments":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"evaluations":{"state":"value_present","value":{"kind":"identifiers","identifiers":["AIBD-0626-evaluation-1"],"role":"Evaluations of the benefit"},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":[],"source_refs":["AIBD-0626-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"partial","record_ids":["AIBD-0626-evaluation-1"]},"monetary observations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"institutional decisions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]}},"fields":{"actors[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"developer":"Prenosis, Inc.","deployer":"Prenosis (retrospective validation on data from three US hospitals)"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["developer","deployer"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"actors[].ownership_control":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"ai_contribution":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"ai_relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"category":"general benefit","ai_role":{"status":"unassessed","statement":"The study measured the accuracy of the score against physician adjudication. It did not compare care with and without the score."}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ai_role","category"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].alternatives":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].assessor_date":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].depth":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"The record revision removed the mapped value.","record_fields":["ratings"],"source_refs":[]},"reason":"The revised record no longer states this information.","review_state":"not_assessed","coverage":"partial"},"assessments[].display_confidence":{"state":"value_present","value":{"kind":"structured","data":{"confidence":"high","evidence_word":"found","claim_status":"Found by a regulator","basis":"Sources: one independent regulatory document. The cited evidence includes no independent study or report.","interpretation":"Existing display rule preserved; the richer outcome-specific confidence question still needs review."}},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rationale":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","reason":"The risk categories were measured on retrospective data, and no hospital used the score to change care."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rubric_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].status_basis":{"state":"value_present","value":{"kind":"text","text":"Intended. The validation applied the score retrospectively to stored data, and the score guided no care, so the sources report no realized benefit."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["benefit_status"],"source_refs":["AIBD-0626-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Intended. The validation applied the score retrospectively to stored data, and the score guided no care, so the sources report no realized benefit.","inferred":false}},"assessments[].target":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","reason":"The risk categories were measured on retrospective data, and no hospital used the score to change care."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"availability":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"brief":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_kind":{"state":"value_present","value":{"kind":"structured","data":{"classification":"evaluation or study","answer":"The case describes an evaluation or a study. A regulatory review of a validation study.","scope":"The period and activity described in the case."}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["account","evidence"],"source_refs":["AIBD-0626-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"The case describes an evaluation or a study. A regulatory review of a validation study.","inferred":false}},"case_links[]":{"state":"value_present","value":{"kind":"structured","data":{"answer":"Both records concern an AI model that flags hospital patients at risk of sepsis, and the hospital that relies on its alerts is the stakeholder in each.","links":[{"database":"AI Incident Database","identifier":"1374","title":"Purportedly AI-Generated Sepsis Alert Reportedly Prompted Potentially Inappropriate IV Fluid Administration for a Dialysis Patient, Averted by Clinician Intervention","url":"https://incidentdatabase.ai/cite/1374","group":"organizational","basis":"Both records concern an AI model that flags hospital patients at risk of sepsis, and the hospital that relies on its alerts is the stakeholder in each.","relation":"comparable_harm"}]}},"provenance":{"kind":"curatorial","basis":"Compared with the incidents in the AI Incident Database snapshot of 26 October 2026; a second reading confirmed that the incident concerns the same kind of system and stakeholder.","record_fields":["paired_incident"],"source_refs":["https://incidentdatabase.ai/cite/1374"]},"review_state":"reviewed","coverage":"complete","display":{"answer":"Both records concern an AI model that flags hospital patients at risk of sepsis, and the hospital that relies on its alerts is the stakeholder in each.","inferred":false}},"claims[].evidence_links":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_strength":{"state":"value_present","value":{"kind":"structured","data":{"answer":"Found by a regulator. Sources: one independent regulatory document. The cited evidence includes no independent study or report.","evidence_word":"found","claim_status":"Found by a regulator"}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0626-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Found by a regulator. Sources: one independent regulatory document. The cited evidence includes no independent study or report.","inferred":false}},"claims[].missingness":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].proposition":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"cross_border_flows[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"decisions[].action_outcome":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].grounds":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].institution_task":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].success_criterion":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"deployment_stage":{"state":"value_present","value":{"kind":"structured","data":{"classification":"laboratory test","answer":"The system was tested in a laboratory. Retrospective validation on biobank samples and records; the score did not guide care.","scope":"The period and activity described in the case."}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["account","evidence"],"source_refs":["AIBD-0626-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"The system was tested in a laboratory. Retrospective validation on biobank samples and records; the score did not guide care.","inferred":false}},"economics[].amount":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].costs[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].counterfactual":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].currency_price_basis":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].gross_net":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].measure_type":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].period_unit":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].realization":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].recipient_payer":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].return_payback":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].valuation_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"evaluations[].ai_uplift":{"state":"value_present","value":{"kind":"text","text":"Not isolated."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0626-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Not isolated.","inferred":false}},"evaluations[].comparator":{"state":"value_present","value":{"kind":"text","text":"Physician adjudication of Sepsis-3."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0626-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Physician adjudication of Sepsis-3.","inferred":false}},"evaluations[].design":{"state":"value_present","value":{"kind":"text","text":"Other."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0626-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Other.","inferred":false}},"evaluations[].effect":{"state":"value_present","value":{"kind":"text","text":"AUROC 0.81; sepsis 3.02% low to 69.70% very high."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0626-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"AUROC 0.81; sepsis 3.02% low to 69.70% very high.","inferred":false}},"evaluations[].exposure":{"state":"value_present","value":{"kind":"text","text":"One score per patient."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0626-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"One score per patient.","inferred":false}},"evaluations[].id":{"state":"value_present","value":{"kind":"identifiers","identifiers":["AIBD-0626-evaluation-1"],"role":"Evaluations of the benefit"},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0626-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Other.","inferred":false}},"evaluations[].measurement_method":{"state":"value_present","value":{"kind":"text","text":"Retrospective study of prospectively collected data and samples; sepsis adjudicated by three physicians blinded to the score."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0626-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Retrospective study of prospectively collected data and samples; sepsis adjudicated by three physicians blinded to the score.","inferred":false}},"evaluations[].metric":{"state":"value_present","value":{"kind":"text","text":"AUROC and sepsis rate by risk category."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0626-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"AUROC and sepsis rate by risk category.","inferred":false}},"evaluations[].reproduction_materials":{"state":"value_present","value":{"kind":"text","text":"None public."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0626-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"None public.","inferred":false}},"evaluations[].setting_sample":{"state":"value_present","value":{"kind":"text","text":"746 patients with suspected sepsis at three US hospitals."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0626-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"746 patients with suspected sepsis at three US hospitals.","inferred":false}},"evaluations[].uncertainty_limitations":{"state":"value_present","value":{"kind":"text","text":"Retrospective; same-site adjudicators; mechanical ventilation endpoint not met."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0626-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Retrospective; same-site adjudicators; mechanical ventilation endpoint not met.","inferred":false}},"external_references[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"paired_incident":{"database":"AI Incident Database","identifier":"1374","title":"Purportedly AI-Generated Sepsis Alert Reportedly Prompted Potentially Inappropriate IV Fluid Administration for a Dialysis Patient, Averted by Clinician Intervention","url":"https://incidentdatabase.ai/cite/1374","group":"organizational","basis":"Both records concern an AI model that flags hospital patients at risk of sepsis, and the hospital that relies on its alerts is the stakeholder in each."}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["paired_incident"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"follow_up[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"human_oversight":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"id":{"state":"value_present","value":{"kind":"record_fields","fields":{"id":"AIBD-0626"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["id"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"infrastructure_dependencies[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiaries":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiary_count":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].benefit_type":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_type":"Improved Task Accuracy"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].claim":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"Prenosis of Chicago developed the Sepsis ImmunoScore, machine learning software that uses up to 22 inputs from the electronic health record to place a patient in one of four sepsis risk categories. The validation study used prospectively collected data and blood samples from patients with suspected sepsis at Beth Israel Deaconess Medical Center in Boston, the Jesse Brown VA in Chicago and Beaumont in Royal Oak, Michigan. Physicians blinded to the score judged whether each patient had sepsis. FDA reviewers report an area under the ROC curve of 0.81 against the majority judgment, above a goal of 0.75. Sepsis was present in 3.02% of the low risk group and 69.70% of the very high risk group. In-hospital death rose from 0% in the low group to 18.18% in the very high group. FDA granted the De Novo request on 2 April 2024. The study was retrospective, so the score did not guide care, and adjudicators worked at the same hospitals as the patients.","benefit_type":"Improved Task Accuracy"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].distribution":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].duration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].id":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].stakeholder_group":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","reason":"The risk categories were measured on retrospective data, and no hospital used the score to change care."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].status":{"state":"value_present","value":{"kind":"text","text":"Intended. The validation applied the score retrospectively to stored data, and the score guided no care, so the sources report no realized benefit."},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["benefit_status"],"source_refs":["AIBD-0626-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Intended. The validation applied the score retrospectively to stored data, and the score guided no care, so the sources report no realized benefit.","inferred":false}},"outcomes[].tradeoffs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].unexpected":{"state":"value_present","value":{"kind":"record_fields","fields":{"unexpected":false,"purpose":"The Sepsis ImmunoScore was built to identify patients at risk of having or developing sepsis within 24 hours. The measured risk stratification is that purpose."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["unexpected","purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"places[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"location":"Boston, Massachusetts; Chicago, Illinois; Royal Oak, Michigan, United States","developer_country":"United States","deployer_country":"United States"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["location","developer_country","deployer_country"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"purpose":{"state":"value_present","value":{"kind":"record_fields","fields":{"purpose":"The Sepsis ImmunoScore was built to identify patients at risk of having or developing sepsis within 24 hours. The measured risk stratification is that purpose."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"record_dates":{"state":"value_present","value":{"kind":"record_fields","fields":{"date_observed":"2024-04-02","date_basis":"source publication","date_precision":"day","revisions":[{"date":"2026-10-29","change":"Added the case.","source":"https://www.accessdata.fda.gov/cdrh_docs/reviews/DEN230036.pdf","editor":"AIBD"},{"date":"2026-10-29","change":"Linked a comparable incident in the AI Incident Database (incident 1374).","source":"https://incidentdatabase.ai/cite/1374","editor":"AIBD"},{"date":"2026-10-29","change":"Corrected the benefit status; revised the depth ratings.","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["date_observed","date_basis","date_precision","revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"replication.attempts[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"replication.conditions":{"state":"value_present","value":{"kind":"record_fields","fields":{"replication":{"produced_by":["The score used up to 22 inputs from the electronic health record, including a blood sample drawn within three hours of the first blood culture order.","Risk thresholds were fixed before the validation study."],"must_hold":["The patient is an adult with suspected sepsis and a blood culture ordered.","Clinicians use the score with other findings and not as the sole basis for a decision."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"revision_history[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"revisions":[{"date":"2026-10-29","change":"Added the case.","source":"https://www.accessdata.fda.gov/cdrh_docs/reviews/DEN230036.pdf","editor":"AIBD"},{"date":"2026-10-29","change":"Linked a comparable incident in the AI Incident Database (incident 1374).","source":"https://incidentdatabase.ai/cite/1374","editor":"AIBD"},{"date":"2026-10-29","change":"Corrected the benefit status; revised the depth ratings.","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sector":{"state":"value_present","value":{"kind":"record_fields","fields":{"domain":"Healthcare"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["domain"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].access_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].citation_locator":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"regulatory document","citation":"U.S. Food and Drug Administration, Center for Devices and Radiological Health. De Novo classification request for Sepsis ImmunoScore (DEN230036): decision summary. Granted 2024-04-02.","title":"De Novo classification request for Sepsis ImmunoScore (DEN230036)","url":"https://www.accessdata.fda.gov/cdrh_docs/reviews/DEN230036.pdf","date":"2024-04-02","written_by":"independent","quote":"The ImmunoScore has demonstrated that an increase in risk score and category is correlated with the increased risk of sepsis."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].id":{"state":"value_present","value":{"kind":"identifiers","identifiers":["AIBD-0626-source-0001"],"role":"Existing evidence items, in their original order"},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"sources[].language":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"regulatory document","citation":"U.S. Food and Drug Administration, Center for Devices and Radiological Health. De Novo classification request for Sepsis ImmunoScore (DEN230036): decision summary. Granted 2024-04-02.","title":"De Novo classification request for Sepsis ImmunoScore (DEN230036)","url":"https://www.accessdata.fda.gov/cdrh_docs/reviews/DEN230036.pdf","date":"2024-04-02","written_by":"independent","quote":"The ImmunoScore has demonstrated that an increase in risk score and category is correlated with the increased risk of sepsis."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].upstream_sources":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"strategic_assessments[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"strategic assessments"},"summary":{"state":"value_present","value":{"kind":"record_fields","fields":{"summary":"In FDA's review of the Prenosis Sepsis ImmunoScore, sepsis within 24 hours rose from 3.02% in its low risk category to 69.70% in its very high category; AUROC was 0.81.","account":"Prenosis of Chicago developed the Sepsis ImmunoScore, machine learning software that uses up to 22 inputs from the electronic health record to place a patient in one of four sepsis risk categories. The validation study used prospectively collected data and blood samples from patients with suspected sepsis at Beth Israel Deaconess Medical Center in Boston, the Jesse Brown VA in Chicago and Beaumont in Royal Oak, Michigan. Physicians blinded to the score judged whether each patient had sepsis. FDA reviewers report an area under the ROC curve of 0.81 against the majority judgment, above a goal of 0.75. Sepsis was present in 3.02% of the low risk group and 69.70% of the very high risk group. In-hospital death rose from 0% in the low group to 18.18% in the very high group. FDA granted the De Novo request on 2 April 2024. The study was retrospective, so the score did not guide care, and adjudicators worked at the same hospitals as the patients."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["summary","account"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].autonomy_permissions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].component_role":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].deployment_configuration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].inputs_outputs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_name":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].product_name":{"state":"value_present","value":{"kind":"record_fields","fields":{"system":"Sepsis ImmunoScore"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["system"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].provider":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"taxonomy_crosswalks[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"title":{"state":"value_present","value":{"kind":"record_fields","fields":{"title":"FDA De Novo review of Prenosis Sepsis ImmunoScore: AI risk categories track sepsis risk in data from three hospitals","headline":"*Sepsis ImmunoScore* sorted patients by sepsis risk in FDA's review"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["title","headline"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"version":{"state":"value_present","value":{"kind":"identifiers","identifiers":["88d1b88b8e1d3ee766fb4960baacfa8e1c935ca37f5c7bb23f564cfd4e0e9d2f"],"role":"SHA-256 of the complete public case and its assessments"},"provenance":{"kind":"curatorial","basis":"SHA-256 of the public case, its assessments, and its displayed answers and notes, excluding its own identifier and the derived coverage summary.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"workflow":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"Prenosis of Chicago developed the Sepsis ImmunoScore, machine learning software that uses up to 22 inputs from the electronic health record to place a patient in one of four sepsis risk categories. The validation study used prospectively collected data and blood samples from patients with suspected sepsis at Beth Israel Deaconess Medical Center in Boston, the Jesse Brown VA in Chicago and Beaumont in Royal Oak, Michigan. Physicians blinded to the score judged whether each patient had sepsis. FDA reviewers report an area under the ROC curve of 0.81 against the majority judgment, above a goal of 0.75. Sepsis was present in 3.02% of the low risk group and 69.70% of the very high risk group. In-hospital death rose from 0% in the low group to 18.18% in the very high group. FDA granted the De Novo request on 2 April 2024. The study was retrospective, so the score did not guide care, and adjudicators worked at the same hospitals as the patients.","replication":{"produced_by":["The score used up to 22 inputs from the electronic health record, including a blood sample drawn within three hours of the first blood culture order.","Risk thresholds were fixed before the validation study."],"must_hold":["The patient is an adult with suspected sepsis and a blood culture ordered.","Clinicians use the score with other findings and not as the sole basis for a decision."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"}},"summary":{"total":91,"addressed":91,"known":42,"reviewed":17,"reviewed_complete":17,"reviewed_partial":0,"record_mapped":25,"review_not_assessed":49,"not_assessed":0,"complete":false,"by_state":{"value_present":42,"not_reported":0,"unresolved":49,"not_assessed":0,"not_applicable":0,"withheld":0,"source_unavailable":0}}},"presentation_version":"1d6e261b1928b4d7ce8fb3081ac66c12e47418cb8f853e0082b87fa857d2d4f6"}
