{"id":"AIBD-1030","title":"Andalusia's assessment agency AETSA finds that ejection fractions from four AI echocardiography assistants agree with expert measurement","summary":"AETSA reviewed five studies of four AI echocardiography assistants. It found that their ejection fractions agreed with manual expert measurement, with no systematic error identified.","date_observed":"2024-01-01","date_basis":"source publication","date_precision":"year","benefit_status":"reported","source_collection":null,"source_entry":null,"account":"AETSA, the health technology assessment agency of Andalusia, assessed AI assistants for echocardiography in 2024 for Spain's network of assessment agencies. The four systems were Caption Guidance, Real-Time EF, LVivo Seamless and AI TRIO. AETSA writes that they were trained on millions of echocardiographic images annotated by experts. It included five prospective validation studies from the United States, Germany, Tunisia and Portugal, found in searches up to February 2024. In four studies, nurses or residents without echocardiography experience scanned patients with the AI's help. In the German study, LVivo Seamless analyzed images that a cardiologist had taken. AETSA found that ejection fractions from the four systems agreed with manual expert measurement, with no systematic error identified. The intraclass correlation was 0.84 for Caption Guidance in one study and 0.68 for AI TRIO in another. In one study, nurses' scans were good enough to assess the left ventricle in 98.8% of cases. AETSA notes risks of bias, small samples and a lack of long-term studies. It found no economic evaluations and no data on use in Europe.","category":"aggregate result","unexpected":false,"purpose":"Caption Health, GE HealthCare, DIA Imaging Analysis and EchoNous built Caption Guidance, Real-Time EF, LVivo Seamless and AI TRIO to help users without expert training perform echocardiography. The systems also compute the left ventricular ejection fraction automatically.","system":"AI echocardiography assistants: Caption Guidance, Real-Time EF, LVivo Seamless and AI TRIO","model_version":null,"developer":"Caption Health (Caption Guidance), GE HealthCare (Real-Time EF), DIA Imaging Analysis (LVivo Seamless) and EchoNous (AI TRIO)","deployer":"Hospitals in the five validation studies that AETSA reviewed, in the United States, Germany, Tunisia and Portugal","location":"United States, Germany, Tunisia and Portugal (studies), assessed for Spain","domain":"Healthcare (cardiology)","segment":null,"benefit_type":"Improved Task Accuracy","work_activities":["4.A.1.b.3","4.A.4.b.3"],"taxonomy_note":null,"registry_ids":{},"ratings":[{"group":"organizational","depth":2,"reason":"In the studies that AETSA reviewed, ejection fractions from the four systems agreed with expert measurement, with usable nurse scans in 98.8% of cases in one study."},{"group":"societal","depth":null,"reason":"AETSA found no data on use of the systems in Europe and no long-term studies of their diagnostic validity."}],"ai_role":{"status":"unassessed","statement":"The studies compared ejection fractions from the AI systems with manual expert measurement, which tests the systems' accuracy. They did not compare diagnoses or care with and without the systems. In the German study, the software analyzed images that a cardiologist had taken. AETSA describes Caption Guidance and AI TRIO as deep learning and the other two as neural networks."},"evidence":[{"kind":"assessment report","citation":"AETSA, Evaluación de Tecnologías Sanitarias de Andalucía (Maesa Márquez JM, Isabel Gómez R). Sistema de identificación de enfermedades cardiacas basado en ecografía e inteligencia artificial. Ficha de evaluación de tecnologías sanitarias nuevas y emergentes, RedETS and Ministerio de Sanidad, Sevilla, 2024. Puntos clave, p. 53.","title":"Sistema de identificación de enfermedades cardiacas basado en ecografía e inteligencia artificial","url":"https://redets.sanidad.gob.es/productos/buscarProductos.do?metodo=descargarFichero&idProducto=1268","date":null,"written_by":"independent","quote":"Los trabajos incluidos determinan la existencia de concordancia entre la FEVI determinada por los cuatro sistemas de IA y las obtenidas manualmente por el método de referencia, sin identificarse ningún error sistemático."}],"replication":{"produced_by":["Nurses or residents without echocardiography experience scanned patients, after one hour of training in one study and one day in another.","The software guided the probe and judged image quality, except LVivo Seamless, which analyzed stored images.","The software computed the ejection fraction automatically from the apical views."],"must_hold":["The software must run on compatible scanners, such as the Terason uSmart 3200T Plus for Caption Guidance and the Venue for Real-Time EF.","Expert cardiologists must supervise use, since AETSA writes that the results should not replace a specialist's diagnosis."],"echoes":[]},"paired_incident":null,"headline":"*AI echocardiography assistants* match experts' ejection fractions","metric":"intraclass correlation was 0.84 for Caption Guidance","comparator":{"against":"Manual measurement of the ejection fraction by expert echocardiographers or cardiologists with the modified Simpson method","before":null,"after":"concordancia entre la FEVI determinada por los cuatro sistemas de IA y las obtenidas manualmente por el método de referencia","basis":"measured","quote":"Estos estudios establecen una comparación entre estos sistemas de IA utilizados por personal no experto, y el mismo tipo de estudio realizado por expertos ecocardiografistas o cardiólogos.","url":"https://redets.sanidad.gob.es/productos/buscarProductos.do?metodo=descargarFichero&idProducto=1268"},"later":null,"value":null,"developer_country":"Multiple: United States, Israel","deployer_country":"Multiple: United States, Germany, Tunisia, Portugal","unrated_because":null,"brief_notes":null,"brief":null,"revisions":[{"date":"2026-11-01","change":"Added the record from the finding of AETSA, Evaluación de Tecnologías Sanitarias de Andalucía.","source":"https://redets.sanidad.gob.es/productos/buscarProductos.do?metodo=descargarFichero&idProducto=1268","editor":"AIBD"}],"confidence":"found","shade":"high","claim_status":"Found by an assessment body","claim_basis":"Sources: one independent assessment report. The cited evidence includes no independent study or report.","case_jurisdictions":["United States","Germany","Tunisia","Portugal","Spain"],"profile":{"case_id":"AIBD-1030","catalog_version":"1.0.0","source_fingerprint":"51dc6c6bd028d6b5b6caecefe853c362455ab88c1ab6aa892c3242c9a82e8b2d","collection_refs":[{"collection_id":"aibd","version":"2026-10-31"},{"collection_id":"querist","version":"2026-10-25"}],"source_ids":["AIBD-1030-source-0001"],"families":{"strategic assessments":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"evaluations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"monetary observations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"institutional decisions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]}},"fields":{"actors[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"developer":"Caption Health (Caption Guidance), GE HealthCare (Real-Time EF), DIA Imaging Analysis (LVivo Seamless) and EchoNous (AI TRIO)","deployer":"Hospitals in the five validation studies that AETSA reviewed, in the United States, Germany, Tunisia and Portugal"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["developer","deployer"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"actors[].ownership_control":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"ai_contribution":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"ai_relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"category":"aggregate result","ai_role":{"status":"unassessed","statement":"The studies compared ejection fractions from the AI systems with manual expert measurement, which tests the systems' accuracy. They did not compare diagnoses or care with and without the systems. In the German study, the software analyzed images that a cardiologist had taken. AETSA describes Caption Guidance and AI TRIO as deep learning and the other two as neural networks."}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ai_role","category"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].alternatives":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].assessor_date":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].depth":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":2,"reason":"In the studies that AETSA reviewed, ejection fractions from the four systems agreed with expert measurement, with usable nurse scans in 98.8% of cases in one study."},{"group":"societal","reason":"AETSA found no data on use of the systems in Europe and no long-term studies of their diagnostic validity."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].display_confidence":{"state":"value_present","value":{"kind":"structured","data":{"confidence":"high","evidence_word":"found","claim_status":"Found by an assessment body","basis":"Sources: one independent assessment report. The cited evidence includes no independent study or report.","interpretation":"Existing display rule preserved; the richer outcome-specific confidence question still needs review."}},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rationale":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":2,"reason":"In the studies that AETSA reviewed, ejection fractions from the four systems agreed with expert measurement, with usable nurse scans in 98.8% of cases in one study."},{"group":"societal","reason":"AETSA found no data on use of the systems in Europe and no long-term studies of their diagnostic validity."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rubric_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].status_basis":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].target":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":2,"reason":"In the studies that AETSA reviewed, ejection fractions from the four systems agreed with expert measurement, with usable nurse scans in 98.8% of cases in one study."},{"group":"societal","reason":"AETSA found no data on use of the systems in Europe and no long-term studies of their diagnostic validity."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"availability":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"brief":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_kind":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_links[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_links":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_strength":{"state":"value_present","value":{"kind":"structured","data":{"answer":"Found by an assessment body. Sources: one independent assessment report. The cited evidence includes no independent study or report.","evidence_word":"found","claim_status":"Found by an assessment body"}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-1030-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Found by an assessment body. Sources: one independent assessment report. The cited evidence includes no independent study or report.","inferred":false}},"claims[].missingness":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].proposition":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"cross_border_flows[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"decisions[].action_outcome":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].grounds":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].institution_task":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].success_criterion":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"deployment_stage":{"state":"value_present","value":{"kind":"structured","data":{"classification":"pilot","answer":"The system was used in a pilot. The evidence comes from prospective validation studies in hospitals, with no data on routine use in Europe.","scope":"The period and activity described in the case."}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["account","evidence"],"source_refs":["AIBD-1030-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"The system was used in a pilot. The evidence comes from prospective validation studies in hospitals, with no data on routine use in Europe.","inferred":false}},"economics[].amount":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].costs[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].counterfactual":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].currency_price_basis":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].gross_net":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].measure_type":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].period_unit":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].realization":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].recipient_payer":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].return_payback":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].valuation_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"evaluations[].ai_uplift":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].comparator":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].design":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].effect":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].exposure":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].id":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].measurement_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].metric":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].reproduction_materials":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].setting_sample":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].uncertainty_limitations":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"external_references[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"follow_up[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"human_oversight":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"id":{"state":"value_present","value":{"kind":"record_fields","fields":{"id":"AIBD-1030"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["id"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"infrastructure_dependencies[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiaries":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiary_count":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].benefit_type":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_type":"Improved Task Accuracy"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].claim":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"AETSA, the health technology assessment agency of Andalusia, assessed AI assistants for echocardiography in 2024 for Spain's network of assessment agencies. The four systems were Caption Guidance, Real-Time EF, LVivo Seamless and AI TRIO. AETSA writes that they were trained on millions of echocardiographic images annotated by experts. It included five prospective validation studies from the United States, Germany, Tunisia and Portugal, found in searches up to February 2024. In four studies, nurses or residents without echocardiography experience scanned patients with the AI's help. In the German study, LVivo Seamless analyzed images that a cardiologist had taken. AETSA found that ejection fractions from the four systems agreed with manual expert measurement, with no systematic error identified. The intraclass correlation was 0.84 for Caption Guidance in one study and 0.68 for AI TRIO in another. In one study, nurses' scans were good enough to assess the left ventricle in 98.8% of cases. AETSA notes risks of bias, small samples and a lack of long-term studies. It found no economic evaluations and no data on use in Europe.","benefit_type":"Improved Task Accuracy"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].distribution":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].duration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].id":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].stakeholder_group":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":2,"reason":"In the studies that AETSA reviewed, ejection fractions from the four systems agreed with expert measurement, with usable nurse scans in 98.8% of cases in one study."},{"group":"societal","reason":"AETSA found no data on use of the systems in Europe and no long-term studies of their diagnostic validity."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].status":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_status":"reported"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_status"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].tradeoffs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].unexpected":{"state":"value_present","value":{"kind":"record_fields","fields":{"unexpected":false,"purpose":"Caption Health, GE HealthCare, DIA Imaging Analysis and EchoNous built Caption Guidance, Real-Time EF, LVivo Seamless and AI TRIO to help users without expert training perform echocardiography. The systems also compute the left ventricular ejection fraction automatically."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["unexpected","purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"places[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"location":"United States, Germany, Tunisia and Portugal (studies), assessed for Spain","developer_country":"Multiple: United States, Israel","deployer_country":"Multiple: United States, Germany, Tunisia, Portugal"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["location","developer_country","deployer_country"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"purpose":{"state":"value_present","value":{"kind":"record_fields","fields":{"purpose":"Caption Health, GE HealthCare, DIA Imaging Analysis and EchoNous built Caption Guidance, Real-Time EF, LVivo Seamless and AI TRIO to help users without expert training perform echocardiography. The systems also compute the left ventricular ejection fraction automatically."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"record_dates":{"state":"value_present","value":{"kind":"record_fields","fields":{"date_observed":"2024-01-01","date_basis":"source publication","date_precision":"year","revisions":[{"date":"2026-11-01","change":"Added the record from the finding of AETSA, Evaluación de Tecnologías Sanitarias de Andalucía.","source":"https://redets.sanidad.gob.es/productos/buscarProductos.do?metodo=descargarFichero&idProducto=1268","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["date_observed","date_basis","date_precision","revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"replication.attempts[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"replication.conditions":{"state":"value_present","value":{"kind":"record_fields","fields":{"replication":{"produced_by":["Nurses or residents without echocardiography experience scanned patients, after one hour of training in one study and one day in another.","The software guided the probe and judged image quality, except LVivo Seamless, which analyzed stored images.","The software computed the ejection fraction automatically from the apical views."],"must_hold":["The software must run on compatible scanners, such as the Terason uSmart 3200T Plus for Caption Guidance and the Venue for Real-Time EF.","Expert cardiologists must supervise use, since AETSA writes that the results should not replace a specialist's diagnosis."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"revision_history[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"revisions":[{"date":"2026-11-01","change":"Added the record from the finding of AETSA, Evaluación de Tecnologías Sanitarias de Andalucía.","source":"https://redets.sanidad.gob.es/productos/buscarProductos.do?metodo=descargarFichero&idProducto=1268","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sector":{"state":"value_present","value":{"kind":"record_fields","fields":{"domain":"Healthcare (cardiology)"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["domain"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].access_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].citation_locator":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"assessment report","citation":"AETSA, Evaluación de Tecnologías Sanitarias de Andalucía (Maesa Márquez JM, Isabel Gómez R). Sistema de identificación de enfermedades cardiacas basado en ecografía e inteligencia artificial. Ficha de evaluación de tecnologías sanitarias nuevas y emergentes, RedETS and Ministerio de Sanidad, Sevilla, 2024. Puntos clave, p. 53.","title":"Sistema de identificación de enfermedades cardiacas basado en ecografía e inteligencia artificial","url":"https://redets.sanidad.gob.es/productos/buscarProductos.do?metodo=descargarFichero&idProducto=1268","written_by":"independent","quote":"Los trabajos incluidos determinan la existencia de concordancia entre la FEVI determinada por los cuatro sistemas de IA y las obtenidas manualmente por el método de referencia, sin identificarse ningún error sistemático."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].id":{"state":"value_present","value":{"kind":"identifiers","identifiers":["AIBD-1030-source-0001"],"role":"Existing evidence items, in their original order"},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"sources[].language":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"assessment report","citation":"AETSA, Evaluación de Tecnologías Sanitarias de Andalucía (Maesa Márquez JM, Isabel Gómez R). Sistema de identificación de enfermedades cardiacas basado en ecografía e inteligencia artificial. Ficha de evaluación de tecnologías sanitarias nuevas y emergentes, RedETS and Ministerio de Sanidad, Sevilla, 2024. Puntos clave, p. 53.","title":"Sistema de identificación de enfermedades cardiacas basado en ecografía e inteligencia artificial","url":"https://redets.sanidad.gob.es/productos/buscarProductos.do?metodo=descargarFichero&idProducto=1268","written_by":"independent","quote":"Los trabajos incluidos determinan la existencia de concordancia entre la FEVI determinada por los cuatro sistemas de IA y las obtenidas manualmente por el método de referencia, sin identificarse ningún error sistemático."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].upstream_sources":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"strategic_assessments[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"strategic assessments"},"summary":{"state":"value_present","value":{"kind":"record_fields","fields":{"summary":"AETSA reviewed five studies of four AI echocardiography assistants. It found that their ejection fractions agreed with manual expert measurement, with no systematic error identified.","account":"AETSA, the health technology assessment agency of Andalusia, assessed AI assistants for echocardiography in 2024 for Spain's network of assessment agencies. The four systems were Caption Guidance, Real-Time EF, LVivo Seamless and AI TRIO. AETSA writes that they were trained on millions of echocardiographic images annotated by experts. It included five prospective validation studies from the United States, Germany, Tunisia and Portugal, found in searches up to February 2024. In four studies, nurses or residents without echocardiography experience scanned patients with the AI's help. In the German study, LVivo Seamless analyzed images that a cardiologist had taken. AETSA found that ejection fractions from the four systems agreed with manual expert measurement, with no systematic error identified. The intraclass correlation was 0.84 for Caption Guidance in one study and 0.68 for AI TRIO in another. In one study, nurses' scans were good enough to assess the left ventricle in 98.8% of cases. AETSA notes risks of bias, small samples and a lack of long-term studies. It found no economic evaluations and no data on use in Europe."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["summary","account"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].autonomy_permissions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].component_role":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].deployment_configuration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].inputs_outputs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_name":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].product_name":{"state":"value_present","value":{"kind":"record_fields","fields":{"system":"AI echocardiography assistants: Caption Guidance, Real-Time EF, LVivo Seamless and AI TRIO"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["system"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].provider":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"taxonomy_crosswalks[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"title":{"state":"value_present","value":{"kind":"record_fields","fields":{"title":"Andalusia's assessment agency AETSA finds that ejection fractions from four AI echocardiography assistants agree with expert measurement","headline":"*AI echocardiography assistants* match experts' ejection fractions"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["title","headline"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"version":{"state":"value_present","value":{"kind":"identifiers","identifiers":["5aad4bd41150325173525d104a09a0858c3935f26db59c7610c7770cd42a5026"],"role":"SHA-256 of the complete public record and its assessments"},"provenance":{"kind":"curatorial","basis":"SHA-256 of the public record, its assessments, and its displayed answers and notes, excluding its own identifier and the derived coverage summary.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"workflow":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"AETSA, the health technology assessment agency of Andalusia, assessed AI assistants for echocardiography in 2024 for Spain's network of assessment agencies. The four systems were Caption Guidance, Real-Time EF, LVivo Seamless and AI TRIO. AETSA writes that they were trained on millions of echocardiographic images annotated by experts. It included five prospective validation studies from the United States, Germany, Tunisia and Portugal, found in searches up to February 2024. In four studies, nurses or residents without echocardiography experience scanned patients with the AI's help. In the German study, LVivo Seamless analyzed images that a cardiologist had taken. AETSA found that ejection fractions from the four systems agreed with manual expert measurement, with no systematic error identified. The intraclass correlation was 0.84 for Caption Guidance in one study and 0.68 for AI TRIO in another. In one study, nurses' scans were good enough to assess the left ventricle in 98.8% of cases. AETSA notes risks of bias, small samples and a lack of long-term studies. It found no economic evaluations and no data on use in Europe.","replication":{"produced_by":["Nurses or residents without echocardiography experience scanned patients, after one hour of training in one study and one day in another.","The software guided the probe and judged image quality, except LVivo Seamless, which analyzed stored images.","The software computed the ejection fraction automatically from the apical views."],"must_hold":["The software must run on compatible scanners, such as the Terason uSmart 3200T Plus for Caption Guidance and the Venue for Real-Time EF.","Expert cardiologists must supervise use, since AETSA writes that the results should not replace a specialist's diagnosis."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"}},"summary":{"total":91,"addressed":91,"known":28,"reviewed":2,"reviewed_complete":2,"reviewed_partial":0,"record_mapped":26,"review_not_assessed":63,"not_assessed":0,"complete":false,"by_state":{"value_present":28,"not_reported":0,"unresolved":63,"not_assessed":0,"not_applicable":0,"withheld":0,"source_unavailable":0}}},"presentation_version":"35f3ad54970a9156453402d193b9c2284de6951c384d771a72de4cf5a3b5ab6c"}