{"id":"AIBD-1128","title":"GAO reports that the hurricane intensity model SHIPS was the best of 48 models for Pacific hurricanes at longer lead times in 2021","summary":"GAO reports that SHIPS, which the National Hurricane Center uses for intensity forecasts, was the best of 48 models at longer lead times for Pacific hurricanes in 2021.","date_observed":"2021-01-01","date_basis":"event","date_precision":"year","benefit_status":"reported","source_collection":null,"source_entry":null,"account":"NOAA's Hurricane Research Division developed the Statistical Hurricane Intensity Prediction Scheme (SHIPS), which first ran in real time in 1990. Its developers write that it uses a linear regression technique with predictors from climatology, persistence, the atmosphere and the ocean. In a technology assessment dated 14 December 2023, the U.S. Government Accountability Office (GAO) states that SHIPS outperformed most operational hurricane intensity models through the mid-2010s. GAO reports that in 2021 it was the best of 48 models evaluated by the National Hurricane Center (NHC) at longer lead times for Pacific hurricanes. GAO writes that SHIPS uses a simple form of machine learning to predict rapid intensification. GAO did not verify the forecasts. It relays the results of NHC, which uses SHIPS. NHC's report of 25 April 2022 states that SHIPS with inland decay was the best individual model at the longer forecast periods in the eastern North Pacific. Its comparison table covers six individual models and four consensus aids. The ranking covers one season in one basin. No source measures how SHIPS changed NHC's official forecasts or warnings.","category":"aggregate result","unexpected":false,"purpose":"NOAA's Hurricane Research Division built SHIPS to give the National Hurricane Center objective guidance for predicting the intensity of tropical cyclones.","system":"Statistical Hurricane Intensity Prediction Scheme (SHIPS)","model_version":null,"developer":"NOAA Hurricane Research Division (John Kaplan and Mark DeMaria), with later work by NOAA/NESDIS and the Cooperative Institute for Research in the Atmosphere, Colorado State University","deployer":"NOAA National Hurricane Center","location":"Eastern North Pacific basin, with forecasts from the National Hurricane Center in Miami, Florida, United States","domain":"Weather forecasting / tropical cyclones","segment":null,"benefit_type":"Improved Task Accuracy","work_activities":["4.A.1.b.3"],"taxonomy_note":null,"registry_ids":{},"ratings":[{"group":"organizational","depth":2,"reason":"GAO reports that SHIPS gave the best intensity guidance of 48 models for Pacific hurricanes at longer lead times in 2021, and NHC forecasters use that guidance."},{"group":"societal","depth":null,"reason":"No source links the guidance to changes in NHC's warnings or to outcomes for people in the storms' paths."}],"ai_role":{"status":"unassessed","statement":"The ranking compares the forecasts of SHIPS with those of other models, which measures the model's own skill. No source compares NHC's official forecasts made with and without SHIPS. The developers describe a linear regression technique, and GAO writes that SHIPS uses a simple form of machine learning."},"evidence":[{"kind":"descriptive report","citation":"U.S. Government Accountability Office. Artificial Intelligence in Natural Hazard Modeling: Severe Storms, Hurricanes, Floods, and Wildfires. Technology assessment GAO-24-106213, 14 December 2023, p. 25.","title":"Artificial Intelligence in Natural Hazard Modeling: Severe Storms, Hurricanes, Floods, and Wildfires","url":"https://web.archive.org/web/2026id_/https://www.gao.gov/assets/d24106213.pdf","date":"2023-12-14","written_by":"independent","quote":"SHIPS has historically outperformed most operational hurricane intensity models through the mid-2010s and still provide skillful intensity guidance. In 2021, it was the best of 48 models evaluated by the National Hurricane Center at providing intensity guidance for hurricanes in the Pacific at longer lead times."},{"kind":"report","citation":"Cangialosi, J. P. National Hurricane Center Forecast Verification Report: 2021 Hurricane Season. NOAA National Hurricane Center, 25 April 2022, p. 13.","title":"National Hurricane Center Forecast Verification Report: 2021 Hurricane Season","url":"https://www.nhc.noaa.gov/verification/pdfs/Verification_2021.pdf","date":"2022-04-25","written_by":"deployer","quote":"Among the individual models, HMNI was the best performer for the short lead times while DSHP was best at the longer forecast periods."},{"kind":"descriptive report","citation":"Regional and Mesoscale Meteorology Branch (NOAA/NESDIS) and Cooperative Institute for Research in the Atmosphere, Colorado State University. Statistical Tropical Cyclone Intensity Forecast Technique Development. Web page, undated, checked 1 November 2026.","title":"Statistical Tropical Cyclone Intensity Forecast Technique Development","url":"https://rammb2.cira.colostate.edu/research/tropical-cyclones/ships/","date":null,"written_by":"makers","quote":"The SHIPS and STIPS models use a linear regression technique, with the impacts of land applied as a correction in a post-processing step.","supports_benefit":false}],"replication":{"produced_by":["SHIPS combined predictors from climatology, persistence, the atmosphere and the ocean to forecast changes in maximum sustained winds.","The National Hurricane Center used SHIPS with other models to help forecasters predict hurricane intensity.","NHC compared the intensity models in a homogeneous verification of the 2021 eastern North Pacific season."],"must_hold":["Atmospheric forecast models must supply the predictors.","Storms must not intensify rapidly, since SHIPS forecasts have not performed well in those cases."],"echoes":[]},"paired_incident":null,"headline":"*SHIPS* gave the best long-range Pacific intensity guidance in 2021","metric":"the best of 48 models at longer lead times","comparator":{"against":"Other intensity models evaluated by the National Hurricane Center in 2021","before":null,"after":"Best of 48 models at longer lead times for Pacific hurricanes","basis":"measured","quote":"In 2021, it was the best of 48 models evaluated by the National Hurricane Center at providing intensity guidance for hurricanes in the Pacific at longer lead times.","url":"https://web.archive.org/web/2026id_/https://www.gao.gov/assets/d24106213.pdf"},"later":null,"value":null,"developer_country":"United States","deployer_country":"United States","unrated_because":null,"brief_notes":null,"brief":null,"revisions":[{"date":"2026-11-01","change":"Added the record from the report of the U.S. Government Accountability Office.","source":"https://web.archive.org/web/2026id_/https://www.gao.gov/assets/d24106213.pdf","editor":"AIBD"}],"confidence":"reported","shade":"medium","claim_status":"Independently reported","claim_basis":"Sources: one independent descriptive report, the makers' descriptive report and the deployer's report. For the benefit itself, the cited sources include no independent study of the benefit and no finding by an external body.","case_jurisdictions":["United States"],"profile":{"case_id":"AIBD-1128","catalog_version":"1.0.0","source_fingerprint":"4038844ea9d33f64eba530922a0f60872bd0f8c61feaffbc80df99d7149b06f4","collection_refs":[{"collection_id":"aibd","version":"2026-10-31"}],"source_ids":["AIBD-1128-source-0001","AIBD-1128-source-0002","AIBD-1128-source-0003"],"families":{"strategic assessments":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"evaluations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"monetary observations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"institutional decisions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]}},"fields":{"actors[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"developer":"NOAA Hurricane Research Division (John Kaplan and Mark DeMaria), with later work by NOAA/NESDIS and the Cooperative Institute for Research in the Atmosphere, Colorado State University","deployer":"NOAA National Hurricane Center"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["developer","deployer"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"actors[].ownership_control":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"ai_contribution":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"ai_relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"category":"aggregate result","ai_role":{"status":"unassessed","statement":"The ranking compares the forecasts of SHIPS with those of other models, which measures the model's own skill. No source compares NHC's official forecasts made with and without SHIPS. The developers describe a linear regression technique, and GAO writes that SHIPS uses a simple form of machine learning."}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ai_role","category"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].alternatives":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].assessor_date":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].depth":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":2,"reason":"GAO reports that SHIPS gave the best intensity guidance of 48 models for Pacific hurricanes at longer lead times in 2021, and NHC forecasters use that guidance."},{"group":"societal","reason":"No source links the guidance to changes in NHC's warnings or to outcomes for people in the storms' paths."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].display_confidence":{"state":"value_present","value":{"kind":"structured","data":{"confidence":"medium","evidence_word":"reported","claim_status":"Independently reported","basis":"Sources: one independent descriptive report, the makers' descriptive report and the deployer's report. For the benefit itself, the cited sources include no independent study of the benefit and no finding by an external body.","interpretation":"Existing display rule preserved; the richer outcome-specific confidence question still needs review."}},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rationale":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":2,"reason":"GAO reports that SHIPS gave the best intensity guidance of 48 models for Pacific hurricanes at longer lead times in 2021, and NHC forecasters use that guidance."},{"group":"societal","reason":"No source links the guidance to changes in NHC's warnings or to outcomes for people in the storms' paths."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rubric_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].status_basis":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].target":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":2,"reason":"GAO reports that SHIPS gave the best intensity guidance of 48 models for Pacific hurricanes at longer lead times in 2021, and NHC forecasters use that guidance."},{"group":"societal","reason":"No source links the guidance to changes in NHC's warnings or to outcomes for people in the storms' paths."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"availability":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"brief":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_kind":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_links[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_links":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_strength":{"state":"value_present","value":{"kind":"structured","data":{"answer":"Independently reported. Sources: one independent descriptive report, the makers' descriptive report and the deployer's report. For the benefit itself, the cited sources include no independent study of the benefit and no finding by an external body.","evidence_word":"reported","claim_status":"Independently reported"}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-1128-source-0001","AIBD-1128-source-0002","AIBD-1128-source-0003"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Independently reported. Sources: one independent descriptive report, the makers' descriptive report and the deployer's report. For the benefit itself, the cited sources include no independent study of the benefit and no finding by an external body.","inferred":false}},"claims[].missingness":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].proposition":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"cross_border_flows[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"decisions[].action_outcome":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].grounds":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].institution_task":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].success_criterion":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"deployment_stage":{"state":"value_present","value":{"kind":"structured","data":{"classification":"routine use","answer":"The system was in routine use. GAO states that the National Hurricane Center currently uses SHIPS, along with other models, to help forecasters predict hurricane intensity.","scope":"The period and activity described in the case."}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["account","evidence"],"source_refs":["AIBD-1128-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"The system was in routine use. GAO states that the National Hurricane Center currently uses SHIPS, along with other models, to help forecasters predict hurricane intensity.","inferred":false}},"economics[].amount":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].costs[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].counterfactual":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].currency_price_basis":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].gross_net":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].measure_type":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].period_unit":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].realization":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].recipient_payer":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].return_payback":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].valuation_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"evaluations[].ai_uplift":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].comparator":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].design":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].effect":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].exposure":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].id":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].measurement_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].metric":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].reproduction_materials":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].setting_sample":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].uncertainty_limitations":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"external_references[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"follow_up[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"human_oversight":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"id":{"state":"value_present","value":{"kind":"record_fields","fields":{"id":"AIBD-1128"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["id"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"infrastructure_dependencies[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiaries":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiary_count":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].benefit_type":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_type":"Improved Task Accuracy"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].claim":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"NOAA's Hurricane Research Division developed the Statistical Hurricane Intensity Prediction Scheme (SHIPS), which first ran in real time in 1990. Its developers write that it uses a linear regression technique with predictors from climatology, persistence, the atmosphere and the ocean. In a technology assessment dated 14 December 2023, the U.S. Government Accountability Office (GAO) states that SHIPS outperformed most operational hurricane intensity models through the mid-2010s. GAO reports that in 2021 it was the best of 48 models evaluated by the National Hurricane Center (NHC) at longer lead times for Pacific hurricanes. GAO writes that SHIPS uses a simple form of machine learning to predict rapid intensification. GAO did not verify the forecasts. It relays the results of NHC, which uses SHIPS. NHC's report of 25 April 2022 states that SHIPS with inland decay was the best individual model at the longer forecast periods in the eastern North Pacific. Its comparison table covers six individual models and four consensus aids. The ranking covers one season in one basin. No source measures how SHIPS changed NHC's official forecasts or warnings.","benefit_type":"Improved Task Accuracy"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].distribution":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].duration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].id":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].stakeholder_group":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":2,"reason":"GAO reports that SHIPS gave the best intensity guidance of 48 models for Pacific hurricanes at longer lead times in 2021, and NHC forecasters use that guidance."},{"group":"societal","reason":"No source links the guidance to changes in NHC's warnings or to outcomes for people in the storms' paths."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].status":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_status":"reported"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_status"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].tradeoffs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].unexpected":{"state":"value_present","value":{"kind":"record_fields","fields":{"unexpected":false,"purpose":"NOAA's Hurricane Research Division built SHIPS to give the National Hurricane Center objective guidance for predicting the intensity of tropical cyclones."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["unexpected","purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"places[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"location":"Eastern North Pacific basin, with forecasts from the National Hurricane Center in Miami, Florida, United States","developer_country":"United States","deployer_country":"United States"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["location","developer_country","deployer_country"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"purpose":{"state":"value_present","value":{"kind":"record_fields","fields":{"purpose":"NOAA's Hurricane Research Division built SHIPS to give the National Hurricane Center objective guidance for predicting the intensity of tropical cyclones."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"record_dates":{"state":"value_present","value":{"kind":"record_fields","fields":{"date_observed":"2021-01-01","date_basis":"event","date_precision":"year","revisions":[{"date":"2026-11-01","change":"Added the record from the report of the U.S. Government Accountability Office.","source":"https://web.archive.org/web/2026id_/https://www.gao.gov/assets/d24106213.pdf","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["date_observed","date_basis","date_precision","revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"replication.attempts[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"replication.conditions":{"state":"value_present","value":{"kind":"record_fields","fields":{"replication":{"produced_by":["SHIPS combined predictors from climatology, persistence, the atmosphere and the ocean to forecast changes in maximum sustained winds.","The National Hurricane Center used SHIPS with other models to help forecasters predict hurricane intensity.","NHC compared the intensity models in a homogeneous verification of the 2021 eastern North Pacific season."],"must_hold":["Atmospheric forecast models must supply the predictors.","Storms must not intensify rapidly, since SHIPS forecasts have not performed well in those cases."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"revision_history[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"revisions":[{"date":"2026-11-01","change":"Added the record from the report of the U.S. Government Accountability Office.","source":"https://web.archive.org/web/2026id_/https://www.gao.gov/assets/d24106213.pdf","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sector":{"state":"value_present","value":{"kind":"record_fields","fields":{"domain":"Weather forecasting / tropical cyclones"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["domain"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].access_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].citation_locator":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"descriptive report","citation":"U.S. Government Accountability Office. Artificial Intelligence in Natural Hazard Modeling: Severe Storms, Hurricanes, Floods, and Wildfires. Technology assessment GAO-24-106213, 14 December 2023, p. 25.","title":"Artificial Intelligence in Natural Hazard Modeling: Severe Storms, Hurricanes, Floods, and Wildfires","url":"https://web.archive.org/web/2026id_/https://www.gao.gov/assets/d24106213.pdf","date":"2023-12-14","written_by":"independent","quote":"SHIPS has historically outperformed most operational hurricane intensity models through the mid-2010s and still provide skillful intensity guidance. In 2021, it was the best of 48 models evaluated by the National Hurricane Center at providing intensity guidance for hurricanes in the Pacific at longer lead times."},{"kind":"report","citation":"Cangialosi, J. P. National Hurricane Center Forecast Verification Report: 2021 Hurricane Season. NOAA National Hurricane Center, 25 April 2022, p. 13.","title":"National Hurricane Center Forecast Verification Report: 2021 Hurricane Season","url":"https://www.nhc.noaa.gov/verification/pdfs/Verification_2021.pdf","date":"2022-04-25","written_by":"deployer","quote":"Among the individual models, HMNI was the best performer for the short lead times while DSHP was best at the longer forecast periods."},{"kind":"descriptive report","citation":"Regional and Mesoscale Meteorology Branch (NOAA/NESDIS) and Cooperative Institute for Research in the Atmosphere, Colorado State University. Statistical Tropical Cyclone Intensity Forecast Technique Development. Web page, undated, checked 1 November 2026.","title":"Statistical Tropical Cyclone Intensity Forecast Technique Development","url":"https://rammb2.cira.colostate.edu/research/tropical-cyclones/ships/","written_by":"makers","quote":"The SHIPS and STIPS models use a linear regression technique, with the impacts of land applied as a correction in a post-processing step.","supports_benefit":false}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].id":{"state":"value_present","value":{"kind":"identifiers","identifiers":["AIBD-1128-source-0001","AIBD-1128-source-0002","AIBD-1128-source-0003"],"role":"Existing evidence items, in their original order"},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"sources[].language":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"descriptive report","citation":"U.S. Government Accountability Office. Artificial Intelligence in Natural Hazard Modeling: Severe Storms, Hurricanes, Floods, and Wildfires. Technology assessment GAO-24-106213, 14 December 2023, p. 25.","title":"Artificial Intelligence in Natural Hazard Modeling: Severe Storms, Hurricanes, Floods, and Wildfires","url":"https://web.archive.org/web/2026id_/https://www.gao.gov/assets/d24106213.pdf","date":"2023-12-14","written_by":"independent","quote":"SHIPS has historically outperformed most operational hurricane intensity models through the mid-2010s and still provide skillful intensity guidance. In 2021, it was the best of 48 models evaluated by the National Hurricane Center at providing intensity guidance for hurricanes in the Pacific at longer lead times."},{"kind":"report","citation":"Cangialosi, J. P. National Hurricane Center Forecast Verification Report: 2021 Hurricane Season. NOAA National Hurricane Center, 25 April 2022, p. 13.","title":"National Hurricane Center Forecast Verification Report: 2021 Hurricane Season","url":"https://www.nhc.noaa.gov/verification/pdfs/Verification_2021.pdf","date":"2022-04-25","written_by":"deployer","quote":"Among the individual models, HMNI was the best performer for the short lead times while DSHP was best at the longer forecast periods."},{"kind":"descriptive report","citation":"Regional and Mesoscale Meteorology Branch (NOAA/NESDIS) and Cooperative Institute for Research in the Atmosphere, Colorado State University. Statistical Tropical Cyclone Intensity Forecast Technique Development. Web page, undated, checked 1 November 2026.","title":"Statistical Tropical Cyclone Intensity Forecast Technique Development","url":"https://rammb2.cira.colostate.edu/research/tropical-cyclones/ships/","written_by":"makers","quote":"The SHIPS and STIPS models use a linear regression technique, with the impacts of land applied as a correction in a post-processing step.","supports_benefit":false}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].upstream_sources":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"strategic_assessments[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"strategic assessments"},"summary":{"state":"value_present","value":{"kind":"record_fields","fields":{"summary":"GAO reports that SHIPS, which the National Hurricane Center uses for intensity forecasts, was the best of 48 models at longer lead times for Pacific hurricanes in 2021.","account":"NOAA's Hurricane Research Division developed the Statistical Hurricane Intensity Prediction Scheme (SHIPS), which first ran in real time in 1990. Its developers write that it uses a linear regression technique with predictors from climatology, persistence, the atmosphere and the ocean. In a technology assessment dated 14 December 2023, the U.S. Government Accountability Office (GAO) states that SHIPS outperformed most operational hurricane intensity models through the mid-2010s. GAO reports that in 2021 it was the best of 48 models evaluated by the National Hurricane Center (NHC) at longer lead times for Pacific hurricanes. GAO writes that SHIPS uses a simple form of machine learning to predict rapid intensification. GAO did not verify the forecasts. It relays the results of NHC, which uses SHIPS. NHC's report of 25 April 2022 states that SHIPS with inland decay was the best individual model at the longer forecast periods in the eastern North Pacific. Its comparison table covers six individual models and four consensus aids. The ranking covers one season in one basin. No source measures how SHIPS changed NHC's official forecasts or warnings."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["summary","account"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].autonomy_permissions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].component_role":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].deployment_configuration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].inputs_outputs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_name":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].product_name":{"state":"value_present","value":{"kind":"record_fields","fields":{"system":"Statistical Hurricane Intensity Prediction Scheme (SHIPS)"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["system"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].provider":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"taxonomy_crosswalks[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"title":{"state":"value_present","value":{"kind":"record_fields","fields":{"title":"GAO reports that the hurricane intensity model SHIPS was the best of 48 models for Pacific hurricanes at longer lead times in 2021","headline":"*SHIPS* gave the best long-range Pacific intensity guidance in 2021"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["title","headline"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"version":{"state":"value_present","value":{"kind":"identifiers","identifiers":["28957b1dfcde7f3887819ff395e600610911b6222d7b9addda2a5b868615f94f"],"role":"SHA-256 of the complete public record and its assessments"},"provenance":{"kind":"curatorial","basis":"SHA-256 of the public record, its assessments, and its displayed answers and notes, excluding its own identifier and the derived coverage summary.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"workflow":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"NOAA's Hurricane Research Division developed the Statistical Hurricane Intensity Prediction Scheme (SHIPS), which first ran in real time in 1990. Its developers write that it uses a linear regression technique with predictors from climatology, persistence, the atmosphere and the ocean. In a technology assessment dated 14 December 2023, the U.S. Government Accountability Office (GAO) states that SHIPS outperformed most operational hurricane intensity models through the mid-2010s. GAO reports that in 2021 it was the best of 48 models evaluated by the National Hurricane Center (NHC) at longer lead times for Pacific hurricanes. GAO writes that SHIPS uses a simple form of machine learning to predict rapid intensification. GAO did not verify the forecasts. It relays the results of NHC, which uses SHIPS. NHC's report of 25 April 2022 states that SHIPS with inland decay was the best individual model at the longer forecast periods in the eastern North Pacific. Its comparison table covers six individual models and four consensus aids. The ranking covers one season in one basin. No source measures how SHIPS changed NHC's official forecasts or warnings.","replication":{"produced_by":["SHIPS combined predictors from climatology, persistence, the atmosphere and the ocean to forecast changes in maximum sustained winds.","The National Hurricane Center used SHIPS with other models to help forecasters predict hurricane intensity.","NHC compared the intensity models in a homogeneous verification of the 2021 eastern North Pacific season."],"must_hold":["Atmospheric forecast models must supply the predictors.","Storms must not intensify rapidly, since SHIPS forecasts have not performed well in those cases."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"}},"summary":{"total":91,"addressed":91,"known":28,"reviewed":2,"reviewed_complete":2,"reviewed_partial":0,"record_mapped":26,"review_not_assessed":63,"not_assessed":0,"complete":false,"by_state":{"value_present":28,"not_reported":0,"unresolved":63,"not_assessed":0,"not_applicable":0,"withheld":0,"source_unavailable":0}}},"presentation_version":"7c38e0915de4f4d128c5cd2b7a7accd55f88b3c425d47951e1927a2db1ff3920"}