{"id":"AIBD-0756","title":"A Typhoon Committee expert team finds that AI models such as Pangu-Weather and GraphCast beat official forecasts on 2024 typhoon tracks","summary":"An ESCAP/WMO Typhoon Committee expert team verified 19 AI forecast setups for the 2024 season. The best AI models had smaller track errors than official forecasts and physics-based models.","date_observed":"2026-04-01","date_basis":"source publication","date_precision":"month","benefit_status":"reported","source_collection":null,"source_entry":null,"account":"The ESCAP/WMO Typhoon Committee's Expert Team on AI Applications in Tropical Cyclone Analysis and Forecasting published its activity report for 2025 in April 2026. It presents a verification of the 2024 western North Pacific season. CMA, HKO, JMA, KMA and the Shanghai Meteorological Service submitted forecasts from 19 AI model setups. They included Pangu-Weather, GraphCast, FengWu, FuXi, AIFS and FourCastNet. The team checked them against best-track data from RSMC Tokyo. It compared the best AI setup from each member with official forecasts from five agencies and with the ECMWF and JMA global models. The team found that the AI models consistently had the smallest mean position errors, with the advantage growing at longer lead times. For intensity, the AI models systematically underestimated storms, and official forecasts kept biases often more than 50% lower. The results cover one season, and the AI group held each member's best-performing model.","category":"aggregate result","unexpected":false,"purpose":"Huawei, Google DeepMind and the Shanghai Artificial Intelligence Laboratory built Pangu-Weather, GraphCast and FengWu to forecast global weather in the medium range with models trained on past weather data.","system":"19 AI typhoon forecast setups, with Pangu-Weather (HKO), GraphCast (JMA and KMA) and FengWu (Shanghai Meteorological Service) as the best track models","model_version":null,"developer":"Huawei (Pangu-Weather), Google DeepMind (GraphCast), Shanghai Artificial Intelligence Laboratory (FengWu), Fudan University (FuXi), ECMWF (AIFS), NVIDIA (FourCastNet) and CMA (FengQing)","deployer":"CMA, HKO, JMA, KMA and the Shanghai Meteorological Service, each running the models","location":"Western North Pacific, with forecasts made in China, Hong Kong, Japan and South Korea","domain":"Weather forecasting / tropical cyclones","segment":null,"benefit_type":"Improved Task Accuracy","work_activities":["4.A.1.b.3"],"taxonomy_note":null,"registry_ids":{},"ratings":[{"group":"organizational","depth":2,"reason":"Across the 2024 season, the best AI models had smaller mean position errors than official forecasts and physics-based models, more so at longer lead times."}],"ai_role":{"status":"assessed","statement":"The team compared the AI models' own track forecasts with official forecasts and physics-based models on a homogeneous sample, which isolates the models' skill. The team notes that most models were trained on ERA5 reanalysis data. The verifying agencies run the models themselves, and the makers are outside them, except CMA for FengQing."},"evidence":[{"kind":"report","citation":"ESCAP/WMO Typhoon Committee, Working Group on Meteorology, Expert Team on AI Applications in Tropical Cyclone Analysis and Forecasting (ET-AITC). Annual Operating Plan 13: Promoting Technical Exchange of AI Applications in Tropical Cyclone Analysis and Forecasting, Activity Report 2025. April 2026, section 3.2.","title":"Annual Operating Plan 13: Promoting Technical Exchange of AI Applications in Tropical Cyclone Analysis and Forecasting, Activity Report 2025","url":"https://www.typhooncommittee.org/docs/WGM/WGMAOP13ActivityReport2025.pdf","date":null,"written_by":"deployer","quote":"AI-based models consistently produced the smallest mean position errors, with the advantage becoming increasingly pronounced at longer lead times."}],"replication":{"produced_by":["Five agencies ran AI models from the initial conditions of global models and tracked storm centers in the output.","The team verified the forecasts against RSMC Tokyo best-track data up to 120 hours."],"must_hold":["The result holds over more seasons, which the team calls for.","Intensity forecasts come from other sources, since the AI models underestimate intensity."],"echoes":[]},"paired_incident":null,"headline":"*Pangu-Weather* and *GraphCast* beat official track forecasts in 2024","metric":null,"comparator":{"against":"Official forecasts by CMA, HKO, JMA, JTWC and KMA, plus the ECMWF IFS and JMA GSM models","before":null,"after":null,"basis":"measured","quote":"AI-based models consistently produced the smallest mean position errors, with the advantage becoming increasingly pronounced at longer lead times.","url":"https://www.typhooncommittee.org/docs/WGM/WGMAOP13ActivityReport2025.pdf"},"later":null,"value":null,"developer_country":"Multiple: China, United Kingdom, United States","deployer_country":"Multiple: China, Japan, South Korea","unrated_because":null,"brief_notes":null,"brief":null,"revisions":[{"date":"2026-10-31","change":"Added the record from the report of the Typhoon Committee expert team.","source":"https://www.typhooncommittee.org/docs/WGM/WGMAOP13ActivityReport2025.pdf","editor":"AIBD"}],"confidence":"claimed","shade":"low","claim_status":"The deployer's account","claim_basis":"Sources: the deployer's report. The cited evidence includes no independent source and no finding by an external body.","case_jurisdictions":["China","Hong Kong","Japan","South Korea"],"profile":{"case_id":"AIBD-0756","catalog_version":"1.0.0","source_fingerprint":"ebebe6b605efafbacf9c7849ab3f9e359e74c082af641ccc0d46ca2a24b1c1d0","collection_refs":[{"collection_id":"aibd","version":"2026-10-31"}],"source_ids":["AIBD-0756-source-0001"],"families":{"strategic assessments":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"evaluations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"monetary observations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"institutional decisions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]}},"fields":{"actors[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"developer":"Huawei (Pangu-Weather), Google DeepMind (GraphCast), Shanghai Artificial Intelligence Laboratory (FengWu), Fudan University (FuXi), ECMWF (AIFS), NVIDIA (FourCastNet) and CMA (FengQing)","deployer":"CMA, HKO, JMA, KMA and the Shanghai Meteorological Service, each running the models"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["developer","deployer"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"actors[].ownership_control":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"ai_contribution":{"state":"value_present","value":{"kind":"record_fields","fields":{"ai_role":{"status":"assessed","statement":"The team compared the AI models' own track forecasts with official forecasts and physics-based models on a homogeneous sample, which isolates the models' skill. The team notes that most models were trained on ERA5 reanalysis data. The verifying agencies run the models themselves, and the makers are outside them, except CMA for FengQing."}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ai_role"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"ai_relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"category":"aggregate result","ai_role":{"status":"assessed","statement":"The team compared the AI models' own track forecasts with official forecasts and physics-based models on a homogeneous sample, which isolates the models' skill. The team notes that most models were trained on ERA5 reanalysis data. The verifying agencies run the models themselves, and the makers are outside them, except CMA for FengQing."}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ai_role","category"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].alternatives":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].assessor_date":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].depth":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":2,"reason":"Across the 2024 season, the best AI models had smaller mean position errors than official forecasts and physics-based models, more so at longer lead times."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].display_confidence":{"state":"value_present","value":{"kind":"structured","data":{"confidence":"low","evidence_word":"claimed","claim_status":"The deployer's account","basis":"Sources: the deployer's report. The cited evidence includes no independent source and no finding by an external body.","interpretation":"Existing display rule preserved; the richer outcome-specific confidence question still needs review."}},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rationale":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":2,"reason":"Across the 2024 season, the best AI models had smaller mean position errors than official forecasts and physics-based models, more so at longer lead times."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rubric_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].status_basis":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].target":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":2,"reason":"Across the 2024 season, the best AI models had smaller mean position errors than official forecasts and physics-based models, more so at longer lead times."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"availability":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"brief":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_kind":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_links[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_links":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_strength":{"state":"value_present","value":{"kind":"structured","data":{"answer":"The deployer's account. Sources: the deployer's report. The cited evidence includes no independent source and no finding by an external body.","evidence_word":"claimed","claim_status":"The deployer's account"}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0756-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"The deployer's account. Sources: the deployer's report. The cited evidence includes no independent source and no finding by an external body.","inferred":false}},"claims[].missingness":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].proposition":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"cross_border_flows[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"decisions[].action_outcome":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].grounds":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].institution_task":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].success_criterion":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"deployment_stage":{"state":"value_present","value":{"kind":"structured","data":{"classification":"routine use","answer":"The system was in routine use. The five agencies ran the AI models in real time and submitted their forecasts for the 2024 season.","scope":"The period and activity described in the case."}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["account","evidence"],"source_refs":["AIBD-0756-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"The system was in routine use. The five agencies ran the AI models in real time and submitted their forecasts for the 2024 season.","inferred":false}},"economics[].amount":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].costs[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].counterfactual":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].currency_price_basis":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].gross_net":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].measure_type":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].period_unit":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].realization":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].recipient_payer":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].return_payback":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].valuation_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"evaluations[].ai_uplift":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].comparator":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].design":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].effect":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].exposure":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].id":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].measurement_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].metric":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].reproduction_materials":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].setting_sample":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].uncertainty_limitations":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"external_references[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"follow_up[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"human_oversight":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"id":{"state":"value_present","value":{"kind":"record_fields","fields":{"id":"AIBD-0756"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["id"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"infrastructure_dependencies[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiaries":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiary_count":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].benefit_type":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_type":"Improved Task Accuracy"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].claim":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"The ESCAP/WMO Typhoon Committee's Expert Team on AI Applications in Tropical Cyclone Analysis and Forecasting published its activity report for 2025 in April 2026. It presents a verification of the 2024 western North Pacific season. CMA, HKO, JMA, KMA and the Shanghai Meteorological Service submitted forecasts from 19 AI model setups. They included Pangu-Weather, GraphCast, FengWu, FuXi, AIFS and FourCastNet. The team checked them against best-track data from RSMC Tokyo. It compared the best AI setup from each member with official forecasts from five agencies and with the ECMWF and JMA global models. The team found that the AI models consistently had the smallest mean position errors, with the advantage growing at longer lead times. For intensity, the AI models systematically underestimated storms, and official forecasts kept biases often more than 50% lower. The results cover one season, and the AI group held each member's best-performing model.","benefit_type":"Improved Task Accuracy"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].distribution":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].duration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].id":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].stakeholder_group":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":2,"reason":"Across the 2024 season, the best AI models had smaller mean position errors than official forecasts and physics-based models, more so at longer lead times."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].status":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_status":"reported"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_status"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].tradeoffs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].unexpected":{"state":"value_present","value":{"kind":"record_fields","fields":{"unexpected":false,"purpose":"Huawei, Google DeepMind and the Shanghai Artificial Intelligence Laboratory built Pangu-Weather, GraphCast and FengWu to forecast global weather in the medium range with models trained on past weather data."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["unexpected","purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"places[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"location":"Western North Pacific, with forecasts made in China, Hong Kong, Japan and South Korea","developer_country":"Multiple: China, United Kingdom, United States","deployer_country":"Multiple: China, Japan, South Korea"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["location","developer_country","deployer_country"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"purpose":{"state":"value_present","value":{"kind":"record_fields","fields":{"purpose":"Huawei, Google DeepMind and the Shanghai Artificial Intelligence Laboratory built Pangu-Weather, GraphCast and FengWu to forecast global weather in the medium range with models trained on past weather data."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"record_dates":{"state":"value_present","value":{"kind":"record_fields","fields":{"date_observed":"2026-04-01","date_basis":"source publication","date_precision":"month","revisions":[{"date":"2026-10-31","change":"Added the record from the report of the Typhoon Committee expert team.","source":"https://www.typhooncommittee.org/docs/WGM/WGMAOP13ActivityReport2025.pdf","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["date_observed","date_basis","date_precision","revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"replication.attempts[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"replication.conditions":{"state":"value_present","value":{"kind":"record_fields","fields":{"replication":{"produced_by":["Five agencies ran AI models from the initial conditions of global models and tracked storm centers in the output.","The team verified the forecasts against RSMC Tokyo best-track data up to 120 hours."],"must_hold":["The result holds over more seasons, which the team calls for.","Intensity forecasts come from other sources, since the AI models underestimate intensity."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"revision_history[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"revisions":[{"date":"2026-10-31","change":"Added the record from the report of the Typhoon Committee expert team.","source":"https://www.typhooncommittee.org/docs/WGM/WGMAOP13ActivityReport2025.pdf","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sector":{"state":"value_present","value":{"kind":"record_fields","fields":{"domain":"Weather forecasting / tropical cyclones"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["domain"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].access_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].citation_locator":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"report","citation":"ESCAP/WMO Typhoon Committee, Working Group on Meteorology, Expert Team on AI Applications in Tropical Cyclone Analysis and Forecasting (ET-AITC). Annual Operating Plan 13: Promoting Technical Exchange of AI Applications in Tropical Cyclone Analysis and Forecasting, Activity Report 2025. April 2026, section 3.2.","title":"Annual Operating Plan 13: Promoting Technical Exchange of AI Applications in Tropical Cyclone Analysis and Forecasting, Activity Report 2025","url":"https://www.typhooncommittee.org/docs/WGM/WGMAOP13ActivityReport2025.pdf","written_by":"deployer","quote":"AI-based models consistently produced the smallest mean position errors, with the advantage becoming increasingly pronounced at longer lead times."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].id":{"state":"value_present","value":{"kind":"identifiers","identifiers":["AIBD-0756-source-0001"],"role":"Existing evidence items, in their original order"},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"sources[].language":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"report","citation":"ESCAP/WMO Typhoon Committee, Working Group on Meteorology, Expert Team on AI Applications in Tropical Cyclone Analysis and Forecasting (ET-AITC). Annual Operating Plan 13: Promoting Technical Exchange of AI Applications in Tropical Cyclone Analysis and Forecasting, Activity Report 2025. April 2026, section 3.2.","title":"Annual Operating Plan 13: Promoting Technical Exchange of AI Applications in Tropical Cyclone Analysis and Forecasting, Activity Report 2025","url":"https://www.typhooncommittee.org/docs/WGM/WGMAOP13ActivityReport2025.pdf","written_by":"deployer","quote":"AI-based models consistently produced the smallest mean position errors, with the advantage becoming increasingly pronounced at longer lead times."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].upstream_sources":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"strategic_assessments[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"strategic assessments"},"summary":{"state":"value_present","value":{"kind":"record_fields","fields":{"summary":"An ESCAP/WMO Typhoon Committee expert team verified 19 AI forecast setups for the 2024 season. The best AI models had smaller track errors than official forecasts and physics-based models.","account":"The ESCAP/WMO Typhoon Committee's Expert Team on AI Applications in Tropical Cyclone Analysis and Forecasting published its activity report for 2025 in April 2026. It presents a verification of the 2024 western North Pacific season. CMA, HKO, JMA, KMA and the Shanghai Meteorological Service submitted forecasts from 19 AI model setups. They included Pangu-Weather, GraphCast, FengWu, FuXi, AIFS and FourCastNet. The team checked them against best-track data from RSMC Tokyo. It compared the best AI setup from each member with official forecasts from five agencies and with the ECMWF and JMA global models. The team found that the AI models consistently had the smallest mean position errors, with the advantage growing at longer lead times. For intensity, the AI models systematically underestimated storms, and official forecasts kept biases often more than 50% lower. The results cover one season, and the AI group held each member's best-performing model."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["summary","account"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].autonomy_permissions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].component_role":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].deployment_configuration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].inputs_outputs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_name":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].product_name":{"state":"value_present","value":{"kind":"record_fields","fields":{"system":"19 AI typhoon forecast setups, with Pangu-Weather (HKO), GraphCast (JMA and KMA) and FengWu (Shanghai Meteorological Service) as the best track models"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["system"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].provider":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"taxonomy_crosswalks[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"title":{"state":"value_present","value":{"kind":"record_fields","fields":{"title":"A Typhoon Committee expert team finds that AI models such as Pangu-Weather and GraphCast beat official forecasts on 2024 typhoon tracks","headline":"*Pangu-Weather* and *GraphCast* beat official track forecasts in 2024"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["title","headline"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"version":{"state":"value_present","value":{"kind":"identifiers","identifiers":["785738501f4729efb54b270add9c0b9c3b919fc22ef4f4b823861cc7ca03186e"],"role":"SHA-256 of the complete public record and its assessments"},"provenance":{"kind":"curatorial","basis":"SHA-256 of the public record, its assessments, and its displayed answers and notes, excluding its own identifier and the derived coverage summary.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"workflow":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"The ESCAP/WMO Typhoon Committee's Expert Team on AI Applications in Tropical Cyclone Analysis and Forecasting published its activity report for 2025 in April 2026. It presents a verification of the 2024 western North Pacific season. CMA, HKO, JMA, KMA and the Shanghai Meteorological Service submitted forecasts from 19 AI model setups. They included Pangu-Weather, GraphCast, FengWu, FuXi, AIFS and FourCastNet. The team checked them against best-track data from RSMC Tokyo. It compared the best AI setup from each member with official forecasts from five agencies and with the ECMWF and JMA global models. The team found that the AI models consistently had the smallest mean position errors, with the advantage growing at longer lead times. For intensity, the AI models systematically underestimated storms, and official forecasts kept biases often more than 50% lower. The results cover one season, and the AI group held each member's best-performing model.","replication":{"produced_by":["Five agencies ran AI models from the initial conditions of global models and tracked storm centers in the output.","The team verified the forecasts against RSMC Tokyo best-track data up to 120 hours."],"must_hold":["The result holds over more seasons, which the team calls for.","Intensity forecasts come from other sources, since the AI models underestimate intensity."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"}},"summary":{"total":91,"addressed":91,"known":29,"reviewed":2,"reviewed_complete":2,"reviewed_partial":0,"record_mapped":27,"review_not_assessed":62,"not_assessed":0,"complete":false,"by_state":{"value_present":29,"not_reported":0,"unresolved":62,"not_assessed":0,"not_applicable":0,"withheld":0,"source_unavailable":0}}},"presentation_version":"8709db433e916c7dafacfdfa7e478664d1afd0a4c2b0f677fc63f1548b70d61f"}