{"id":"AIBD-0754","title":"The Hong Kong Observatory finds that Pangu-Weather and FengWu had an edge over traditional models on 2023 typhoon tracks in its trial","summary":"In slides for the Typhoon Committee, HKO reported that Pangu-Weather and FengWu, run in a trial from mid-2023, had an edge over traditional models on typhoon tracks.","date_observed":"2024-02-27","date_basis":"source publication","date_precision":"day","benefit_status":"reported","source_collection":null,"source_entry":null,"account":"From mid-2023, the Hong Kong Observatory (HKO) ran Pangu-Weather and FengWu in real time in an internal trial to assist forecasting. The models started from analyses of traditional global models from DWD, ECCC, ECMWF, NCEP and Météo-France. On 27 February 2024, an HKO scientific officer presented the Observatory's verification of the 2023 season to the 56th session of the ESCAP/WMO Typhoon Committee. HKO compared the track errors of the two AI models with those of ECMWF, JMA, UKMO and NCEP models for eight tropical cyclones, including Saola, Haikui and Koinu. HKO concluded that the AI models had an edge over traditional models in track forecasts. In late September 2023, traditional models predicted a cyclone over the northern South China Sea that never formed, and an AI model correctly predicted no formation. HKO found that intensity prediction remained a big challenge, and Pangu's wind forecast for Super Typhoon Saola was far too weak. The findings come from slides, without a formal report.","category":"aggregate result","unexpected":false,"purpose":"Huawei and the Shanghai Artificial Intelligence Laboratory built Pangu-Weather and FengWu to forecast global weather in the medium range with models trained on past weather data.","system":"Pangu-Weather and FengWu, run by HKO in an internal real-time trial","model_version":null,"developer":"Huawei (Pangu-Weather) and Shanghai Artificial Intelligence Laboratory (FengWu)","deployer":"Hong Kong Observatory (internal trial to assist forecasting operations)","location":"Hong Kong, China (western North Pacific and South China Sea)","domain":"Weather forecasting / tropical cyclones","segment":null,"benefit_type":"Improved Task Accuracy","work_activities":["4.A.1.b.3"],"taxonomy_note":null,"registry_ids":{},"ratings":[{"group":"organizational","depth":2,"reason":"HKO found an edge for the AI models in track forecasts for eight cyclones in 2023, and an AI model correctly foresaw that a predicted cyclone would not form."}],"ai_role":{"status":"assessed","statement":"HKO compared the two models' own track forecasts with those of four traditional global models for the same cyclones, which isolates the models' skill. HKO describes them as machine learning-based models. HKO ran them itself in a trial, and the makers are outside HKO."},"evidence":[{"kind":"report","citation":"Hong Kong Observatory. Assessment and Verification of Artificial Intelligence Models on Tropical Cyclone Forecasting in 2023. Presentation by LUI Yuk-sing, Scientific Officer, to the 56th session of the ESCAP/WMO Typhoon Committee, 27 February 2024, slide 11.","title":"Assessment and Verification of Artificial Intelligence Models on Tropical Cyclone Forecasting in 2023","url":"https://typhooncommittee.org/56th/docs/item%205/Technical%20PresentationsTC56/2.%2020240227_TC56_AI_TC_Forecastsing_HKO_v2.pdf","date":"2024-02-27","written_by":"deployer","quote":"Although AI models have an edge over traditional NWPs in TC track forecast, TC intensity prediction remains a big challenge."}],"replication":{"produced_by":["The AI models started from the operational analyses of traditional global models.","HKO verified track and intensity errors for the cyclones of 2023."],"must_hold":["Forecasters rely on traditional models for intensity and wind structure.","The verification covers one season of eight cyclones."],"echoes":[]},"paired_incident":null,"headline":"*Pangu-Weather* and *FengWu* edge out physics models on 2023 typhoons","metric":null,"comparator":{"against":"ECMWF, JMA, UKMO and NCEP global models for the same 2023 cyclones","before":null,"after":null,"basis":"measured","quote":"Although AI models have an edge over traditional NWPs in TC track forecast, TC intensity prediction remains a big challenge.","url":"https://typhooncommittee.org/56th/docs/item%205/Technical%20PresentationsTC56/2.%2020240227_TC56_AI_TC_Forecastsing_HKO_v2.pdf"},"later":null,"value":null,"developer_country":"China","deployer_country":"China (Hong Kong)","unrated_because":null,"brief_notes":null,"brief":null,"revisions":[{"date":"2026-10-31","change":"Added the record from the report of the Hong Kong Observatory.","source":"https://typhooncommittee.org/56th/docs/item%205/Technical%20PresentationsTC56/2.%2020240227_TC56_AI_TC_Forecastsing_HKO_v2.pdf","editor":"AIBD"}],"confidence":"claimed","shade":"low","claim_status":"The deployer's account","claim_basis":"Sources: the deployer's report. The cited evidence includes no independent source and no finding by an external body.","case_jurisdictions":["Hong Kong","China"],"profile":{"case_id":"AIBD-0754","catalog_version":"1.0.0","source_fingerprint":"09c869ca00d3adc7ed713d18ee68b40230a56ee88610419ca959ccea551ea40b","collection_refs":[{"collection_id":"aibd","version":"2026-10-31"},{"collection_id":"viator","version":"2026-10-25"}],"source_ids":["AIBD-0754-source-0001"],"families":{"strategic assessments":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"evaluations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"monetary observations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"institutional decisions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]}},"fields":{"actors[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"developer":"Huawei (Pangu-Weather) and Shanghai Artificial Intelligence Laboratory (FengWu)","deployer":"Hong Kong Observatory (internal trial to assist forecasting operations)"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["developer","deployer"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"actors[].ownership_control":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"ai_contribution":{"state":"value_present","value":{"kind":"record_fields","fields":{"ai_role":{"status":"assessed","statement":"HKO compared the two models' own track forecasts with those of four traditional global models for the same cyclones, which isolates the models' skill. HKO describes them as machine learning-based models. HKO ran them itself in a trial, and the makers are outside HKO."}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ai_role"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"ai_relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"category":"aggregate result","ai_role":{"status":"assessed","statement":"HKO compared the two models' own track forecasts with those of four traditional global models for the same cyclones, which isolates the models' skill. HKO describes them as machine learning-based models. HKO ran them itself in a trial, and the makers are outside HKO."}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ai_role","category"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].alternatives":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].assessor_date":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].depth":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":2,"reason":"HKO found an edge for the AI models in track forecasts for eight cyclones in 2023, and an AI model correctly foresaw that a predicted cyclone would not form."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].display_confidence":{"state":"value_present","value":{"kind":"structured","data":{"confidence":"low","evidence_word":"claimed","claim_status":"The deployer's account","basis":"Sources: the deployer's report. The cited evidence includes no independent source and no finding by an external body.","interpretation":"Existing display rule preserved; the richer outcome-specific confidence question still needs review."}},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rationale":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":2,"reason":"HKO found an edge for the AI models in track forecasts for eight cyclones in 2023, and an AI model correctly foresaw that a predicted cyclone would not form."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rubric_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].status_basis":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].target":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":2,"reason":"HKO found an edge for the AI models in track forecasts for eight cyclones in 2023, and an AI model correctly foresaw that a predicted cyclone would not form."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"availability":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"brief":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_kind":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_links[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_links":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_strength":{"state":"value_present","value":{"kind":"structured","data":{"answer":"The deployer's account. Sources: the deployer's report. The cited evidence includes no independent source and no finding by an external body.","evidence_word":"claimed","claim_status":"The deployer's account"}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0754-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"The deployer's account. Sources: the deployer's report. The cited evidence includes no independent source and no finding by an external body.","inferred":false}},"claims[].missingness":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].proposition":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"cross_border_flows[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"decisions[].action_outcome":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].grounds":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].institution_task":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].success_criterion":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"deployment_stage":{"state":"value_present","value":{"kind":"structured","data":{"classification":"pilot","answer":"The system was used in a pilot. HKO ran the models in an internal real-time trial from mid-2023 to assist forecasting operations.","scope":"The period and activity described in the case."}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["account","evidence"],"source_refs":["AIBD-0754-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"The system was used in a pilot. HKO ran the models in an internal real-time trial from mid-2023 to assist forecasting operations.","inferred":false}},"economics[].amount":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].costs[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].counterfactual":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].currency_price_basis":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].gross_net":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].measure_type":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].period_unit":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].realization":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].recipient_payer":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].return_payback":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].valuation_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"evaluations[].ai_uplift":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].comparator":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].design":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].effect":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].exposure":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].id":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].measurement_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].metric":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].reproduction_materials":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].setting_sample":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].uncertainty_limitations":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"external_references[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"follow_up[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"human_oversight":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"id":{"state":"value_present","value":{"kind":"record_fields","fields":{"id":"AIBD-0754"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["id"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"infrastructure_dependencies[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiaries":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiary_count":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].benefit_type":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_type":"Improved Task Accuracy"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].claim":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"From mid-2023, the Hong Kong Observatory (HKO) ran Pangu-Weather and FengWu in real time in an internal trial to assist forecasting. The models started from analyses of traditional global models from DWD, ECCC, ECMWF, NCEP and Météo-France. On 27 February 2024, an HKO scientific officer presented the Observatory's verification of the 2023 season to the 56th session of the ESCAP/WMO Typhoon Committee. HKO compared the track errors of the two AI models with those of ECMWF, JMA, UKMO and NCEP models for eight tropical cyclones, including Saola, Haikui and Koinu. HKO concluded that the AI models had an edge over traditional models in track forecasts. In late September 2023, traditional models predicted a cyclone over the northern South China Sea that never formed, and an AI model correctly predicted no formation. HKO found that intensity prediction remained a big challenge, and Pangu's wind forecast for Super Typhoon Saola was far too weak. The findings come from slides, without a formal report.","benefit_type":"Improved Task Accuracy"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].distribution":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].duration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].id":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].stakeholder_group":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","depth":2,"reason":"HKO found an edge for the AI models in track forecasts for eight cyclones in 2023, and an AI model correctly foresaw that a predicted cyclone would not form."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].status":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_status":"reported"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_status"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].tradeoffs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].unexpected":{"state":"value_present","value":{"kind":"record_fields","fields":{"unexpected":false,"purpose":"Huawei and the Shanghai Artificial Intelligence Laboratory built Pangu-Weather and FengWu to forecast global weather in the medium range with models trained on past weather data."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["unexpected","purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"places[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"location":"Hong Kong, China (western North Pacific and South China Sea)","developer_country":"China","deployer_country":"China (Hong Kong)"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["location","developer_country","deployer_country"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"purpose":{"state":"value_present","value":{"kind":"record_fields","fields":{"purpose":"Huawei and the Shanghai Artificial Intelligence Laboratory built Pangu-Weather and FengWu to forecast global weather in the medium range with models trained on past weather data."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"record_dates":{"state":"value_present","value":{"kind":"record_fields","fields":{"date_observed":"2024-02-27","date_basis":"source publication","date_precision":"day","revisions":[{"date":"2026-10-31","change":"Added the record from the report of the Hong Kong Observatory.","source":"https://typhooncommittee.org/56th/docs/item%205/Technical%20PresentationsTC56/2.%2020240227_TC56_AI_TC_Forecastsing_HKO_v2.pdf","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["date_observed","date_basis","date_precision","revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"replication.attempts[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"replication.conditions":{"state":"value_present","value":{"kind":"record_fields","fields":{"replication":{"produced_by":["The AI models started from the operational analyses of traditional global models.","HKO verified track and intensity errors for the cyclones of 2023."],"must_hold":["Forecasters rely on traditional models for intensity and wind structure.","The verification covers one season of eight cyclones."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"revision_history[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"revisions":[{"date":"2026-10-31","change":"Added the record from the report of the Hong Kong Observatory.","source":"https://typhooncommittee.org/56th/docs/item%205/Technical%20PresentationsTC56/2.%2020240227_TC56_AI_TC_Forecastsing_HKO_v2.pdf","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sector":{"state":"value_present","value":{"kind":"record_fields","fields":{"domain":"Weather forecasting / tropical cyclones"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["domain"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].access_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].citation_locator":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"report","citation":"Hong Kong Observatory. Assessment and Verification of Artificial Intelligence Models on Tropical Cyclone Forecasting in 2023. Presentation by LUI Yuk-sing, Scientific Officer, to the 56th session of the ESCAP/WMO Typhoon Committee, 27 February 2024, slide 11.","title":"Assessment and Verification of Artificial Intelligence Models on Tropical Cyclone Forecasting in 2023","url":"https://typhooncommittee.org/56th/docs/item%205/Technical%20PresentationsTC56/2.%2020240227_TC56_AI_TC_Forecastsing_HKO_v2.pdf","date":"2024-02-27","written_by":"deployer","quote":"Although AI models have an edge over traditional NWPs in TC track forecast, TC intensity prediction remains a big challenge."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].id":{"state":"value_present","value":{"kind":"identifiers","identifiers":["AIBD-0754-source-0001"],"role":"Existing evidence items, in their original order"},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"sources[].language":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"report","citation":"Hong Kong Observatory. Assessment and Verification of Artificial Intelligence Models on Tropical Cyclone Forecasting in 2023. Presentation by LUI Yuk-sing, Scientific Officer, to the 56th session of the ESCAP/WMO Typhoon Committee, 27 February 2024, slide 11.","title":"Assessment and Verification of Artificial Intelligence Models on Tropical Cyclone Forecasting in 2023","url":"https://typhooncommittee.org/56th/docs/item%205/Technical%20PresentationsTC56/2.%2020240227_TC56_AI_TC_Forecastsing_HKO_v2.pdf","date":"2024-02-27","written_by":"deployer","quote":"Although AI models have an edge over traditional NWPs in TC track forecast, TC intensity prediction remains a big challenge."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].upstream_sources":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"strategic_assessments[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"strategic assessments"},"summary":{"state":"value_present","value":{"kind":"record_fields","fields":{"summary":"In slides for the Typhoon Committee, HKO reported that Pangu-Weather and FengWu, run in a trial from mid-2023, had an edge over traditional models on typhoon tracks.","account":"From mid-2023, the Hong Kong Observatory (HKO) ran Pangu-Weather and FengWu in real time in an internal trial to assist forecasting. The models started from analyses of traditional global models from DWD, ECCC, ECMWF, NCEP and Météo-France. On 27 February 2024, an HKO scientific officer presented the Observatory's verification of the 2023 season to the 56th session of the ESCAP/WMO Typhoon Committee. HKO compared the track errors of the two AI models with those of ECMWF, JMA, UKMO and NCEP models for eight tropical cyclones, including Saola, Haikui and Koinu. HKO concluded that the AI models had an edge over traditional models in track forecasts. In late September 2023, traditional models predicted a cyclone over the northern South China Sea that never formed, and an AI model correctly predicted no formation. HKO found that intensity prediction remained a big challenge, and Pangu's wind forecast for Super Typhoon Saola was far too weak. The findings come from slides, without a formal report."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["summary","account"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].autonomy_permissions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].component_role":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].deployment_configuration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].inputs_outputs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_name":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].product_name":{"state":"value_present","value":{"kind":"record_fields","fields":{"system":"Pangu-Weather and FengWu, run by HKO in an internal real-time trial"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["system"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].provider":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"taxonomy_crosswalks[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"title":{"state":"value_present","value":{"kind":"record_fields","fields":{"title":"The Hong Kong Observatory finds that Pangu-Weather and FengWu had an edge over traditional models on 2023 typhoon tracks in its trial","headline":"*Pangu-Weather* and *FengWu* edge out physics models on 2023 typhoons"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["title","headline"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"version":{"state":"value_present","value":{"kind":"identifiers","identifiers":["7ad145ce13fe39094f6cb4368b9f66b966d7108aeff6b665ef466f4d24ecebf6"],"role":"SHA-256 of the complete public record and its assessments"},"provenance":{"kind":"curatorial","basis":"SHA-256 of the public record, its assessments, and its displayed answers and notes, excluding its own identifier and the derived coverage summary.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"workflow":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"From mid-2023, the Hong Kong Observatory (HKO) ran Pangu-Weather and FengWu in real time in an internal trial to assist forecasting. The models started from analyses of traditional global models from DWD, ECCC, ECMWF, NCEP and Météo-France. On 27 February 2024, an HKO scientific officer presented the Observatory's verification of the 2023 season to the 56th session of the ESCAP/WMO Typhoon Committee. HKO compared the track errors of the two AI models with those of ECMWF, JMA, UKMO and NCEP models for eight tropical cyclones, including Saola, Haikui and Koinu. HKO concluded that the AI models had an edge over traditional models in track forecasts. In late September 2023, traditional models predicted a cyclone over the northern South China Sea that never formed, and an AI model correctly predicted no formation. HKO found that intensity prediction remained a big challenge, and Pangu's wind forecast for Super Typhoon Saola was far too weak. The findings come from slides, without a formal report.","replication":{"produced_by":["The AI models started from the operational analyses of traditional global models.","HKO verified track and intensity errors for the cyclones of 2023."],"must_hold":["Forecasters rely on traditional models for intensity and wind structure.","The verification covers one season of eight cyclones."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"}},"summary":{"total":91,"addressed":91,"known":29,"reviewed":2,"reviewed_complete":2,"reviewed_partial":0,"record_mapped":27,"review_not_assessed":62,"not_assessed":0,"complete":false,"by_state":{"value_present":29,"not_reported":0,"unresolved":62,"not_assessed":0,"not_applicable":0,"withheld":0,"source_unavailable":0}}},"presentation_version":"00b990c6f292500d9d51addca59337f62d981432623bf00d0d31aeff04b86b23"}