{"id":"AIBD-0760","title":"JMA researchers find that Pangu-Weather, run from JMA analyses, tracked the 64 named typhoons of 2021 to 2023 more accurately than JMA's global model","summary":"Run from Japan Meteorological Agency analyses, Pangu-Weather's errors in typhoon position were 8% to 19% smaller than those of JMA's global model. It covered all 64 named storms of 2021 to 2023.","date_observed":"2025-02-27","date_basis":"source publication","date_precision":"day","benefit_status":"reported","source_collection":null,"source_entry":null,"account":"Researchers at the Meteorological Research Institute of the Japan Meteorological Agency (JMA) and three universities tested Pangu-Weather on typhoons in the western North Pacific. They ran Huawei's pretrained model without fine-tuning from the real-time analyses of JMA's Global Spectral Model (GSM). They compared its forecasts of typhoon tracks up to five days ahead for all 64 named typhoons of 2021 to 2023 with the GSM's forecasts from the same analyses. The authors report that Pangu-Weather's mean position errors were smaller at every lead time and that the differences were statistically significant. The improvement was 8%, 19%, 18%, 15% and 9% for one- to five-day forecasts. A five-day run took under a minute on one GPU, against about 19 minutes for the GSM. Intensity errors were larger than the GSM's, and forecast busts such as Typhoon Haikui in 2023 still occurred. The Journal of the Meteorological Society of Japan published the study online on 27 February 2025. The authors propose adding the model's tracks to the consensus that underlies JMA's track forecasts.","category":"aggregate result","unexpected":false,"purpose":"Huawei Cloud built Pangu-Weather to produce fast global medium-range forecasts with a deep learning model trained on ERA5 reanalysis.","system":"Pangu-Weather (PNG-W), run from JMA Global Spectral Model initial conditions","model_version":null,"developer":"Huawei Cloud","deployer":null,"location":"Western North Pacific basin (verification domain); Meteorological Research Institute, Tsukuba, Japan","domain":"Weather forecasting / tropical cyclones","segment":null,"benefit_type":"Improved Task Accuracy","work_activities":["4.A.1.b.3"],"taxonomy_note":null,"registry_ids":{},"ratings":[{"group":"organizational","depth":null,"reason":"The authors verified forecasts of past typhoons, and JMA is not reported to have used them in its warnings."}],"ai_role":{"status":"assessed","statement":"Pangu-Weather and the GSM started from the same JMA analyses and were verified against the same best tracks, so the authors isolate the model's own track skill."},"evidence":[{"kind":"peer-reviewed study","citation":"Yamaguchi M, Ikuta Y, Ito K, Satoh M. Tropical cyclone track and intensity predictions in the western North Pacific basin using Pangu-Weather and JMA initial conditions. Journal of the Meteorological Society of Japan 2025, 103(3):357–370.","title":"Tropical Cyclone Track and Intensity Predictions in the Western North Pacific Basin Using Pangu-Weather and JMA Initial Conditions","url":"https://www.jstage.jst.go.jp/article/jmsj/103/3/103_2025-018/_pdf/-char/en","date":"2025-02-27","written_by":"independent","quote":"Results indicate that the ML forecasts exhibit smaller position errors compared to the NWP model, alleviate the westward bias around Japan, and retain its forecast accuracy for TCs with unusual paths"}],"replication":{"produced_by":["The pretrained model ran without fine-tuning from JMA's real-time GSM analyses.","Forecasts from 0000 and 1200 UTC were verified against JMA best tracks up to five days ahead."],"must_hold":["An operational analysis must be available on time to start the model.","Intensity forecasts need other tools, since the model's typhoons were too weak."],"echoes":[]},"paired_incident":null,"headline":"*Pangu-Weather* tracks typhoons better than Japan's global model","metric":"The improvement was 8%, 19%, 18%, 15% and 9%","comparator":{"against":"JMA's operational Global Spectral Model (GSM) started from the same analyses","before":"GSM mean position errors for 1-day to 5-day forecasts","after":"Pangu-Weather mean position errors smaller by 8, 19, 18, 15 and 9 %","basis":"measured","quote":"The improvement rate of the 1-day to 5-day forecasts is 8, 19, 18, 15, and 9 %, respectively.","url":"https://www.jstage.jst.go.jp/article/jmsj/103/3/103_2025-018/_pdf/-char/en"},"later":null,"value":null,"developer_country":"China","deployer_country":null,"unrated_because":"The study scores forecasts of past typhoons that guided no warnings, so no gain to forecasters or the public is reported.","brief_notes":null,"brief":null,"revisions":[{"date":"2026-10-31","change":"Added the record from the report of the Meteorological Research Institute.","source":"https://www.jstage.jst.go.jp/article/jmsj/103/3/103_2025-018/_pdf/-char/en","editor":"AIBD"},{"date":"2026-10-31","change":"Rewrote the prose in plain sentences, with its facts, figures and quotations unchanged.","source":null,"editor":"AIBD"}],"confidence":"studied","shade":"high","claim_status":"Independently studied","claim_basis":"Sources: one independent peer-reviewed study. The cited evidence includes no finding by an external body.","case_jurisdictions":["Japan"],"profile":{"case_id":"AIBD-0760","catalog_version":"1.0.0","source_fingerprint":"15b32bf96913b5d028289c96a776723376355c0c1b374301d61e01bd62185085","collection_refs":[{"collection_id":"aibd","version":"2026-10-31"},{"collection_id":"viator","version":"2026-10-25"}],"source_ids":["AIBD-0760-source-0001"],"families":{"strategic assessments":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"evaluations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"monetary observations":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]},"institutional decisions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"Editorial assignment.","review_state":"not_assessed","coverage":"partial","record_ids":[]}},"fields":{"actors[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"developer":"Huawei Cloud"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["developer"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"actors[].ownership_control":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"ai_contribution":{"state":"value_present","value":{"kind":"record_fields","fields":{"ai_role":{"status":"assessed","statement":"Pangu-Weather and the GSM started from the same JMA analyses and were verified against the same best tracks, so the authors isolate the model's own track skill."}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ai_role"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"ai_relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"category":"aggregate result","ai_role":{"status":"assessed","statement":"Pangu-Weather and the GSM started from the same JMA analyses and were verified against the same best tracks, so the authors isolate the model's own track skill."}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ai_role","category"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].alternatives":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].assessor_date":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].depth":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].display_confidence":{"state":"value_present","value":{"kind":"structured","data":{"confidence":"high","evidence_word":"studied","claim_status":"Independently studied","basis":"Sources: one independent peer-reviewed study. The cited evidence includes no finding by an external body.","interpretation":"Existing display rule preserved; the richer outcome-specific confidence question still needs review."}},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rationale":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","reason":"The authors verified forecasts of past typhoons, and JMA is not reported to have used them in its warnings."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"assessments[].rubric_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].status_basis":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"assessments[].target":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","reason":"The authors verified forecasts of past typhoons, and JMA is not reported to have used them in its warnings."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"availability":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"brief":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_kind":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"case_links[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_links":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].evidence_strength":{"state":"value_present","value":{"kind":"structured","data":{"answer":"Independently studied. Sources: one independent peer-reviewed study. The cited evidence includes no finding by an external body.","evidence_word":"studied","claim_status":"Independently studied"}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":["AIBD-0760-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"Independently studied. Sources: one independent peer-reviewed study. The cited evidence includes no finding by an external body.","inferred":false}},"claims[].missingness":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"claims[].proposition":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"cross_border_flows[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"decisions[].action_outcome":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].grounds":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].institution_task":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"decisions[].success_criterion":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"institutional decisions"},"deployment_stage":{"state":"value_present","value":{"kind":"structured","data":{"classification":"laboratory test","answer":"The system was tested in a laboratory. JMA researchers ran the model on three past typhoon seasons and proposed operational use.","scope":"The period and activity described in the case."}},"provenance":{"kind":"source_review","basis":"Editorial assignment.","record_fields":["account","evidence"],"source_refs":["AIBD-0760-source-0001"],"reviewed_on":"2026-10-29"},"review_state":"reviewed","coverage":"complete","display":{"answer":"The system was tested in a laboratory. JMA researchers ran the model on three past typhoon seasons and proposed operational use.","inferred":false}},"economics[].amount":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].costs[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].counterfactual":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].currency_price_basis":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].gross_net":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].measure_type":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].period_unit":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].realization":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].recipient_payer":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].return_payback":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"economics[].valuation_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"monetary observations"},"evaluations[].ai_uplift":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].comparator":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].design":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].effect":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].exposure":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].id":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].measurement_method":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].metric":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].reproduction_materials":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].setting_sample":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"evaluations[].uncertainty_limitations":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"evaluations"},"external_references[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"follow_up[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"human_oversight":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"id":{"state":"value_present","value":{"kind":"record_fields","fields":{"id":"AIBD-0760"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["id"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"infrastructure_dependencies[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiaries":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].beneficiary_count":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].benefit_type":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_type":"Improved Task Accuracy"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].claim":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"Researchers at the Meteorological Research Institute of the Japan Meteorological Agency (JMA) and three universities tested Pangu-Weather on typhoons in the western North Pacific. They ran Huawei's pretrained model without fine-tuning from the real-time analyses of JMA's Global Spectral Model (GSM). They compared its forecasts of typhoon tracks up to five days ahead for all 64 named typhoons of 2021 to 2023 with the GSM's forecasts from the same analyses. The authors report that Pangu-Weather's mean position errors were smaller at every lead time and that the differences were statistically significant. The improvement was 8%, 19%, 18%, 15% and 9% for one- to five-day forecasts. A five-day run took under a minute on one GPU, against about 19 minutes for the GSM. Intensity errors were larger than the GSM's, and forecast busts such as Typhoon Haikui in 2023 still occurred. The Journal of the Meteorological Society of Japan published the study online on 27 February 2025. The authors propose adding the model's tracks to the consensus that underlies JMA's track forecasts.","benefit_type":"Improved Task Accuracy"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","benefit_type"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].distribution":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].duration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].id":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].stakeholder_group":{"state":"value_present","value":{"kind":"record_fields","fields":{"ratings":[{"group":"organizational","reason":"The authors verified forecasts of past typhoons, and JMA is not reported to have used them in its warnings."}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["ratings"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].status":{"state":"value_present","value":{"kind":"record_fields","fields":{"benefit_status":"reported"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["benefit_status"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"outcomes[].tradeoffs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"outcomes[].unexpected":{"state":"value_present","value":{"kind":"record_fields","fields":{"unexpected":false,"purpose":"Huawei Cloud built Pangu-Weather to produce fast global medium-range forecasts with a deep learning model trained on ERA5 reanalysis."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["unexpected","purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"places[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"location":"Western North Pacific basin (verification domain); Meteorological Research Institute, Tsukuba, Japan","developer_country":"China"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["location","developer_country"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"purpose":{"state":"value_present","value":{"kind":"record_fields","fields":{"purpose":"Huawei Cloud built Pangu-Weather to produce fast global medium-range forecasts with a deep learning model trained on ERA5 reanalysis."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["purpose"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"record_dates":{"state":"value_present","value":{"kind":"record_fields","fields":{"date_observed":"2025-02-27","date_basis":"source publication","date_precision":"day","revisions":[{"date":"2026-10-31","change":"Added the record from the report of the Meteorological Research Institute.","source":"https://www.jstage.jst.go.jp/article/jmsj/103/3/103_2025-018/_pdf/-char/en","editor":"AIBD"},{"date":"2026-10-31","change":"Rewrote the prose in plain sentences, with its facts, figures and quotations unchanged.","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["date_observed","date_basis","date_precision","revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"replication.attempts[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"replication.conditions":{"state":"value_present","value":{"kind":"record_fields","fields":{"replication":{"produced_by":["The pretrained model ran without fine-tuning from JMA's real-time GSM analyses.","Forecasts from 0000 and 1200 UTC were verified against JMA best tracks up to five days ahead."],"must_hold":["An operational analysis must be available on time to start the model.","Intensity forecasts need other tools, since the model's typhoons were too weak."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"revision_history[]":{"state":"value_present","value":{"kind":"record_fields","fields":{"revisions":[{"date":"2026-10-31","change":"Added the record from the report of the Meteorological Research Institute.","source":"https://www.jstage.jst.go.jp/article/jmsj/103/3/103_2025-018/_pdf/-char/en","editor":"AIBD"},{"date":"2026-10-31","change":"Rewrote the prose in plain sentences, with its facts, figures and quotations unchanged.","editor":"AIBD"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["revisions"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sector":{"state":"value_present","value":{"kind":"record_fields","fields":{"domain":"Weather forecasting / tropical cyclones"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["domain"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].access_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].citation_locator":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"peer-reviewed study","citation":"Yamaguchi M, Ikuta Y, Ito K, Satoh M. Tropical cyclone track and intensity predictions in the western North Pacific basin using Pangu-Weather and JMA initial conditions. Journal of the Meteorological Society of Japan 2025, 103(3):357–370.","title":"Tropical Cyclone Track and Intensity Predictions in the Western North Pacific Basin Using Pangu-Weather and JMA Initial Conditions","url":"https://www.jstage.jst.go.jp/article/jmsj/103/3/103_2025-018/_pdf/-char/en","date":"2025-02-27","written_by":"independent","quote":"Results indicate that the ML forecasts exhibit smaller position errors compared to the NWP model, alleviate the westward bias around Japan, and retain its forecast accuracy for TCs with unusual paths"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].id":{"state":"value_present","value":{"kind":"identifiers","identifiers":["AIBD-0760-source-0001"],"role":"Existing evidence items, in their original order"},"provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"sources[].language":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"sources[].relationship":{"state":"value_present","value":{"kind":"record_fields","fields":{"evidence":[{"kind":"peer-reviewed study","citation":"Yamaguchi M, Ikuta Y, Ito K, Satoh M. Tropical cyclone track and intensity predictions in the western North Pacific basin using Pangu-Weather and JMA initial conditions. Journal of the Meteorological Society of Japan 2025, 103(3):357–370.","title":"Tropical Cyclone Track and Intensity Predictions in the Western North Pacific Basin Using Pangu-Weather and JMA Initial Conditions","url":"https://www.jstage.jst.go.jp/article/jmsj/103/3/103_2025-018/_pdf/-char/en","date":"2025-02-27","written_by":"independent","quote":"Results indicate that the ML forecasts exhibit smaller position errors compared to the NWP model, alleviate the westward bias around Japan, and retain its forecast accuracy for TCs with unusual paths"}]}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["evidence"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"sources[].upstream_sources":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"strategic_assessments[]":{"state":"unresolved","review_state":"not_assessed","coverage":"partial","family":"strategic assessments"},"summary":{"state":"value_present","value":{"kind":"record_fields","fields":{"summary":"Run from Japan Meteorological Agency analyses, Pangu-Weather's errors in typhoon position were 8% to 19% smaller than those of JMA's global model. It covered all 64 named storms of 2021 to 2023.","account":"Researchers at the Meteorological Research Institute of the Japan Meteorological Agency (JMA) and three universities tested Pangu-Weather on typhoons in the western North Pacific. They ran Huawei's pretrained model without fine-tuning from the real-time analyses of JMA's Global Spectral Model (GSM). They compared its forecasts of typhoon tracks up to five days ahead for all 64 named typhoons of 2021 to 2023 with the GSM's forecasts from the same analyses. The authors report that Pangu-Weather's mean position errors were smaller at every lead time and that the differences were statistically significant. The improvement was 8%, 19%, 18%, 15% and 9% for one- to five-day forecasts. A five-day run took under a minute on one GPU, against about 19 minutes for the GSM. Intensity errors were larger than the GSM's, and forecast busts such as Typhoon Haikui in 2023 still occurred. The Journal of the Meteorological Society of Japan published the study online on 27 February 2025. The authors propose adding the model's tracks to the consensus that underlies JMA's track forecasts."}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["summary","account"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].autonomy_permissions":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].component_role":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].deployment_configuration":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].inputs_outputs":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_name":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].model_version":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"systems[].product_name":{"state":"value_present","value":{"kind":"record_fields","fields":{"system":"Pangu-Weather (PNG-W), run from JMA Global Spectral Model initial conditions"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["system"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"systems[].provider":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"taxonomy_crosswalks[]":{"state":"unresolved","provenance":{"kind":"curatorial","basis":"Editorial assignment.","record_fields":[],"source_refs":[]},"reason":"This is an explicit unresolved assignment: the sources on record do not settle this question.","review_state":"not_assessed","coverage":"partial"},"title":{"state":"value_present","value":{"kind":"record_fields","fields":{"title":"JMA researchers find that Pangu-Weather, run from JMA analyses, tracked the 64 named typhoons of 2021 to 2023 more accurately than JMA's global model","headline":"*Pangu-Weather* tracks typhoons better than Japan's global model"}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["title","headline"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"},"version":{"state":"value_present","value":{"kind":"identifiers","identifiers":["b95962298fdff19046f7ab8922cc952410fa674d671fee7d16e7605ad3d9843c"],"role":"SHA-256 of the complete public record and its assessments"},"provenance":{"kind":"curatorial","basis":"SHA-256 of the public record, its assessments, and its displayed answers and notes, excluding its own identifier and the derived coverage summary.","record_fields":[],"source_refs":[]},"review_state":"record_mapped","coverage":"complete"},"workflow":{"state":"value_present","value":{"kind":"record_fields","fields":{"account":"Researchers at the Meteorological Research Institute of the Japan Meteorological Agency (JMA) and three universities tested Pangu-Weather on typhoons in the western North Pacific. They ran Huawei's pretrained model without fine-tuning from the real-time analyses of JMA's Global Spectral Model (GSM). They compared its forecasts of typhoon tracks up to five days ahead for all 64 named typhoons of 2021 to 2023 with the GSM's forecasts from the same analyses. The authors report that Pangu-Weather's mean position errors were smaller at every lead time and that the differences were statistically significant. The improvement was 8%, 19%, 18%, 15% and 9% for one- to five-day forecasts. A five-day run took under a minute on one GPU, against about 19 minutes for the GSM. Intensity errors were larger than the GSM's, and forecast busts such as Typhoon Haikui in 2023 still occurred. The Journal of the Meteorological Society of Japan published the study online on 27 February 2025. The authors propose adding the model's tracks to the consensus that underlies JMA's track forecasts.","replication":{"produced_by":["The pretrained model ran without fine-tuning from JMA's real-time GSM analyses.","Forecasts from 0000 and 1200 UTC were verified against JMA best tracks up to five days ahead."],"must_hold":["An operational analysis must be available on time to start the model.","Intensity forecasts need other tools, since the model's typhoons were too weak."],"echoes":[]}}},"provenance":{"kind":"legacy_record","basis":"Editorial assignment.","record_fields":["account","replication"],"source_refs":[]},"review_state":"record_mapped","coverage":"partial"}},"summary":{"total":91,"addressed":91,"known":28,"reviewed":2,"reviewed_complete":2,"reviewed_partial":0,"record_mapped":26,"review_not_assessed":63,"not_assessed":0,"complete":false,"by_state":{"value_present":28,"not_reported":0,"unresolved":63,"not_assessed":0,"not_applicable":0,"withheld":0,"source_unavailable":0}}},"presentation_version":"e41fb2d0ae9a8421b730c07c4d171efbd5804a22876d9e000e211ba5d085efd7"}
