Data driven weather forecasts trained and initialised directly from observations Article Swipe

MAKE IMPACT

A. P. McNally , Christian Lessig , Peter Lean , Eulalie Boucher , Mihai Alexe , Ewan Pinnington , Matthew Chantry , Simon Lang , C. J. Burrows , Marcin Chrust , Florian Pinault , Ethel Villeneuve , Niels Bormann , S. B. Healy · YOU? · · 2024 · Open Access · · DOI: https://doi.org/10.48550/arxiv.2407.15586

Skilful Machine Learned weather forecasts have challenged our approach to numerical weather prediction, demonstrating competitive performance compared to traditional physics-based approaches. Data-driven systems have been trained to forecast future weather by learning from long historical records of past weather such as the ECMWF ERA5. These datasets have been made freely available to the wider research community, including the commercial sector, which has been a major factor in the rapid rise of ML forecast systems and the levels of accuracy they have achieved. However, historical reanalyses used for training and real-time analyses used for initial conditions are produced by data assimilation, an optimal blending of observations with a physics-based forecast model. As such, many ML forecast systems have an implicit and unquantified dependence on the physics-based models they seek to challenge. Here we propose a new approach, training a neural network to predict future weather purely from historical observations with no dependence on reanalyses. We use raw observations to initialise a model of the atmosphere (in observation space) learned directly from the observations themselves. Forecasts of crucial weather parameters (such as surface temperature and wind) are obtained by predicting weather parameter observations (e.g. SYNOP surface data) at future times and arbitrary locations. We present preliminary results on forecasting observations 12-hours into the future. These already demonstrate successful learning of time evolutions of the physical processes captured in real observations. We argue that this new approach, by staying purely in observation space, avoids many of the challenges of traditional data assimilation, can exploit a wider range of observations and is readily expanded to simultaneous forecasting of the full Earth system (atmosphere, land, ocean and composition).

Type

preprint

Language

en

Landing Page

http://arxiv.org/abs/2407.15586

PDF

https://arxiv.org/pdf/2407.15586

OA Status

green

Cited By

3

Related Works

10

OpenAlex ID

https://openalex.org/W4406073321

Raw OpenAlex JSON

OpenAlex ID

https://openalex.org/W4406073321

Canonical identifier for this work in OpenAlex

DOI

https://doi.org/10.48550/arxiv.2407.15586

Digital Object Identifier

Title

Data driven weather forecasts trained and initialised directly from observations

Work title

Type

preprint

OpenAlex work type

Language

en

Primary language

Publication year

2024

Year of publication

Publication date

2024-07-22

Full publication date if available

Authors

A. P. McNally, Christian Lessig, Peter Lean, Eulalie Boucher, Mihai Alexe, Ewan Pinnington, Matthew Chantry, Simon Lang, C. J. Burrows, Marcin Chrust, Florian Pinault, Ethel Villeneuve, Niels Bormann, S. B. Healy

List of authors in order

Landing page

https://arxiv.org/abs/2407.15586

Publisher landing page

PDF URL

https://arxiv.org/pdf/2407.15586

Direct link to full text PDF

Open access

Yes

Whether a free full text is available

OA status

green

Open access status per OpenAlex

OA URL

https://arxiv.org/pdf/2407.15586

Direct OA link when available

Concepts

Climatology, Meteorology, Computer science, Environmental science, Geography, Geology

Top concepts (fields/topics) attached by OpenAlex

Cited by

3

Total citation count in OpenAlex

Citations by year (recent)

2025: 2, 2024: 1

Per-year citation counts (last 5 years)

Related works (count)

10

Other works algorithmically related by OpenAlex

Full payload