Ensemble score filter with image inpainting for data assimilation in tracking surface quasi-geostrophic dynamics with partial observations Article Swipe

MAKE IMPACT

Siming Liang , Hoang Ngoc Tran , F. Bao , Hristo G. Chipilski , Peter Jan van Leeuwen , Guannan Zhang · YOU? · · 2025 · Open Access · · DOI: https://doi.org/10.48550/arxiv.2501.12419

Data assimilation plays a pivotal role in understanding and predicting turbulent systems within geoscience and weather forecasting, where data assimilation is used to address three fundamental challenges, i.e., high-dimensionality, nonlinearity, and partial observations. Recent advances in machine learning (ML)-based data assimilation methods have demonstrated encouraging results. In this work, we develop an ensemble score filter (EnSF) that integrates image inpainting to solve the data assimilation problems with partial observations. The EnSF method exploits an exclusively designed training-free diffusion models to solve high-dimensional nonlinear data assimilation problems. Its performance has been successfully demonstrated in the context of having full observations, i.e., all the state variables are directly or indirectly observed. However, because the EnSF does not use a covariance matrix to capture the dependence between the observed and unobserved state variables, it is nontrivial to extend the original EnSF method to the partial observation scenario. In this work, we incorporate various image inpainting techniques into the EnSF to predict the unobserved states during data assimilation. At each filtering step, we first use the diffusion model to estimate the observed states by integrating the likelihood information into the score function. Then, we use image inpainting methods to predict the unobserved state variables. We demonstrate the performance of the EnSF with inpainting by tracking the Surface Quasi-Geostrophic (SQG) model dynamics under a variety of scenarios. The successful proof of concept paves the way to more in-depth investigations on exploiting modern image inpainting techniques to advance data assimilation methodology for practical geoscience and weather forecasting problems.

Type

preprint

Language

en

Landing Page

http://arxiv.org/abs/2501.12419

PDF

https://arxiv.org/pdf/2501.12419

OA Status

green

Cited By

1

Related Works

10

OpenAlex ID

https://openalex.org/W4406764763

Raw OpenAlex JSON

OpenAlex ID

https://openalex.org/W4406764763

Canonical identifier for this work in OpenAlex

DOI

https://doi.org/10.48550/arxiv.2501.12419

Digital Object Identifier

Title

Ensemble score filter with image inpainting for data assimilation in tracking surface quasi-geostrophic dynamics with partial observations

Work title

Type

preprint

OpenAlex work type

Language

en

Primary language

Publication year

2025

Year of publication

Publication date

2025-01-20

Full publication date if available

Authors

Siming Liang, Hoang Ngoc Tran, F. Bao, Hristo G. Chipilski, Peter Jan van Leeuwen, Guannan Zhang

List of authors in order

Landing page

https://arxiv.org/abs/2501.12419

Publisher landing page

PDF URL

https://arxiv.org/pdf/2501.12419

Direct link to full text PDF

Open access

Yes

Whether a free full text is available

OA status

green

Open access status per OpenAlex

OA URL

https://arxiv.org/pdf/2501.12419

Direct OA link when available

Concepts

Inpainting, Data assimilation, Geostrophic wind, Tracking (education), Image (mathematics), Computer vision, Artificial intelligence, Filter (signal processing), Computer science, Ensemble Kalman filter, Kalman filter, Mathematics, Geography, Geology, Climatology, Meteorology, Extended Kalman filter, Psychology, Pedagogy

Top concepts (fields/topics) attached by OpenAlex

Cited by

1

Total citation count in OpenAlex

Citations by year (recent)

2025: 1

Per-year citation counts (last 5 years)

Related works (count)

10

Other works algorithmically related by OpenAlex

Full payload