Non‐Gaussian Detection Using Machine Learning With Data Assimilation Applications
Open Access
- 22 April 2022
- journal article
- research article
- Published by American Geophysical Union (AGU) in Earth and Space Science
- Vol. 9 (4)
Abstract
In most data assimilation and numerical weather prediction systems, the Gaussian assumption is prevalent for the behavior of the random variables/errors that are involved. At the Cooperative Institute for Research in the Atmosphere theory has been developed for different forms of variational data assimilation schemes that enables the Gaussian assumption to be relaxed. For certain variable types, a lognormally distributed random variable can be combined in a mixed Gaussian‐lognormal distribution to better capture the interactions of the errors of different distributions. However, assuming that a distribution can change in time, then developing techniques to know when to switch between different versions of the data assimilation schemes becomes very important. By dynamically changing the formulation of the data assimilation system we are able to assimilate observations in a way that reflects the flow‐dependent variability of their distribution.In this paper, we present results with a machine learning technique (the support vector machine) to switch between data assimilation methods based on the detection of a change in the Lorenz 1963 model's z component's probability distribution. Given the machine learning technique's detection/prediction of a change in the distribution, then either a Gaussian or a mixed Gaussian‐lognormal 3DVar based cost function is used to minimize the errors in this period of time. It is shown that switching from a Gaussian 3DVar to a lognormal 3DVar at lognormally distributed parts of the attractor improves the data assimilation analysis error compared to using one distribution type for the entire attractor.Keywords
All Related Versions
This publication has 34 references indexed in Scilit:
- Gaussian anamorphosis in the analysis step of the EnKF: a joint state-variable/observation approachTellus, 2014
- Multiplicative and Additive Incremental Variational Data Assimilation for Mixed Lognormal–Gaussian ErrorsMonthly Weather Review, 2014
- Climatology of Non-Gaussian Atmospheric StatisticsJournal of Climate, 2013
- Mixed Gaussian-lognormal four-dimensional data assimilationTellus, 2010
- Implications and impacts of transforming lognormal variables into normal variables in VARMeteorologische Zeitschrift, 2007
- A data assimilation method for log‐normally distributed observational errorsQuarterly Journal of the Royal Meteorological Society, 2006
- A hybrid multivariate Normal and lognormal distribution for data assimilationAtmospheric Science Letters, 2006
- Maximum Likelihood Ensemble Filter: Theoretical AspectsMonthly Weather Review, 2005
- A local ensemble Kalman filter for atmospheric data assimilationTellus, 2004
- A Suggestion for Using Powerful and Informative Tests of NormalityThe American Statistician, 1990