GHGuannan Hu

Guannan Hu

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Guannan Hu has a total of 27 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Investigating the possibility of rare spontaneous AMOC transitions in the intermediate complexity climate model FAMOUS.

    by Jeroen Wouters, Guannan Hu, Jochen Bröcker, Robin Smith

    Earth System Models of Intermediate Complexity (EMICs) allow for fast exploration of large-scale climate dynamics. These models thus enable the development and testing of large-ensemble-based techniques that would be too costly with more realistic climate models.In this ongoing study we develop a rare event simulation setup to explore the possibility of a spontaneous collapse of the Atlantic Meridional Overturning Circulation (AMOC) in the FAMOUS model. FAMOUS is a low-resolution, coupled atmosphere-ocean general circulation model derived from the UK Met Office’s Unified Model specifically designed for efficient, long-duration and ensemble climate simulations. FAMOUS has previously been used to investigate the hysteresis of the Atlantic Meridional Overturning Circulation under freshwater hosing.We apply a genealogical particle analysis (GPA) algorithm that is designed to probe the possibility of spontaneous AMOC transitions. The method initiates an ensemble of realisations in the "on"-state of the AMOC and clones ensemble members at regular intervals that are showing a low AMOC.Contrary to recent results in another EMIC, a straightforward sampling based on the AMOC indicator does not result in any spontaneous transitions to the AMOC "off"-state. To improve the selection of potentially exceedingly rare trajectories, we therefore investigate statistical methods to identify physical variables that correlate with the state of the AMOC ahead of time, to be used as selection criteria in the GPA algorithm.

  • Open Access

    Assessing the Influence of Observations in Ensemble‐Based Data Assimilation Systems

    by Guannan Hu, Sarah L. Dance, Alison Fowler, David Simonin, Joanne Waller

    The skill of numerical weather forecasts strongly depends on the quality of the initial conditions (analyses), which are created by assimilating observations into previous short‐range model forecasts. Therefore, it is important to carefully assess the influence of different observations on the analysis. The degrees of freedom for signal (DFS) is a useful metric for quantifying this influence. While DFS has long been used in variational data assimilation (DA) systems, its application in ensemble‐based DA systems remains limited. In this study, we propose two novel approaches for estimating the DFS in ensemble‐based systems. One approach uses the weighting vector calculated in ensemble transform Kalman filters, while the other uses the innovation vector and observation‐space increment vector. We also propose a new strategy for implementing the DFS approaches in the presence of domain localization, which first estimates DFS locally and then aggregates the results to derive a global DFS value for each observation. Our numerical results show that the DFS per observation decreases as the localization radius increases. More generally, the proposed DFS approaches and implementation strategy have the potential to be used in practice to inform the optimization of observation networks and DA systems.


  • Open Access

    On methods for assessment of the value of observations in convection‐permitting data assimilation and numerical weather forecasting

    by Guannan Hu, Sarah L. Dance, Alison Fowler, David Simonin, Joanne Waller, Thomas Auligne, Sean Healy, Daisuke Hotta, Ulrich Löhnert, Takemasa Miyoshi, et al.

    In numerical weather prediction (NWP), a large number of observations are used to create initial conditions for weather forecasting through a process known as data assimilation. An assessment of the value of these observations for NWP can guide us in the design of future observation networks, help us to identify problems with the assimilation system, and allow us to assess changes to the assimilation system. However, assessment can be challenging in convection‐permitting NWP. This is because verification of convection‐permitting forecasts is not easy, the forecast model is strongly nonlinear, a limited‐area model is used, and the observations used often contain complex error statistics and are often associated with nonlinear observation operators. We compare methods that can be used to assess the value of observations in convection‐permitting NWP and discuss operational considerations when using these methods. We focus on their applicability to ensemble forecasting systems, as these systems are becoming increasingly dominant for convection‐permitting NWP. We also identify several future research directions, which include comparing results from different methods, comparing forecast validation using analyses versus using observations, applying flow‐dependent covariance localization, investigating the effect of ensemble size on the assessment, and generating and validating the nature run in observing‐system simulation experiments.


  • Open Access

    Assessing the influence of observations on the analysis in ensemble-based data assimilation systems

    by Guannan Hu, Sarah Dance, Alison Fowler, David Simonin, Joanne Waller

    Convection-permitting numerical weather prediction (NWP) is crucial for forecasting high-impact weather events such as heavy precipitation, storms, floods, wind gusts and fog. The assimilation of observations plays a significant role in improving the forecasting skill of these weather events. To make better use of existing observations and guide the design of future observation networks, accurately assessing the influence of assimilated observations is essential. The degrees of freedom for signal (DFS) has long been used to assess the influence of observations on the analysis. While various methods exist for calculating the DFS in variational data assimilation (DA) systems, calculating the DFS in ensemble-based DA systems (e.g., the ensemble transform Kalman filter) is a largely unexplored area. Since ensemble-based DA systems are becoming increasingly dominant for convection-permitting NWP, practical implementation of the DFS in such DA systems is needed. Unlike in variational DA systems, the background error covariance matrix is not static in ensemble-based DA methods. Consequently, the DFS calculated at each assimilation step measures the observation influence for a certain background error covariance matrix. This means that the DFS estimates are flow dependent. In addition, domain localisation of observations is often used in ensemble-based DA systems (e.g., local ensemble transform Kalman filter). This implies that the DFS should be calculated locally. In this work, we propose novel approaches for calculating the DFS in ensemble-based DA systems and investigate existing approaches applicable to such systems. We establish their consistency under idealised conditions and discuss their differences in practical applications. To validate our theoretical findings, we conduct simple numerical experiments using JEDI (Joint Effort for Data assimilation Integration) developed by JCSDA (Joint Center for Satellite Data Assimilation). Our results provide useful information for assessing the influence of observations in ensemble-based DA systems. This work is financially supported by the Met Office and is fully in line with the Met Office’s strategy and its ongoing development of the next generation data assimilation and observation processing system.

  • Open Access

    A Novel Localized Fast Multipole Method for Computations With Spatially Correlated Observation Error Statistics in Data Assimilation

    by Guannan Hu, Sarah L. Dance

    Several observation types (e.g., geostationary satellite and Doppler radar observations) have recently been found to exhibit strong spatial error correlations. Including these error statistics in data assimilation for numerical weather prediction can improve analysis quality and forecast skill. Moreover, it allows for increases in the spatial density of observations assimilated, which is needed for the provision of information on appropriate scales for high‐resolution forecasting. However, introducing correlated error statistics may increase the computational complexity and parallel communication costs of matrix‐vector products involving observation precision matrices (inverse observation error covariance matrices). Without new approaches, we cannot take full advantage of new observation uncertainty estimates. We develop a new numerical approximation method based on a particular type of fast multipole method and a domain localization approach. The basic idea is to divide the observation domain into boxes and then separate calculations of matrix‐vector products according to the partition. These calculations can be done in parallel with very low communication overheads. The new method is easy to implement and parallelize, and it is applicable to a wide variety of observation precision matrices. We applied the new method to a simple variational data assimilation problem and found that the computational cost of the variational minimization was dramatically reduced while preserving analysis accuracy across a range of scales. The new method has the potential to be used as an efficient technique for practical applications where a large number of observations with mutual error correlations need to be assimilated quickly.


  • Open Access

    Sampling and misspecification errors in the estimation of observation‐error covariance matrices using observation‐minus‐background and observation‐minus‐analysis statistics

    by Guannan Hu, Sarah L. Dance

    Specification of the observation‐error covariance matrix for data assimilation systems affects the observation information content retained by the analysis, particularly for observations known to have correlated observation errors (e.g., geostationary satellite and Doppler radar data). A widely adopted approach for estimating observation‐error covariance matrices uses observation‐minus‐background and observation‐minus‐analysis residuals, which are routinely produced by most data assimilation systems. Although this approach is known to produce biased and noisy estimates, due to sampling and misspecification errors, there has been no systematic study of sampling errors with this approach to date. Furthermore, the eigenspectrum of the estimated observation‐error covariance matrix is known to influence the analysis information content and numerical convergence of variational assimilation schemes. In this work, we provide new theorems for the sampling error and eigenvalues of the estimated observation‐error covariance matrices with this approach. We also conduct numerical experiments to illustrate our theoretical results. We find that this method produces large sampling errors if the true observation‐error standard deviation is large, while the other error characteristics, including the true background‐error standard deviation and observation‐ and background‐error correlation length‐scales, have a relatively small effect. We also find that the smallest eigenvalues of the estimated matrices may be smaller or larger than the true eigenvalues, depending on the assumed and true observation‐ and background‐error statistics. These results may provide insights for practical applications: for example, in deciding on appropriate sample sizes and choosing parameters for matrix reconditioning techniques.


  • Open Access

    A Novel Numerical Approximation Method for Computations with Spatially Correlated Observation Error Statistics in Data Assimilation

    by Guannan Hu, Sarah L. Dance

    Convection-permitting data assimilation requires observations with high spatial density and high temporal frequency to provide information on appropriate scales for high resolution forecasting. Those observation types (e.g., geostationary satellite data) were found to exhibit strong spatial error correlations. Explicitly introducing correlated error statistics in the assimilation may increase the computational complexity and parallel communication costs of the matrix-vector multiplications with the observation precision matrices (the inverse observation error covariance matrices). Therefore, without suitable approaches we cannot take full advantage of the new observation uncertainty estimates. In this work, we present a new numerical approximation method, called the local SVD-FMM, which is developed based on a particular type of the fast multipole method (FMM) using a singular value decomposition (SVD), and a domain localization approach. The basic idea of the local SVD-FMM is to divide the observation domain into boxes of (approximately) equal size and then separates the calculations of the matrix-vector products according to the domain partition. These calculations can be done in parallel with very low communication overheads. Moreover, the local SVD-FMM is easy to implement and applicable to a wide variety of the precision matrices. We applied the local SVD-FMM in a simple variational data assimilation system and found that the computational cost of the variational minimisation was dramatically reduced while preserving the accuracy of the analysis. This new method has the potential to be used as an efficient technique for practical data assimilation applications where a large volume of observations with mutual error correlations needs to be assimilated in a short period of time.

  • Open Access

    Progress, challenges, and future steps in data assimilation for convection‐permitting numerical weather prediction: Report on the virtual meeting held on 10 and 12 November 2021

    by Guannan Hu, Sarah L. Dance, Ross N. Bannister, Hristo G. Chipilski, Oliver Guillet, Bruce Macpherson, Martin Weissmann, Nusrat Yussouf

    In November 2021, the Royal Meteorological Society Data Assimilation (DA) Special Interest Group and the University of Reading hosted a virtual meeting on the topic of DA for convection‐permitting numerical weather prediction. The goal of the meeting was to discuss recent developments and review the challenges including methodological developments and progress in making the best use of observations. The meeting took place over two half days on the 10 and 12 November, and consisted of six talks and a panel discussion. The scientific presentations highlighted some recent work from Europe and the USA on convection‐permitting DA including novel developments in the assimilation of observations such as cloud‐affected satellite radiances in visible channels, ground‐based profiling networks, aircraft data, and radar reflectivity data, as well as methodological advancements in background and observation error covariance modelling and progress in operational systems. The panel discussion focused on key future challenges including the handling of multiscales (synoptic‐, meso‐, and convective‐scales), ensemble design, the specification of background and observation error covariances, and better use of observations. These will be critical issues to address in order to improve short‐range forecasts and nowcasts of hazardous weather.


  • Open Access

    Efficient computation of matrix–vector products with full observation weighting matrices in data assimilation

    by Guannan Hu, Sarah L. Dance

    Recent studies have demonstrated improved skill in numerical weather prediction via the use of spatially correlated observation error covariance information in data assimilation systems. In this case, the observation weighting matrices (inverse error covariance matrices) used in the assimilation may be full matrices rather than diagonal. Thus, the computation of matrix–vector products in the variational minimization problem may be very time‐consuming, particularly if the parallel computation of the matrix–vector product requires a high degree of communication between processing elements. Hence, we introduce a well‐known numerical approximation method, called the fast multipole method (FMM), to speed up the matrix–vector multiplications in data assimilation. We explore a particular type of FMM that uses a singular value decomposition (SVD‐FMM) and adjust it to suit our new application in data assimilation. By approximating a large part of the computation of the matrix–vector product, the SVD‐FMM technique greatly reduces the computational complexity compared with the standard approach. We develop a novel possible parallelization scheme of the SVD‐FMM for our application, which can reduce the communication costs. We investigate the accuracy of the SVD‐FMM technique in several numerical experiments: we first assess the accuracy using covariance matrices that are created using different correlation functions and lengthscales, then investigate the impact of reconditioning the covariance matrices on the accuracy, and finally examine the feasibility of the technique in the presence of missing observations. We also provide theoretical explanations for some numerical results. Our results show that the SVD‐FMM technique can compute the matrix–vector product with good accuracy in a wide variety of circumstances and, hence, has potential as an efficient technique for assimilation of a large volume of observational data within a short time interval.


  • Open Access

    Evaluation of Daily Precipitation Extremes in Reanalysis and Gridded Observation‐Based Data Sets Over Germany

    by Guannan Hu, Christian L. E. Franzke

    Accurate and reliable gridded data sets are important for analyzing extreme weather and climate events. Specifically, these data sets should produce extreme value statistics that are close to reality. Here we use various statistical methods to evaluate the quality of four gridded data products in representing daily precipitation extremes. The data products are the COSMO‐REA6 regional reanalysis, the ERA5 global reanalysis, and the E‐OBS and HYRAS gridded observation‐based data sets. The statistical methods we use offer a thorough insight into the quality of the different data sets by providing temporal and spatial extreme value statistics of daily precipitation. Our results show that all data sets except HYRAS underestimate the magnitude of daily precipitation extremes when compared with weather station data. Moreover, the reanalysis data sets give generally worse extreme value statistics of daily precipitation than the gridded observation‐based data sets. In particular, the reanalysis data sets often fail in reproducing the accurate timing of observed daily precipitation extremes.