Joshua P. Hacker
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Joshua P. Hacker has a total of 16 co-authors. Here are the top co-authors by number of shared publications:
- Roland B. Stull
University of British Columbia, Vancouver, British Columbia, Canada
2 shared publications Carlos Maltzahn
Computer Science Department, University of California, Santa Cruz, Santa Cruz, California
1 shared publicationChris Snyder
National Center for Atmospheric Research,* Boulder, Colorado
1 shared publicationDaran L. Rife
National Center for Atmospheric Research,* Boulder, Colorado
1 shared publicationDavid Gill
Research Applications Laboratory, National Center for Atmospheric Research, Boulder, Colorado
1 shared publicationDorita Rostkier-Edelstein
National Center for Atmospheric Research,+ Boulder, Colorado
1 shared publication
Latest Publications
- Open Access
- 1 June 2017
- Published by American Meteorological Society in Bulletin of the American Meteorological Society
- Vol. 98 (6) , 1129-1138
A Containerized Mesoscale Model and Analysis Toolkit to Accelerate Classroom Learning, Collaborative Research, and Uncertainty Quantification
Numerical weather prediction (NWP) experiments can be complex and time consuming; results depend on computational environments and numerous input parameters. Delays in learning and obtaining research results are inevitable. Students face disproportionate effort in the classroom or beginning graduate-level NWP research. Published NWP research is generally not reproducible, introducing uncertainty and slowing efforts that build on past results. This work exploits the rapid emergence of software container technology to produce a transformative research and education environment. The Weather Research and Forecasting (WRF) Model anchors a set of linked Linux-based containers, which include software to initialize and run the model, to analyze results, and to serve output to collaborators. The containers are demonstrated with a WRF simulation of Hurricane Sandy. The demonstration illustrates the following: 1) how the often-difficult exercise in compiling the WRF and its many dependencies is eliminated, 2) how sharing containers provides identical environments for conducting research, 3) that numerically reproducible results are easily obtainable, and 4) how uncertainty in the results can be isolated from uncertainty arising from computing system differences. Numerical experiments designed to simultaneously measure numerical reproducibility and sensitivity to compiler optimization provide guidance for interpreting NWP research. Reproducibility is independent from the operating system and hardware. Results here show numerically identical output on all computing platforms tested. Performance reproducibility is also demonstrated. The result is an infrastructure capable of accelerating classroom learning, graduate research, and collaborative science.
- 1 June 2017
- Published by American Meteorological Society in Bulletin of the American Meteorological Society
- Vol. 98 (6) , 1129-1138
Open AccessA Containerized Mesoscale Model and Analysis Toolkit to Accelerate Classroom Learning, Collaborative Research, and Uncertainty Quantification
Numerical weather prediction (NWP) experiments can be complex and time consuming; results depend on computational environments and numerous input parameters. Delays in learning and obtaining research results are inevitable. Students face disproportionate effort in the classroom or beginning graduate-level NWP research. Published NWP research is generally not reproducible, introducing uncertainty and slowing efforts that build on past results. This work exploits the rapid emergence of software container technology to produce a transformative research and education environment. The Weather Research and Forecasting (WRF) Model anchors a set of linked Linux-based containers, which include software to initialize and run the model, to analyze results, and to serve output to collaborators. The containers are demonstrated with a WRF simulation of Hurricane Sandy. The demonstration illustrates the following: 1) how the often-difficult exercise in compiling the WRF and its many dependencies is eliminated, 2) how sharing containers provides identical environments for conducting research, 3) that numerically reproducible results are easily obtainable, and 4) how uncertainty in the results can be isolated from uncertainty arising from computing system differences. Numerical experiments designed to simultaneously measure numerical reproducibility and sensitivity to compiler optimization provide guidance for interpreting NWP research. Reproducibility is independent from the operating system and hardware. Results here show numerically identical output on all computing platforms tested. Performance reproducibility is also demonstrated. The result is an infrastructure capable of accelerating classroom learning, graduate research, and collaborative science.
- Open Access
- 1 January 2010
- Published by American Meteorological Society in Journal of the Atmospheric Sciences
- Vol. 67 (1) , 217-233
Spatial and Temporal Scales of Boundary Layer Wind Predictability in Response to Small-Amplitude Land Surface Uncertainty
Predictability experiments with the Weather Research and Forecast (WRF) model as a proxy for the atmosphere are analyzed to quantify the spatial and temporal scales of boundary layer wind response to land surface perturbations. Soil moisture is chosen as the land surface variable subject to uncertainty because the atmosphere is known to be sensitive to its state. A range of experiments with spatially correlated, small-amplitude perturbations to soil moisture leads to results that show the dependence of predictability on atmospheric conditions. The primary conclusions are as follows: 1) atmospheric conditions, including static instability and the presence of deep convection, determine whether large errors and local loss of predictability are possible in response to soil moisture errors; 2) the scale of soil moisture uncertainty determines scales of PBL wind predictability when the atmosphere is resistant to upscale error transfer, but when the atmosphere is sensitive the scale and magnitude of soil moisture uncertainty are not important after a few hours; and 3) nonlinear error growth is present whether or not the atmosphere is relatively sensitive to soil moisture uncertainty, leading to doubling times of minutes to hours for finite-sized perturbations. Similar results could be expected from other land surface variables or parameters that exert time-dependent forcing on the atmosphere that is similar in magnitude and scale to that of soil moisture.
- 1 January 2010
- Published by American Meteorological Society in Journal of the Atmospheric Sciences
- Vol. 67 (1) , 217-233
Open AccessSpatial and Temporal Scales of Boundary Layer Wind Predictability in Response to Small-Amplitude Land Surface Uncertainty
Predictability experiments with the Weather Research and Forecast (WRF) model as a proxy for the atmosphere are analyzed to quantify the spatial and temporal scales of boundary layer wind response to land surface perturbations. Soil moisture is chosen as the land surface variable subject to uncertainty because the atmosphere is known to be sensitive to its state. A range of experiments with spatially correlated, small-amplitude perturbations to soil moisture leads to results that show the dependence of predictability on atmospheric conditions. The primary conclusions are as follows: 1) atmospheric conditions, including static instability and the presence of deep convection, determine whether large errors and local loss of predictability are possible in response to soil moisture errors; 2) the scale of soil moisture uncertainty determines scales of PBL wind predictability when the atmosphere is resistant to upscale error transfer, but when the atmosphere is sensitive the scale and magnitude of soil moisture uncertainty are not important after a few hours; and 3) nonlinear error growth is present whether or not the atmosphere is relatively sensitive to soil moisture uncertainty, leading to doubling times of minutes to hours for finite-sized perturbations. Similar results could be expected from other land surface variables or parameters that exert time-dependent forcing on the atmosphere that is similar in magnitude and scale to that of soil moisture.
- Open Access
- 1 December 2007
- Published by American Meteorological Society in Weather and Forecasting
- Vol. 22 (6) , 1257-1273
A Practical Approach to Sequential Estimation of Systematic Error on Near-Surface Mesoscale Grids
Statistical analysis arguments are used to construct an estimation algorithm for systematic error of near-surface temperatures on a mesoscale grid. The systematic error is defined as the observed running-mean error, and an averaging length of 7 days is shown to be acceptable. Those errors are spread over a numerical weather prediction model grid via the statistical analysis equation. Two covariance models are examined: 1) a stationary, isotropic function tuned with the observed running-mean errors and 2) dynamic estimates derived from a recent history of running-mean forecasts. Prediction of error is possible with a diurnal persistence model, where the error at one time of day can be estimated from data with lags of 24-h multiples. The approach is tested on 6 months of 6-h forecasts with the fifth-generation Pennsylvania State University–NCAR Mesoscale Model (MM5) over New Mexico. Results show that for a quantity such as 2-m temperature, the systematic component of error can be effectively predicted on the grid. The gridded estimates fit the observed running-mean errors well. Cross validation shows that predictions of systematic error result in a substantial error reduction where observations are not available. The error estimates show a diurnal evolution, and are not strictly functions of terrain elevation. Observation error covariances, localization operators, and covariance functions in the isotropic case must be tuned for a specific forecast system and observing network, but the process is straightforward. Taken together, the results suggest an effective method for systematic error estimation on near-surface mesoscale grids in the absence of a useful ensemble. Correction for those errors may provide benefits to forecast users.
- 1 December 2007
- Published by American Meteorological Society in Weather and Forecasting
- Vol. 22 (6) , 1257-1273
Open AccessA Practical Approach to Sequential Estimation of Systematic Error on Near-Surface Mesoscale Grids
Statistical analysis arguments are used to construct an estimation algorithm for systematic error of near-surface temperatures on a mesoscale grid. The systematic error is defined as the observed running-mean error, and an averaging length of 7 days is shown to be acceptable. Those errors are spread over a numerical weather prediction model grid via the statistical analysis equation. Two covariance models are examined: 1) a stationary, isotropic function tuned with the observed running-mean errors and 2) dynamic estimates derived from a recent history of running-mean forecasts. Prediction of error is possible with a diurnal persistence model, where the error at one time of day can be estimated from data with lags of 24-h multiples. The approach is tested on 6 months of 6-h forecasts with the fifth-generation Pennsylvania State University–NCAR Mesoscale Model (MM5) over New Mexico. Results show that for a quantity such as 2-m temperature, the systematic component of error can be effectively predicted on the grid. The gridded estimates fit the observed running-mean errors well. Cross validation shows that predictions of systematic error result in a substantial error reduction where observations are not available. The error estimates show a diurnal evolution, and are not strictly functions of terrain elevation. Observation error covariances, localization operators, and covariance functions in the isotropic case must be tuned for a specific forecast system and observing network, but the process is straightforward. Taken together, the results suggest an effective method for systematic error estimation on near-surface mesoscale grids in the absence of a useful ensemble. Correction for those errors may provide benefits to forecast users.
- 1 August 2007
- Published by American Meteorological Society in Monthly Weather Review
- Vol. 135 (8) , 2958-2972
PBL State Estimation with Surface Observations, a Column Model, and an Ensemble Filter
Following recent results showing the potential for using surface observations of temperature, water vapor mixing ratio, and winds to determine PBL profiles, this paper reports on experiments with real observations. A 1D column model with soil, surface-layer, and PBL parameterization schemes that are the same as in the Weather Research and Forecasting model is used to estimate PBL profiles with an ensemble filter. Surface observations over the southern Great Plains are assimilated during the spring and early summer period of 2003. To strictly quantify the utility of the observations for determining PBL profiles in the ensemble filter framework, only climatological information is provided for initialization and forcing. The analysis skill, measured against rawinsondes for an independent verification, is compared against climatology to quantify the influence of the observations. Sensitivity to changing parameterization schemes, and to prescribed values of observation error variance, is examined. Temporal propagation of skillful analyses is also assessed, separating the effects of good prior state estimates from the impact of assimilation at night when covariance is weak. Results show that accurate profiles of temperature, mixing ratio, and winds are estimated with the column model and ensemble filter assimilating only surface observations. Results are largely insensitive to choice of parameterization scheme and specified observation error variance. The effects of using different parameterization schemes within the column model depend on whether assimilation is included, showing the importance of evaluating models within assimilation systems. At night, skillful estimates are possible because the influence of the observations from the previous day is temporally propagated, and atmospheric dynamics in the residual layer operate on slow time scales. It is expected that these profiles will have applications for nowcasting and secondary models (e.g., plume dispersion models) that rely on accurate specification of PBL structure.
- 1 August 2007
- Published by American Meteorological Society in Monthly Weather Review
- Vol. 135 (8) , 2958-2972
PBL State Estimation with Surface Observations, a Column Model, and an Ensemble Filter
Following recent results showing the potential for using surface observations of temperature, water vapor mixing ratio, and winds to determine PBL profiles, this paper reports on experiments with real observations. A 1D column model with soil, surface-layer, and PBL parameterization schemes that are the same as in the Weather Research and Forecasting model is used to estimate PBL profiles with an ensemble filter. Surface observations over the southern Great Plains are assimilated during the spring and early summer period of 2003. To strictly quantify the utility of the observations for determining PBL profiles in the ensemble filter framework, only climatological information is provided for initialization and forcing. The analysis skill, measured against rawinsondes for an independent verification, is compared against climatology to quantify the influence of the observations. Sensitivity to changing parameterization schemes, and to prescribed values of observation error variance, is examined. Temporal propagation of skillful analyses is also assessed, separating the effects of good prior state estimates from the impact of assimilation at night when covariance is weak. Results show that accurate profiles of temperature, mixing ratio, and winds are estimated with the column model and ensemble filter assimilating only surface observations. Results are largely insensitive to choice of parameterization scheme and specified observation error variance. The effects of using different parameterization schemes within the column model depend on whether assimilation is included, showing the importance of evaluating models within assimilation systems. At night, skillful estimates are possible because the influence of the observations from the previous day is temporally propagated, and atmospheric dynamics in the residual layer operate on slow time scales. It is expected that these profiles will have applications for nowcasting and secondary models (e.g., plume dispersion models) that rely on accurate specification of PBL structure.
- 1 March 2007
- Published by American Meteorological Society in Monthly Weather Review
- Vol. 135 (3) , 1021-1036
Improved Vertical Covariance Estimates for Ensemble-Filter Assimilation of Near-Surface Observations
Strategies to improve covariance estimates for ensemble-based assimilation of near-surface observations in atmospheric models are explored. It is known that localization of covariance estimates can improve conditioning of covariance matrices in the assimilation process by removing spurious elements and increasing the rank of the matrix. Vertical covariance localization is the focus of this work, and two basic approaches are compared: 1) a recently proposed hierarchical filter approach based on sampling theory and 2) a more commonly used fifth-order piecewise rational function. The hierarchical filter allows for dynamic estimates of localization functions and does not place any restrictions on their form. The rational function is optimized for every analysis time of day and for every possible observation and state variable combination. The methods are tested with a column model containing PBL and land surface parameterization schemes that are available in current mesoscale modeling systems. The results are expected to provide context for assimilation of near-surface observations in mesoscale models, which will benefit short-range mesoscale NWP applications. Results show that both the hierarchical and rational function approaches effectively improve covariance estimates from small ensembles. The hierarchical approach provides localization functions that are irregular and more closely related to PBL structure. Analysis of eigenvalue spectra show that both approaches improve the rank of the covariance matrices, but the amount of improvement is not always directly related to the assimilation performance. Results also show that specifying different localization functions for different observation and state variable combinations is more important than including time dependence.
- 1 March 2007
- Published by American Meteorological Society in Monthly Weather Review
- Vol. 135 (3) , 1021-1036
Improved Vertical Covariance Estimates for Ensemble-Filter Assimilation of Near-Surface Observations
Strategies to improve covariance estimates for ensemble-based assimilation of near-surface observations in atmospheric models are explored. It is known that localization of covariance estimates can improve conditioning of covariance matrices in the assimilation process by removing spurious elements and increasing the rank of the matrix. Vertical covariance localization is the focus of this work, and two basic approaches are compared: 1) a recently proposed hierarchical filter approach based on sampling theory and 2) a more commonly used fifth-order piecewise rational function. The hierarchical filter allows for dynamic estimates of localization functions and does not place any restrictions on their form. The rational function is optimized for every analysis time of day and for every possible observation and state variable combination. The methods are tested with a column model containing PBL and land surface parameterization schemes that are available in current mesoscale modeling systems. The results are expected to provide context for assimilation of near-surface observations in mesoscale models, which will benefit short-range mesoscale NWP applications. Results show that both the hierarchical and rational function approaches effectively improve covariance estimates from small ensembles. The hierarchical approach provides localization functions that are irregular and more closely related to PBL structure. Analysis of eigenvalue spectra show that both approaches improve the rank of the covariance matrices, but the amount of improvement is not always directly related to the assimilation performance. Results also show that specifying different localization functions for different observation and state variable combinations is more important than including time dependence.
- Open Access
- 1 November 2005
- Published by American Meteorological Society in Monthly Weather Review
- Vol. 133 (11) , 3260-3275
Ensemble Kalman Filter Assimilation of Fixed Screen-Height Observations in a Parameterized PBL
In situ surface layer observations are a rich data source that could be more effectively utilized in NWP applications. If properly assimilated, data from existing mesonets could improve initial conditions and lower boundary conditions, leading to the possibility of improved simulation and short-range forecasts of slope flows, sea breezes, convective initiation, and other PBL circulations. A variance–covariance climatology is constructed by extracting a representative column from real-time mesoscale forecasts over the Southern Great Plains, and used to explore the potential for estimating the state of the PBL by assimilating surface observations. A parameterized 1D PBL model and an ensemble Kalman filter (EnKF) approach to assimilation are used to test this potential. Analysis focuses on understanding how effectively the EnKF can spread the surface observations vertically to constrain the state of the PBL model. Results confirm that assimilating surface observations can substantially improve the state of a modeled PBL. Experiments to estimate the moisture availability parameter through the data assimilation system show that the EnKF is a viable tool for parameter estimation, and may help mitigate model error in forecasting and simulating the PBL.
- 1 November 2005
- Published by American Meteorological Society in Monthly Weather Review
- Vol. 133 (11) , 3260-3275
Open AccessEnsemble Kalman Filter Assimilation of Fixed Screen-Height Observations in a Parameterized PBL
In situ surface layer observations are a rich data source that could be more effectively utilized in NWP applications. If properly assimilated, data from existing mesonets could improve initial conditions and lower boundary conditions, leading to the possibility of improved simulation and short-range forecasts of slope flows, sea breezes, convective initiation, and other PBL circulations. A variance–covariance climatology is constructed by extracting a representative column from real-time mesoscale forecasts over the Southern Great Plains, and used to explore the potential for estimating the state of the PBL by assimilating surface observations. A parameterized 1D PBL model and an ensemble Kalman filter (EnKF) approach to assimilation are used to test this potential. Analysis focuses on understanding how effectively the EnKF can spread the surface observations vertically to constrain the state of the PBL model. Results confirm that assimilating surface observations can substantially improve the state of a modeled PBL. Experiments to estimate the moisture availability parameter through the data assimilation system show that the EnKF is a viable tool for parameter estimation, and may help mitigate model error in forecasting and simulating the PBL.
- Open Access
- 1 October 2003
- Published by American Meteorological Society in Monthly Weather Review
- Vol. 131 (10) , 2464-2478
Spectral Preconditioners for Nonhydrostatic Atmospheric Models
The elliptic problems in semi-implicit nonhydrostatic atmospheric models are difficult. Typically, they are poorly conditioned, nonseparable, contain cross-derivative terms, and are often nonsymmetric. Here, the resulting linear system is solved using a preconditioned Krylov subspace method—the generalized conjugate residual (GCR) algorithm. A horizontal spectral preconditioner is developed as an alternative to a more standard and much simpler line Jacobi relaxation scheme. However, the efficacy of the spectral preconditioner requires neglecting the cross-derivative terms and homogenization (e.g., averaging) metric coefficients over the computational domain. Because such a compromise causes a substantial departure of the preconditioner from the original elliptic operator, it is not obvious a priori whether it leads to a competitive solver. The robustness of the proposed approach over a broad range of representative meteorological applications is evaluated, in the context of a three-time-level semi-implicit semi-Lagrangian all-scale weather-prediction/research model.
- 1 October 2003
- Published by American Meteorological Society in Monthly Weather Review
- Vol. 131 (10) , 2464-2478
Open AccessSpectral Preconditioners for Nonhydrostatic Atmospheric Models
The elliptic problems in semi-implicit nonhydrostatic atmospheric models are difficult. Typically, they are poorly conditioned, nonseparable, contain cross-derivative terms, and are often nonsymmetric. Here, the resulting linear system is solved using a preconditioned Krylov subspace method—the generalized conjugate residual (GCR) algorithm. A horizontal spectral preconditioner is developed as an alternative to a more standard and much simpler line Jacobi relaxation scheme. However, the efficacy of the spectral preconditioner requires neglecting the cross-derivative terms and homogenization (e.g., averaging) metric coefficients over the computational domain. Because such a compromise causes a substantial departure of the preconditioner from the original elliptic operator, it is not obvious a priori whether it leads to a competitive solver. The robustness of the proposed approach over a broad range of representative meteorological applications is evaluated, in the context of a three-time-level semi-implicit semi-Lagrangian all-scale weather-prediction/research model.
- Open Access
- 1 February 2003
- Published by American Meteorological Society in Weather and Forecasting
- Vol. 18 (1) , 12-31
Ensemble Experiments on Numerical Weather Prediction Error and Uncertainty for a North Pacific Forecast Failure
An intense maritime cyclone off the northwest coast of North America during 9–14 February 1999 was remarkable in the repeated inability of numerical weather prediction (NWP) models to forecast its evolution. Each day during that period, the operational and research models of the United States and Canada were initialized with new analysis fields. Each day, the new short-term NWP forecasts predicted the storm to strike the densely populated Lower Mainland (Vancouver) area of southwest British Columbia, Canada, during the next 24–48 h. NWP guidance prompted the local forecast office to issue storm warnings including one or more of the following for Vancouver: heavy snow, heavy rain, and strong winds. Satellite imagery clearly showed the storm off the coast, but the storm did not strike Vancouver until much later and in a decayed state. This synoptic case is studied with an aim to understand the source of the NWP error, and an ensemble of research model runs is made to address three possibilities for failure: 1) initial condition (IC) error, 2) model error for a particularly nonlinear or sensitive event, and 3) sympathetic data denial. To estimate the effect of IC uncertainty, a short-range ensemble system is developed and tested on a limited-area model for a sequence of successive 3-day reforecasts covering the 10-day period surrounding the storm. This IC ensemble shows some correlation between spread and skill and provides one estimate of IC uncertainty. To estimate the effect of model uncertainty, a physics-based ensemble is run for the same period. The effect of data denial is investigated by comparing forecasts made with the same model but from analyses created at different operational centers. Results suggest that if the runs initialized at 0000 UTC 10 February 1999 were used for guidance, model uncertainty was likely responsible for the forecast failure. It had larger-than-average model error but lower-than-average IC error. Subsequent forecast errors were likely dominated by IC uncertainty. An attempt at assessing sympathetic data denial is inconclusive.
- 1 February 2003
- Published by American Meteorological Society in Weather and Forecasting
- Vol. 18 (1) , 12-31
Open AccessEnsemble Experiments on Numerical Weather Prediction Error and Uncertainty for a North Pacific Forecast Failure
An intense maritime cyclone off the northwest coast of North America during 9–14 February 1999 was remarkable in the repeated inability of numerical weather prediction (NWP) models to forecast its evolution. Each day during that period, the operational and research models of the United States and Canada were initialized with new analysis fields. Each day, the new short-term NWP forecasts predicted the storm to strike the densely populated Lower Mainland (Vancouver) area of southwest British Columbia, Canada, during the next 24–48 h. NWP guidance prompted the local forecast office to issue storm warnings including one or more of the following for Vancouver: heavy snow, heavy rain, and strong winds. Satellite imagery clearly showed the storm off the coast, but the storm did not strike Vancouver until much later and in a decayed state. This synoptic case is studied with an aim to understand the source of the NWP error, and an ensemble of research model runs is made to address three possibilities for failure: 1) initial condition (IC) error, 2) model error for a particularly nonlinear or sensitive event, and 3) sympathetic data denial. To estimate the effect of IC uncertainty, a short-range ensemble system is developed and tested on a limited-area model for a sequence of successive 3-day reforecasts covering the 10-day period surrounding the storm. This IC ensemble shows some correlation between spread and skill and provides one estimate of IC uncertainty. To estimate the effect of model uncertainty, a physics-based ensemble is run for the same period. The effect of data denial is investigated by comparing forecasts made with the same model but from analyses created at different operational centers. Results suggest that if the runs initialized at 0000 UTC 10 February 1999 were used for guidance, model uncertainty was likely responsible for the forecast failure. It had larger-than-average model error but lower-than-average IC error. Subsequent forecast errors were likely dominated by IC uncertainty. An attempt at assessing sympathetic data denial is inconclusive.