WHWilliam Wei Hsieh

William Wei Hsieh

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


William Wei Hsieh has a total of 23 co-authors. Here are the top co-authors by number of shared publications:

  • Aiming Wu

    Department of Earth and Ocean Sciences University of British Columbia Vancouver, British Columbia Canada

    5 shared publications
  • Amir Shabbar

    Climate Research Division , Environment Canada , Toronto, Ontario

    3 shared publications
  • Lawrence A. Mysak

    McGill University

    2 shared publications
  • Sanjay S. P. Rattan

    Department of Earth and Ocean Sciences University of British Columbia Vancouver, British Columbia Canada

    2 shared publications
  • Shuyong Li

    Department of Earth and Ocean Sciences University of British Columbia Vancouver, British Columbia Canada

    2 shared publications
  • A. Shabbar

    Climate Research Division, Environment Canada, Toronto, Ontario, Canada

    1 shared publication

Latest Publications

  • Open Access

    Improving Predictions by Nonlinear Regression Models from Outlying Input Data

    by W. W. Hsieh

    When applying machine learning/statistical methods to the environmental sciences, nonlinear regression (NLR) models often perform only slightly better and occasionally worse than linear regression (LR). The proposed reason for this conundrum is that NLR models can give predictions much worse than LR when given input data which lie outside the domain used in model training. Continuous unbounded variables are widely used in environmental sciences, whence not uncommon for new input data to lie far outside the training domain. For six environmental datasets, inputs in the test data were classified as “outliers” and “non-outliers” based on the Mahalanobis distance from the training input data. The prediction scores (mean absolute error, Spearman correlation) showed NLR to outperform LR for the non-outliers, but often underperform LR for the outliers. An approach based on Occam’s Razor (OR) was proposed, where linear extrapolation was used instead of nonlinear extrapolation for the outliers. The linear extrapolation to the outlier domain was based on the NLR model within the non-outlier domain. This NLROR approach reduced occurrences of very poor extrapolation by NLR, and it tended to outperform NLR and LR for the outliers. In conclusion, input test data should be screened for outliers. For outliers, the unreliable NLR predictions can be replaced by NLROR or LR predictions, or by issuing a “no reliable prediction” warning.


  • Open Access

    Evolution of machine learning in environmental science—A perspective

    by William W. Hsieh

    The growth of machine learning (ML) in environmental science can be divided into a slow phase lasting till the mid-2010s and a fast phase thereafter. The rapid transition was brought about by the emergence of powerful new ML methods, allowing ML to successfully tackle many problems where numerical models and statistical models have been hampered. Deep convolutional neural network models greatly advanced the use of ML on 2D or 3D data. Transfer learning has allowed ML to progress in climate science, where data records are generally short for ML. ML and physics are also merging in new areas, for example: (a) using ML for general circulation model parametrization, (b) adding physics constraints in ML models, and (c) using ML in data assimilation.


  • Open Access

    Improving predictions by nonlinear regression models from outlying input data

    by William W. Hsieh

    When applying machine learning/statistical methods to the environmental sciences, nonlinear regression (NLR) models often perform only slightly better and occasionally worse than linear regression (LR). The proposed reason for this conundrum is that NLR models can give predictions much worse than LR when given input data which lie outside the domain used in model training. Continuous unbounded variables are widely used in environmental sciences, whence not uncommon for new input data to lie far outside the training domain. For six environmental datasets, inputs in the test data were classified as "outliers" and "non-outliers" based on the Mahalanobis distance from the training input data. The prediction scores (mean absolute error, Spearman correlation) showed NLR to outperform LR for the non-outliers, but often underperform LR for the outliers. An approach based on Occam's Razor (OR) was proposed, where linear extrapolation was used instead of nonlinear extrapolation for the outliers. The linear extrapolation to the outlier domain was based on the NLR model within the non-outlier domain. This NLR$_{\mathrm{OR}}$ approach reduced occurrences of very poor extrapolation by NLR, and it tended to outperform NLR and LR for the outliers. In conclusion, input test data should be screened for outliers. For outliers, the unreliable NLR predictions can be replaced by NLR$_{\mathrm{OR}}$ or LR predictions, or by issuing a "no reliable prediction" warning.

  • Evaluating hourly air quality forecasting in Canada with nonlinear updatable machine learning methods

    by Huiping Peng, Aranildo R. Lima, Andrew Teakles, Jian Jin, Alex J. Cannon, William W. Hsieh


  • Open Access

    Surface Wind Speed Prediction in the Canadian Arctic using Non-Linear Machine Learning Methods

    by Zhen Zeng, William W. Hsieh, William R. Burrows, Andrew Giles, Amir Shabbar

    Two non-linear, machine-learning/statistical methods, i.e., Bayesian neural network (BNN) and support vector regression (SVR), plus multiple linear regression (MLR), were used to forecast surface wind speeds at lead times of 12, 24, 48 and 72 h. Three different schemes, a statistical downscaling model (Scheme 1) using daily reforecast data from the National Centers for Environmental Prediction (NCEP) Global Forecasting System (GFS), an autoregressive model (Scheme 2) based on past wind observations, and a full model (Scheme 3) combining the two, were investigated in this study for the October–March winds from two meteorological stations in the Canadian Arctic (Clyde River and Paulatuk). At very short lead times, Scheme 2 provides better wind speed prediction than Scheme 1, but its forecast scores decrease rapidly with lead time. Scheme 3 generally performs best, especially at shorter lead times. All the linear and non-linear downscaling methods have significantly higher forecast scores at the two stations than the GFS reforecast. The non-linear methods tended to have slightly better forecast scores than linear methods (MLR and the linear version of SVR). There is particular interest in high-wind events, defined as having wind speeds over 22 knots (11.3 m s−1). After rescaling, the continuous wind predictions from Scheme 3 were classified into two types — high-wind event or non-event. For high-wind event forecasting, the non-linear methods have marginally better binary forecast scores than the linear methods for Clyde River but not for Paulatuk. The alternative approach of using support vector classification (SVC) did not perform better, but weighting the high-wind events more heavily than the non-events during model training improved the binary forecast scores.


  • Open Access

    Seasonal prediction of winter extreme precipitation over Canada by support vector regression

    by Z. Zeng, W. W. Hsieh, A. Shabbar, W. R. Burrows

    For forecasting the maximum 5-day accumulated precipitation over the winter season at lead times of 3, 6, 9 and 12 months over Canada from 1950 to 2007, two nonlinear and two linear regression models were used, where the models were support vector regression (SVR) (nonlinear and linear versions), nonlinear Bayesian neural network (BNN) and multiple linear regression (MLR). The 118 stations were grouped into six geographic regions by K-means clustering. For each region, the leading principal components of the winter maximum 5-d accumulated precipitation anomalies were the predictands. Potential predictors included quasi-global sea surface temperature anomalies and 500 hPa geopotential height anomalies over the Northern Hemisphere, as well as six climate indices (the Niño-3.4 region sea surface temperature, the North Atlantic Oscillation, the Pacific-North American teleconnection, the Pacific Decadal Oscillation, the Scandinavia pattern, and the East Atlantic pattern). The results showed that in general the two robust SVR models tended to have better forecast skills than the two non-robust models (MLR and BNN), and the nonlinear SVR model tended to forecast slightly better than the linear SVR model. Among the six regions, the Prairies region displayed the highest forecast skills, and the Arctic region the second highest. The strongest nonlinearity was manifested over the Prairies and the weakest nonlinearity over the Arctic.


  • Open Access

    Forecasts of Tropical Pacific Sea Surface Temperatures by Neural Networks and Support Vector Regression

    by Silvestre Aguilar-Martinez, William W. Hsieh

    Two nonlinear regression methods, Bayesian neural network (BNN) and support vector regression (SVR), and linear regression (LR), were used to forecast the tropical Pacific sea surface temperature (SST) anomalies at lead times ranging from 3 to 15 months, using sea level pressure (SLP) and SST as predictors. Datasets for 1950–2005 and 1980–2005 were studied, with the latter period having the warm water volume (WWV) above the 20∘C isotherm integrated across the equatorial Pacific available as an extra predictor. The forecasts indicated that the nonlinear structure is mainly present in the second PCA (principal component analysis) mode of the SST field. Overall, improvements in forecast skills by the nonlinear models over LR were modest. Although SVR has two structural advantages over neural network models, namely (a) no multiple minima in the optimization process and (b) an error norm robust to outliers in the data, it did not give better overall forecasts than BNN. Addition of WWV as an extra predictor generally increased the forecast skills slightly; however, the influence of WWV on SST anomalies in the tropical Pacific appears to be linear.


  • Open Access

    Nonlinear atmospheric teleconnections

    by William W. Hsieh, Aiming Wu, Amir Shabbar

    Neural network models are used to reveal the nonlinear winter atmospheric teleconnection patterns associated with the El Niño‐Southern Oscillation (ENSO) and with the Arctic Oscillation (AO) over the N. Hemisphere. The nonlinear teleconnections (for surface air temperature, precipitation, sea level pressure and 500 hPa geopotential height) are found to relate quadratically to the ENSO and AO indices. Relative to linear teleconnections, nonlinear teleconections appear to propagate perturbations farther, into regions where classical linear teleconnections are insignificant.