Missing‐value imputation using the robust singular‐value decomposition: Proposals and numerical evaluation
- 26 March 2021
- journal article
- research article
- Published by Wiley in Crop Science
- Vol. 61 (5) , 3288-3300
Abstract
A common problem in the analysis of data from multi‐environment trials is imbalance caused by missing observations. To get around this problem, Yan proposed a method for imputing the missing values based on the singular‐value decomposition (SVD) of a matrix. However, this SVD can be affected by outliers and produce low quality imputations. In this article, we propose four extensions of the Yan method that are resistant to outliers, replacing the standard SVD method with four robust SVD extensions. We evaluate these methods, using exclusively numerical criteria in a simulation study and in a cross‐validation study based on real data. We conclude that in the presence of outliers, the standard SVD method should not be used; instead, the best alternatives are the robust SVD methods based on sub‐sampling when the percentage of contamination is less than 2% following a completely random missing data mechanism. In any other case, methods that either minimize the L2 norm or that involve L1 regressions are preferable.Keywords
This publication has 46 references indexed in Scilit:
- Deterministic Imputation in Multienvironment TrialsISRN Agronomy, 2013
- Biplot Analysis of Incomplete Two‐Way DataCrop Science, 2013
- A comparison between Joint Regression Analysis and the Additive Main and Multiplicative Interaction model: the robustness with increasing amounts of missing dataScientia Agricola, 2011
- Prediction Assessment of Linear Mixed Models for Multienvironment TrialsCrop Science, 2011
- Biplot Analysis of Genotype × Environment Interaction: Proceed with CautionCrop Science, 2009
- Comparison of Shape Variability in Principal Component Biplot with Missing ValuesKorean Journal of Applied Statistics, 2008
- Robust Low-Rank Approximation of Data Matrices With Elementwise ContaminationTechnometrics, 2008
- Statistical Analysis of Yield Trials by AMMI and GGE: Further ConsiderationsCrop Science, 2008
- GGE Biplot vs. AMMI Analysis of Genotype‐by‐Environment DataCrop Science, 2007
- Lower Rank Approximation of Matrices by Least Squares With Any Choice of WeightsTechnometrics, 1979