Marisol García-Peña
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Marisol García-Peña has a total of 22 co-authors. Here are the top co-authors by number of shared publications:
- Sergio Arciniegas-Alarcón
Facultad de Ingeniería, Universidad de La Sabana, Campus Puente del Común, Km. 7 Autopista Norte, Chía 140013, Colombia
9 shared publications Wojtek J. Krzanowski
University of Exeter, College of Engineering, Mathematics and Physical Sciences, Exeter, UK
3 shared publications- Wojtek J. Krzanowski
College of Engineering, Mathematics and Physical Sciences, University of Exeter, Exeter, UK
3 shared publications - Camilo Rengifo
Department of Mathematics, Physics and Statistics, Universidad de La Sabana, Campus Universitario Puente del Común, Km. 7 Autopista Norte, Bogotá, Colombia
2 shared publications Camilo Rengifo
Universidad de La Sabana, Facultad de Ingeniería, Chía, Colombia
1 shared publicationCarlos Tadeu dos Santos Dias
1 shared publication
Latest Publications
- Open Access
- 27 May 2025
- Published by Springer Nature in BMC Research Notes
- Vol. 18 (1) , 1-11
Application of weighted low rank approximations: outlier detection in a data matrix
A mandatory step in the exploratory analysis of any rectangular database is the identification of possible outliers. The presence of these defines what type of explanatory and/or predictive modeling should be used subsequently. This paper presents strategies to identify outliers in any data set using weighted approximations of a matrix. The strategies are evaluated through artificial contamination in sixteen real data sets, of which two have multivariate characteristics and fourteen come from multi-environment trials. As an evaluation criterion, a statistic is proposed such that its value is small when the detection method is good and it is large when false positives or false negatives appear. Six criteria for identifying outliers from weighted approximations were considered, including simple residuals, squared residuals with differential weights, Jackknife and their corresponding iterative versions, and they were compared with the gold standard one based on limits from a bias-adjusted boxplot. All methods are applicable to any numerical data set written in matrix form, e.g. experiments with genotype-by-environment interaction. It was found that in the presence of random outliers in a matrix with numerical entries, the identification of outliers using weighted approximations is more effective than detection based on limits from a bias-adjusted boxplot.
- 27 May 2025
- Published by Springer Nature in BMC Research Notes
- Vol. 18 (1) , 1-11
Open AccessApplication of weighted low rank approximations: outlier detection in a data matrix
A mandatory step in the exploratory analysis of any rectangular database is the identification of possible outliers. The presence of these defines what type of explanatory and/or predictive modeling should be used subsequently. This paper presents strategies to identify outliers in any data set using weighted approximations of a matrix. The strategies are evaluated through artificial contamination in sixteen real data sets, of which two have multivariate characteristics and fourteen come from multi-environment trials. As an evaluation criterion, a statistic is proposed such that its value is small when the detection method is good and it is large when false positives or false negatives appear. Six criteria for identifying outliers from weighted approximations were considered, including simple residuals, squared residuals with differential weights, Jackknife and their corresponding iterative versions, and they were compared with the gold standard one based on limits from a bias-adjusted boxplot. All methods are applicable to any numerical data set written in matrix form, e.g. experiments with genotype-by-environment interaction. It was found that in the presence of random outliers in a matrix with numerical entries, the identification of outliers using weighted approximations is more effective than detection based on limits from a bias-adjusted boxplot.
- Open Access
- 20 May 2024
- Published by Taylor & Francis in Journal of Crop Improvement
- Vol. 38 (4) , 344-367
Cross-validation to select the optimum rank for a reduced-rank approximation to multivariate data
- 20 May 2024
- Published by Taylor & Francis in Journal of Crop Improvement
- Vol. 38 (4) , 344-367
Open AccessCross-validation to select the optimum rank for a reduced-rank approximation to multivariate data
- Open Access
Missing value imputation in a data matrix using the regularised singular value decomposition
- Open Access
- 19 July 2022
- Published by MDPI AG in Applied System Innovation
- Vol. 5 (4) , 69
Cross-Validation for Lower Rank Matrices Containing Outliers
Several statistical techniques for analyzing data matrices use lower rank approximations to these matrices, for which, in general, the appropriate rank must first be estimated depending on the objective of the study. The estimation can be conducted by cross-validation (CV), but most methods are not designed to cope with the presence of outliers, a very common problem in data matrices. The literature suggests one option to circumvent the problem, namely, the elimination of the outliers, but such information removal should only be performed when it is possible to verify that an outlier effectively corresponds to a collection or typing error. This paper proposes a methodology that combines the robust singular value decomposition (rSVD) with a CV scheme, and this allows outliers to be taken into account without eliminating them. For this, three possible rSVD’s are considered and six resistant criteria are proposed for the choice of the rank, based on three classic statistics used in multivariate statistics. To test the performance of the various methods, a simulation study and an analysis of real data are described, using an exclusively numerical evaluation through Procrustes statistics and critical angles between subspaces of principal components. We conclude that, when data matrices are contaminated with outliers, the best estimation of rank is the one that uses a CV scheme over a robust lower rank approximation (RLRA) containing as many components as possible. In our experiments, the best results were obtained when this RLRA was calculated using an rSVD that minimizes the L2 norm.
- 19 July 2022
- Published by MDPI AG in Applied System Innovation
- Vol. 5 (4) , 69
Open AccessCross-Validation for Lower Rank Matrices Containing Outliers
Several statistical techniques for analyzing data matrices use lower rank approximations to these matrices, for which, in general, the appropriate rank must first be estimated depending on the objective of the study. The estimation can be conducted by cross-validation (CV), but most methods are not designed to cope with the presence of outliers, a very common problem in data matrices. The literature suggests one option to circumvent the problem, namely, the elimination of the outliers, but such information removal should only be performed when it is possible to verify that an outlier effectively corresponds to a collection or typing error. This paper proposes a methodology that combines the robust singular value decomposition (rSVD) with a CV scheme, and this allows outliers to be taken into account without eliminating them. For this, three possible rSVD’s are considered and six resistant criteria are proposed for the choice of the rank, based on three classic statistics used in multivariate statistics. To test the performance of the various methods, a simulation study and an analysis of real data are described, using an exclusively numerical evaluation through Procrustes statistics and critical angles between subspaces of principal components. We conclude that, when data matrices are contaminated with outliers, the best estimation of rank is the one that uses a CV scheme over a robust lower rank approximation (RLRA) containing as many components as possible. In our experiments, the best results were obtained when this RLRA was calculated using an rSVD that minimizes the L2 norm.
- Open Access
- 4 September 2021
- Published by MDPI AG in Applied System Innovation
- Vol. 4 (3) , 62
Techniques for Robust Imputation in Incomplete Two-Way Tables
We describe imputation strategies resistant to outliers, through modifications of the simple imputation method proposed by Krzanowski and assess their performance. The strategies use a robust singular value decomposition, do not depend on distributional or structural assumptions and have no restrictions as to the pattern or missing data mechanisms. They are tested through the simulation of contamination and unbalance, both in artificially generated matrices and in a matrix of real data from an experiment with genotype-by-environment interaction. Their performance is assessed by means of prediction errors, the squared cosine between matrices, and a quality coefficient of fit between imputations and true values. For small matrices, the best results are obtained by applying robust decomposition directly, while for larger matrices the highest quality is obtained by eliminating the singular values of the imputation equation.
- 4 September 2021
- Published by MDPI AG in Applied System Innovation
- Vol. 4 (3) , 62
Open AccessTechniques for Robust Imputation in Incomplete Two-Way Tables
We describe imputation strategies resistant to outliers, through modifications of the simple imputation method proposed by Krzanowski and assess their performance. The strategies use a robust singular value decomposition, do not depend on distributional or structural assumptions and have no restrictions as to the pattern or missing data mechanisms. They are tested through the simulation of contamination and unbalance, both in artificially generated matrices and in a matrix of real data from an experiment with genotype-by-environment interaction. Their performance is assessed by means of prediction errors, the squared cosine between matrices, and a quality coefficient of fit between imputations and true values. For small matrices, the best results are obtained by applying robust decomposition directly, while for larger matrices the highest quality is obtained by eliminating the singular values of the imputation equation.
- 26 March 2021
- Published by Wiley in Crop Science
- Vol. 61 (5) , 3288-3300
Missing‐value imputation using the robust singular‐value decomposition: Proposals and numerical evaluation
A common problem in the analysis of data from multi‐environment trials is imbalance caused by missing observations. To get around this problem, Yan proposed a method for imputing the missing values based on the singular‐value decomposition (SVD) of a matrix. However, this SVD can be affected by outliers and produce low quality imputations. In this article, we propose four extensions of the Yan method that are resistant to outliers, replacing the standard SVD method with four robust SVD extensions. We evaluate these methods, using exclusively numerical criteria in a simulation study and in a cross‐validation study based on real data. We conclude that in the presence of outliers, the standard SVD method should not be used; instead, the best alternatives are the robust SVD methods based on sub‐sampling when the percentage of contamination is less than 2% following a completely random missing data mechanism. In any other case, methods that either minimize the L2 norm or that involve L1 regressions are preferable.
- 26 March 2021
- Published by Wiley in Crop Science
- Vol. 61 (5) , 3288-3300
Missing‐value imputation using the robust singular‐value decomposition: Proposals and numerical evaluation
A common problem in the analysis of data from multi‐environment trials is imbalance caused by missing observations. To get around this problem, Yan proposed a method for imputing the missing values based on the singular‐value decomposition (SVD) of a matrix. However, this SVD can be affected by outliers and produce low quality imputations. In this article, we propose four extensions of the Yan method that are resistant to outliers, replacing the standard SVD method with four robust SVD extensions. We evaluate these methods, using exclusively numerical criteria in a simulation study and in a cross‐validation study based on real data. We conclude that in the presence of outliers, the standard SVD method should not be used; instead, the best alternatives are the robust SVD methods based on sub‐sampling when the percentage of contamination is less than 2% following a completely random missing data mechanism. In any other case, methods that either minimize the L2 norm or that involve L1 regressions are preferable.
- Open Access
- 1 June 2016
- Published by FapUNIFESP (SciELO) in Crop Breeding and Applied Biotechnology
- Vol. 16 (2) , 77-85
Missing value imputation in multi-environment trials: Reconsidering the Krzanowski method
We propose a new methodology for multiple imputation when faced with missing data in multi-environmental trials with genotype-by-environment interaction, based on the imputation system developed by Krzanowski that uses the singular value decomposition (SVD) of a matrix. Several different iterative variants are described; differential weights can also be included in each variant to represent the influence of different components of SVD in the imputation process. The methods are compared through a simulation study based on three real data matrices that have values deleted randomly at different percentages, using as measure of overall accuracy a combination of the variance between imputations and their mean square deviations relative to the deleted values. The best results are shown by two of the iterative schemes that use weights belonging to the interval [0.75, 1]. These schemes provide imputations that have higher quality when compared with other multiple imputation methods based on the Krzanowski method
- 1 June 2016
- Published by FapUNIFESP (SciELO) in Crop Breeding and Applied Biotechnology
- Vol. 16 (2) , 77-85
Open AccessMissing value imputation in multi-environment trials: Reconsidering the Krzanowski method
We propose a new methodology for multiple imputation when faced with missing data in multi-environmental trials with genotype-by-environment interaction, based on the imputation system developed by Krzanowski that uses the singular value decomposition (SVD) of a matrix. Several different iterative variants are described; differential weights can also be included in each variant to represent the influence of different components of SVD in the imputation process. The methods are compared through a simulation study based on three real data matrices that have values deleted randomly at different percentages, using as measure of overall accuracy a combination of the variance between imputations and their mean square deviations relative to the deleted values. The best results are shown by two of the iterative schemes that use weights belonging to the interval [0.75, 1]. These schemes provide imputations that have higher quality when compared with other multiple imputation methods based on the Krzanowski method
- 17 September 2015
- Published by Universidade de São Paulo. Agência de Bibliotecas e Coleções Digitais
A Metodologia AMMI: com aplicação ao melhoramento genético
Os capítulos podem ser lidos de forma independente. O primeiro é introdutório, focalizando a interação genótipo por ambiente e o enfoque estatístico, apresentando o modelo AMMI, o gráfico Biplot e validação cruzada. O capítulo 2 cobre a distribuição empírica dos autovalores da matriz de interação, utilizando reamostragem bootstrap. O capítulo 3 discute a divergência genética utilizando reamostragem bootstrap e análise de agrupamento. O capítulo 4 trás e aplica um método de correção de autovalores viesados e mostra a eficiência da correção. O capítulo 5 apresenta um teste para confirmar a contribuição de genótipos e ambientes para a interação. O capítulo 6 trata da imputação simples e múltipla para observações ausentes na matriz de interação. O capítulo 7 trás os modelos AMMI bivariados utilizando a análise de procrustes. O capítulo 8 cobre o modelo AMMI no estudo da interação entre QTL e ambiente. O capítulo 9 contém a generalização dos modelos AMMI para três fatores com uso dos modelos PARAFAC e TUCKER, gráficos Joint plot e Triplot. Salientamos que os resultados apresentados aqui foram obtidos pelos autores e portanto, a notação algébrica pode não seguir o mesmo padrão em cada capítulo.
- 17 September 2015
- Published by Universidade de São Paulo. Agência de Bibliotecas e Coleções Digitais
A Metodologia AMMI: com aplicação ao melhoramento genético
Os capítulos podem ser lidos de forma independente. O primeiro é introdutório, focalizando a interação genótipo por ambiente e o enfoque estatístico, apresentando o modelo AMMI, o gráfico Biplot e validação cruzada. O capítulo 2 cobre a distribuição empírica dos autovalores da matriz de interação, utilizando reamostragem bootstrap. O capítulo 3 discute a divergência genética utilizando reamostragem bootstrap e análise de agrupamento. O capítulo 4 trás e aplica um método de correção de autovalores viesados e mostra a eficiência da correção. O capítulo 5 apresenta um teste para confirmar a contribuição de genótipos e ambientes para a interação. O capítulo 6 trata da imputação simples e múltipla para observações ausentes na matriz de interação. O capítulo 7 trás os modelos AMMI bivariados utilizando a análise de procrustes. O capítulo 8 cobre o modelo AMMI no estudo da interação entre QTL e ambiente. O capítulo 9 contém a generalização dos modelos AMMI para três fatores com uso dos modelos PARAFAC e TUCKER, gráficos Joint plot e Triplot. Salientamos que os resultados apresentados aqui foram obtidos pelos autores e portanto, a notação algébrica pode não seguir o mesmo padrão em cada capítulo.
- Open Access
- 1 December 2014
- Published by FapUNIFESP (SciELO) in Revista Brasileira de Meteorologia
- Vol. 29 (4) , 527-536
Imputação de dados climáticos utilizando a decomposição por valores singulares: uma comparação empírica
Um problema comum em dados climáticos é a informação ausente. Recentemente, foram desenvolvidos quatro métodos de imputação que têm como base a decomposição por valores singulares de uma matriz (DVS). O objetivo deste artigo é avaliar os novos desenvolvimentos fazendo uma comparação por meio de um estudo de simulação baseado em duas matrizes completas de dados reais. Uma matriz corresponde à precipitação histórica de Piracicaba/SP - Brasil, enquanto a outra matriz corresponde às características meteorológicas multivariadas na mesma cidade desde o ano 1997 até 2012. No estudo foram feitas retiradas aleatórias de diferentes porcentagens com posterior imputação, comparando as metodologias através de três critérios: a raiz quadrada normalizada do erro quadrático médio, a estatística de similaridade de Procrustes e o coeficiente de correlação não paramétrico de Spearman. Concluiu-se que a DVS deve ser utilizada unicamente quando sejam analisadas matrizes multivariadas e, no caso de matrizes de precipitação, a imputação pela média mensal supera o desempenho de métodos baseados na DVS.
- 1 December 2014
- Published by FapUNIFESP (SciELO) in Revista Brasileira de Meteorologia
- Vol. 29 (4) , 527-536
Open AccessImputação de dados climáticos utilizando a decomposição por valores singulares: uma comparação empírica
Um problema comum em dados climáticos é a informação ausente. Recentemente, foram desenvolvidos quatro métodos de imputação que têm como base a decomposição por valores singulares de uma matriz (DVS). O objetivo deste artigo é avaliar os novos desenvolvimentos fazendo uma comparação por meio de um estudo de simulação baseado em duas matrizes completas de dados reais. Uma matriz corresponde à precipitação histórica de Piracicaba/SP - Brasil, enquanto a outra matriz corresponde às características meteorológicas multivariadas na mesma cidade desde o ano 1997 até 2012. No estudo foram feitas retiradas aleatórias de diferentes porcentagens com posterior imputação, comparando as metodologias através de três critérios: a raiz quadrada normalizada do erro quadrático médio, a estatística de similaridade de Procrustes e o coeficiente de correlação não paramétrico de Spearman. Concluiu-se que a DVS deve ser utilizada unicamente quando sejam analisadas matrizes multivariadas e, no caso de matrizes de precipitação, a imputação pela média mensal supera o desempenho de métodos baseados na DVS.