Enhancing Interpretability in Factor Analysis by Means of Mathematical Optimization
- 30 October 2019
- journal article
- research article
- Published by Taylor & Francis in Multivariate Behavioral Research
- Vol. 55 (5) , 748-762
Abstract
Exploratory Factor Analysis (EFA) is a widely used statistical technique to discover the structure of latent unobserved variables, called factors, from a set of observed variables. EFA exploits the property of rotation invariance of the factor model to enhance factors’ interpretability by building a sparse loading matrix. In this paper, we propose an optimization-based procedure to give meaning to the factors arising in EFA by means of an additional set of variables, called explanatory variables, which may include in particular the set of observed variables. A goodness-of-fit criterion is introduced which quantifies the quality of the interpretation given this way. Our methodology also exploits the rotational invariance of EFA to obtain the best orthogonal rotation of the factors, in terms of the goodness-of-fit, but making them match to some of the explanatory variables, thus going beyond traditional rotation methods. Therefore, our approach allows the analyst to interpret the factors not only in terms of the observed variables, but in terms of a broader set of variables. Our experimental results demonstrate how our approach enhances interpretability in EFA, first in an empirical dataset, concerning volumes of reservoirs in California, and second in a synthetic data example.Keywords
This publication has 35 references indexed in Scilit:
- Supervised classification and mathematical optimizationComputers & Operations Research, 2013
- A Comparative Investigation of Rotation Criteria Within Exploratory Factor AnalysisMultivariate Behavioral Research, 2010
- A penalized matrix decomposition, with applications to sparse principal components and canonical correlation analysisBiostatistics, 2009
- High-Dimensional Sparse Factor Modeling: Applications in Gene Expression GenomicsJournal of the American Statistical Association, 2008
- Operations research and data miningEuropean Journal of Operational Research, 2008
- An Overview of Analytic Rotation in Exploratory Factor AnalysisMultivariate Behavioral Research, 2001
- Computing and evaluating factor scores.Psychological Methods, 2001
- A Comparison of Pattern Matching IndicesMultivariate Behavioral Research, 1991
- Identifiability of factor analysis: some results and open problemsLinear Algebra and its Applications, 1985
- The Varimax Criterion for Analytic Rotation in Factor AnalysisPsychometrika, 1958