Similarity-Based Predictive Models: Sensitivity Analysis and a Biological Application with Multi-Attributes
Open Access
Abstract
Predictive models based on empirical similarity are instrumental in biology and data science, where the premise is to measure the likeness of one observation with others in the same dataset. Biological datasets often encompass data that can be categorized. When using empirical similarity-based predictive models, two strategies for handling categorical covariates exist. The first strategy retains categorical covariates in their original form, applying distance measures and allocating weights to each covariate. In contrast, the second strategy creates binary variables, representing each variable level independently, and computes similarity measures solely through the Euclidean distance. This study performs a sensitivity analysis of these two strategies using computational simulations, and applies the results to a biological context. We use a linear regression model as a reference point, and consider two methods for estimating the model parameters, alongside exponential and fractional inverse similarity functions. The sensitivity is evaluated by determining the coefficient of variation of the parameter estimators across the three models as a measure of relative variability. Our results suggest that the first strategy excels over the second one in effectively dealing with categorical variables, and offers greater parsimony due to the use of fewer parameters.Keywords
Funding Information
- The National Council for Scientific and Technological Development (303192/2022-4, 308980/2021-2, 1200525, UIDB/00013/2020, UIDP/00013/2020)
- the Comissão de Aperfeiçoamento de Pessoal do Nível Superior (CAPES) (303192/2022-4, 308980/2021-2, 1200525, UIDB/00013/2020, UIDP/00013/2020)
- FONDECYT (303192/2022-4, 308980/2021-2, 1200525, UIDB/00013/2020, UIDP/00013/2020)
- Portuguese funds through the CMAT-Research Centre of Mathematics, University of Minho (303192/2022-4, 308980/2021-2, 1200525, UIDB/00013/2020, UIDP/00013/2020)
This publication has 15 references indexed in Scilit:
- Performance prediction and adaptation for database management system workload using Case-Based Reasoning approachInformation Systems, 2018
- Types of biological variablesJournal of Thoracic Disease, 2017
- Regularized regression for categorical dataStatistical Modelling, 2016
- Ordinary Least Squares Regression of Ordered Categorical Data: Inferential Implications for PracticeJournal of Agricultural, Biological and Environmental Statistics, 2014
- Categorical data analysis in experimental biologyDevelopmental Biology, 2010
- Influence diagnostics on the coefficient of variation of elliptically contoured distributionsJournal of Applied Statistics, 2010
- ASYMPTOTIC THEORY FOR EMPIRICAL SIMILARITY MODELSEconometric Theory, 2009
- Rule-Based and Case-Based Reasoning in Housing PricesThe B.E. Journal of Theoretical Economics, 2007
- Empirical SimilarityReview of Economics and Statistics, 2006
- The Growth of the Odontoblasts of the Incisor Tooth as a Criterion of the Vitamin C Intake of the Guinea PigThe Journal of Nutrition, 1947