Voting with random classifiers (VORACE): theoretical and experimental analysis
Open Access
- 21 May 2021
- journal article
- research article
- Published by Springer Nature in Autonomous Agents and Multi-Agent Systems
- Vol. 35 (2) , 1-31
Abstract
In many machine learning scenarios, looking for the best classifier that fits a particular dataset can be very costly in terms of time and resources. Moreover, it can require deep knowledge of the specific domain. We propose a new technique which does not require profound expertise in the domain and avoids the commonly used strategy of hyper-parameter tuning and model selection. Our method is an innovative ensemble technique that uses voting rules over a set of randomly-generated classifiers. Given a new input sample, we interpret the output of each classifier as a ranking over the set of possible classes. We then aggregate these output rankings using a voting rule, which treats them as preferences over the classes. We show that our approach obtains good results compared to the state-of-the-art, both providing a theoretical analysis and an empirical evaluation of the approach on several datasets.Keywords
All Related Versions
Funding Information
- European University Institute - Fiesole
This publication has 39 references indexed in Scilit:
- A Short Introduction to Preferences: Between Artificial Intelligence and Social ChoiceSynthesis Lectures on Artificial Intelligence and Machine Learning, 2011
- Ensemble-based classifiersArtificial Intelligence Review, 2009
- Machine learning: a review of classification and combining techniquesArtificial Intelligence Review, 2006
- New Applications of Ensembles of ClassifiersPattern Analysis and Applications, 2003
- Performance analysis of pattern classifier combination by plurality votingPattern Recognition Letters, 2003
- Limits on the majority vote accuracy in classifier fusionPattern Analysis and Applications, 2003
- A Decision-Theoretic Generalization of On-Line Learning and an Application to BoostingJournal of Computer and System Sciences, 1997
- Application of majority voting to pattern recognition: an analysis of its behavior and performanceIEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans, 1997
- Condorcet's Theory of VotingAmerican Political Science Review, 1988
- Optimal Decision Rules in Uncertain Dichotomous Choice SituationsInternational Economic Review, 1982