On Evaluating Data Preprocessing Methods for Machine Learning Models for Flight Delays
- 1 July 2018
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-8
Abstract
Flight delays cause various inconveniences for airlines, airports, and passengers. According to data provided by the Brazilian National Civil Aviation Agency (ANAC), between 2009 and 2015, about 22% of domestic flights made in Brazil were delayed by more than 15 minutes. The prediction of these delays is fundamental to mitigate their occurrence and optimize the decision-making process of an air transport system. Particularly, airlines, airports, and users may be more interested in when delays are likely to occur than the accurate prediction of the absence of delays. This paper focuses on the unbalanced distribution of the classes of delay (presence and absence) by performing an experimental evaluation of several preprocessing methods for the development of machine-learning flight delay classification models. Those models were built from a dataset that integrates national flight operations with meteorological conditions of airports. Our results indicate the models that applied the balancing techniques performed much better in predicting the occurrence of delays, getting about 60% of hits.Keywords
This publication has 17 references indexed in Scilit:
- Characterization and prediction of air traffic delaysTransportation Research Part C: Emerging Technologies, 2014
- Data science and predictionCommunications of the ACM, 2013
- The impact of flight delays on passenger demand and societal welfareTransportation Research Part E: Logistics and Transportation Review, 2012
- Data mining and preprocessing application on component reports of an airline company in TurkeyExpert Systems with Applications, 2011
- Accuracy of reinforcement learning algorithms for predicting aircraft taxi-out times: A case-study of Tampa Bay departuresTransportation Research Part C: Emerging Technologies, 2010
- Benchmarking attribute selection techniques for discrete class data miningIEEE Transactions on Knowledge and Data Engineering, 2003
- Strong optimality of the normalized ML models as universal codes and information in dataIEEE Transactions on Information Theory, 2001
- A preprocessing scheme for high-cardinality categorical attributes in classification and prediction problemsACM SIGKDD Explorations Newsletter, 2001
- A rough set approach to attribute generalization in data miningInformation Sciences, 1998
- The random subspace method for constructing decision forestsIEEE Transactions on Pattern Analysis and Machine Intelligence, 1998