Ensemble Bagging in Binary Logistic Regression for Transportation Mode Selection
Authors:
Open Access
- 15 June 2025
- journal article
- Published by Maulana Malik Ibrahim State Islamic University in CAUCHY: Jurnal Matematika Murni dan Aplikasi
- Vol. 10 (2) , 684-697
Abstract
This study examines train versus bus transportation mode choice on the Malang–Blitar route using binary logistic regression combined with ensemble bagging. Data from 100 respondents were analyzed using 80% for training and 20% for testing with k-fold cross-validation. Variables included travel cost differences, time, safety, comfort, and ease of access. Bagging was selected over other ensemble methods due to its effectiveness in reducing variance and overfitting with small datasets. Results showed the standard logistic regression achieved 85% accuracy on test data, while ensemble bagging with 200 replications improved accuracy to 90.83% (confidence interval: 90.379%–91.187%). McNemar’s test confirmed a statistically significant improvement (p 0.01). Under equivalent conditions, 20.6% of respondents preferred trains while 79.4% chose buses. Ease of access emerged as the primary decision factor, outweighing cost and time considerations. The optimal replication number was 200; exceeding 300 replications decreased model performance. This research contributes an optimized ensemble methodology for transportation mode prediction in developing countries, demonstrating that accessibility infrastructure significantly influences passenger preferences over traditional economic factors.Keywords
This publication has 22 references indexed in Scilit:
- A machine learning comparison of transportation mode changes from high-speed railway promotion in ThailandResults in Engineering, 2024
- A prediction and behavioural analysis of machine learning methods for modelling travel mode choiceTransportation Research Part C: Emerging Technologies, 2023
- Modelling Intercity Travel Mode Choice Behavior Based on the Logistic Regression Stacking Fusion Algorithm2023
- RSS-Bagging: Improving Generalization Through the Fisher Information of Training DataIEEE Transactions on Neural Networks and Learning Systems, 2023
- Travel Mode Choice Prediction Using Imbalanced Machine LearningIEEE Transactions on Intelligent Transportation Systems, 2023
- Cross validation for model selection: A review with examples from ecologyEcological Monographs, 2023
- Interpretable Machine Learning Models for Modal Split Prediction in Transportation Systems2022
- A Comparison of the Effectiveness of Techniques for Predicting Binary Dependent Variables2022
- Prediction and behavioral analysis of travel mode choice: A comparison of machine learning and logit modelsTravel Behaviour and Society, 2020
- Exploring the behaviour of base classifiers in credit scoring ensemblesExpert Systems with Applications, 2012