Artificial intelligence supported professional prediction of Physical Activity Counseling Practices Scale in health professionals with a machine learning algorithm
Open Access
- 1 May 2025
- journal article
- Published by SAGE Publications in Digital Health
- Vol. 11
Abstract
Objective: To evaluate whether machine learning algorithms can predict healthcare professionals’ occupations (physiotherapist, nurse, and dietitian) from PACPS (Physical Activity Counseling Practices Scale) item responses. Methods: We conducted a cross-sectional study in Konya (January–April 2025) with 242 participants. Five algorithms (Random Forest, K-Nearest Neighbors, Support Vector Machine, Decision Tree, and Naive Bayes) were trained and evaluated as follows: we first performed a stratified 70:30 split of the original dataset (train n = 126, test n = 116). Data augmentation was then applied only to the training set to address class imbalance, increasing it to n = 269, while the test set remained untouched (n = 116), preserving an effective ≈70:30 ratio. Performance was assessed on the independent test set (n = 116) using accuracy, precision, recall, and F1-score. Random Forest feature importance was examined to aid interpretability. Results: On the test set (n = 116), accuracies were 0.76 (Support Vector Machine), 0.82 (K-Nearest Neighbors), 0.71 (Naive Bayes), 0.75 (Random Forest), and 0.67 (Decision Tree). Random Forest identified PACPS12 as the most informative item for discrimination among occupations. Conclusion: PACPS responses contain distinctive patterns that enable moderate occupation prediction, with SVM and KNN yielding the best generalization in this small-sample setting. These results support the feasibility of combining a clinically grounded scale with machine learning methods, while underscoring the need for larger and externally validated datasets before clinical implementation.Keywords
This publication has 25 references indexed in Scilit:
- World Medical Association Declaration of HelsinkiJAMA, 2025
- Comparing classic regression with credit scorecard model for predicting sick building syndrome risk: A machine learning perspective in environmental assessmentBuilding and Environment, 2024
- The accuracy of machine learning models relies on hyperparameter tuning: student result classification using random forest, randomized search, grid search, bayesian, genetic, and optuna algorithmsMultimedia Tools and Applications, 2024
- Diabetes prediction using supervised machine learningProcedia Computer Science, 2023
- Recent advances in decision trees: an updated surveyArtificial Intelligence Review, 2022
- Reduction of training data for support vector machine: a surveySoft Computing, 2022
- mics-library: A Python package for reproducible studies on the Multiple Indicator Cluster SurveySoftwareX, 2021
- Modeling alpine grassland forage phosphorus based on hyperspectral remote sensing and a multi-factor machine learning algorithm in the east of Tibetan Plateau, ChinaISPRS Journal of Photogrammetry and Remote Sensing, 2019
- Primary care providers' physical activity counseling and referral practices and barriers for cardiovascular disease preventionPreventive Medicine, 2018
- The Elements of Statistical Learning2009