Machine Learning Algorithms to Predict Digital Competencies in University Faculty
Open Access
- 10 June 2025
- journal article
- Published by F1000 Research Ltd in F1000Research
- Vol. 14, 573
Abstract
Background The digital transformation of higher education has intensified the need to assess and enhance the digital competencies of university faculty. This study analyzed the effectiveness of various machine learning algorithms in predicting levels of faculty digital competence based on socio-educational variables. The objective was to develop an advanced predictive model, applied to faculty members from the State University of Milagro and the Technical University of Manabí. Methods A quantitative approach was adopted, with a cross-sectional correlational design. Digital competencies were measured using the internationally validated DigCompEdu Check-In instrument, structured across six core dimensions. In the predictive phase, nine supervised machine learning algorithms were trained and evaluated: logistic regression, decision trees, random forest, gradient boosting, k-nearest neighbors, support vector machines, stochastic gradient descent, artificial neural networks, and Naive Bayes. The models were trained using a dataset comprising 4,154 observations, and their performance was assessed using standard classification metrics: area under the ROC curve (AUC), accuracy, F1-score, sensitivity, and Matthew’s correlation coefficient (MCC). Results Gradient boosting, random forest, and neural network models demonstrated superior predictive performance, particularly at advanced competence levels (B2 and C1). Significant associations were identified between academic level, age, gender, and digital competencies. Logistic regression and Naive Bayes showed limitations in identifying low competence levels (A1), while intermediate levels were often overestimated across several models. Conclusions The findings confirm that machine learning algorithms can accurately predict university faculty digital competencies. Advanced models outperformed traditional ones, especially at higher competence levels. It is recommended to incorporate contextual variables and validate the models in diverse educational settings.Keywords
This publication has 54 references indexed in Scilit:
- Introducing the Hyperdynamic Adaptive Learning Fusion (HALF) model for superior predictive analytics in E-learningNeural Computing and Applications, 2025
- How do vocational teachers use technology? The role of perceived digital competence and perceived usefulness in technology use across different teaching profilesVocations and Learning, 2025
- The power of Deep Learning techniques for predicting student performance in Virtual Learning Environments: A systematic literature reviewComputers and Education: Artificial Intelligence, 2024
- RETRACTED ARTICLE: Integrating Moral Education and Educational Information Technology: A Strategic Approach to Enhance Rural Teacher Training in UniversitiesJournal of the Knowledge Economy, 2023
- A decade of digital maturity models: much ado about nothing?Information Systems and e-Business Management, 2023
- RETRACTED ARTICLE: Navigating Digital Learning Landscapes: Unveiling the Interplay Between Learning Behaviors, Digital Literacy, and Educational OutcomesJournal of the Knowledge Economy, 2023
- The use of a personalized learning approach to implementing self-regulated online learningComputers and Education: Artificial Intelligence, 2022
- One-size does not fit all: Towards an adaptive model to develop preservice teachers’ digital competenciesComputers in Human Behavior, 2021
- Digitalization in Education: Challenges, Trends and Transformative Potential2020
- A study on academic staff personality and technology acceptance: The case of communication and collaboration applicationsComputers & Education, 2019