A Text Mining and Statistical Approach for Assessment of Pedagogical Impact of Students’ Evaluation of Teaching and Learning Outcome in Education
Open Access
- 25 January 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 11, 9577-9596
Abstract
Technology-enhanced learning (TEL) is now at the heart of the teaching and learning processes in many higher educational institutions (HEIs). Today, educators are faced with challenges of pedagogically specifying what tools or technologies are used to support the teachers and students, and to help maintain/sustain a continuous education and practices. This study shows that there is an opportunity in use of the (educational) datasets derived about the teaching and learning processes to provide insights that can be used to foster the education process. To this effect, this study analyzes the students’ evaluation of teaching (SET) dataset ( n =471968) collected within a higher educational setting, to determine the prominent factors that influence students’ performance or the way (TEL-based) education is being delivered including its didactical impact and implications. Theoretically, the study employed a mixed methodology grounded on integration of the data-structure approach and descriptive decision theory to study the rationality behind the students’ evaluation of the teaching and performance. This was done through the textual data quantification (qualitative) and statistical (quantitative) analysis. Qualitatively, the study applied the Educational Process and Data Mining (EPDM) model (text mining method) to extract the different sentiments and emotional valence expressed by the students in the SET data, and how those characteristically differ based on the period and type of evaluation they completed (between 2019 to 2021). For the quantitative analysis, the study used a multivariate analysis of covariance (MANCOVA) and multiple pairwise comparisons post-hoc tests to analyze the quantified information (average sentiment and emotional valence) that were extracted from the data to determine the marginal means of effect that the different SET types and evaluation period have on the students’ learning outcomes/perception about the teaching-learning processes, and how those may differ across the studied period (2019-2021). In addition, the study empirically discussed and shed light on the implications of the key findings for TEL-based Education, particularly implemented by the HEI during the analyzed periods. The scholastic indicators from the study shows that while the flexible digital models or instructional methods are effective for continuous education, innovative pedagogies, and teaching transformations, it also on the other hand, serves as an incentive for more robust research that idiosyncratically looks into their implications for the students’ learning outcomes and assessment done in this study.Keywords
Funding Information
- Writing Lab, Institute for Future of Education, Tecnológico de Monterrey, Mexico
This publication has 95 references indexed in Scilit:
- Gender biases in student evaluations of teachingJournal of Public Economics, 2017
- The social life of Learning Analytics: cluster analysis and the ‘performance’ of algorithmic educationLearning, Media and Technology, 2016
- THE STRATEGIC IMPLEMENTATION AND AUGMENTATION OF TECHNOLOGY ENHANCED LEARNING (TEL) IN THIRD LEVEL EDUCATION: A CRITICAL LENSINTED Proceedings, 2016
- Sentiment Analysis: Towards a Tool for Analysing Real-Time Students Feedback2014
- An evaluation of course evaluationsScienceOpen Research, 2014
- Learning AnalyticsAmerican Behavioral Scientist, 2013
- Instructor characteristics and students’ evaluation of teaching effectiveness: evidence from an Italian engineering schoolEuropean Journal of Engineering Education, 2012
- Learning analytics2012
- Descriptive Models Of Decision Making2011
- Identifying potential biasing variables in student evaluation of teaching in a newly accredited business program in the UAEInternational Journal of Educational Management, 2006