Yiming Liu
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Yiming Liu has a total of 14 co-authors. Here are the top co-authors by number of shared publications:
- Jeremy Tzi Dong Ng
The University of Hong Kong
4 shared publications - Xiao Hu
Faculty of Education The University of Hong Kong Hong Kong Hong Kong
4 shared publications - Xiaoyan Lai
School of Educational Sciences, Guangdong Polytechnic Normal University, Guangzhou, China
2 shared publications - Zhengyang Ma
Computational Media and Arts Thrust, The Hong Kong University of Science and Technology (Guangzhou), Guangzhou, China
2 shared publications - Didier S. Y. Chui
Faculty of Education, The University of Hong Kong, Hong Kong
1 shared publication - Jack C. H. Man
Faculty of Education, The University of Hong Kong, Hong Kong
1 shared publication
Latest Publications
- Open Access
- 3 March 2025
- Published by Association for Computing Machinery (ACM)
- p. 963-969
Multimodal learning analytics for game-based assessment of collaborative problem solving skills among young students
Collaborative Problem Solving (CPS) has emerged as a key competence for the 21st century. In support of this, valid assessments of CPS skills have become critical. However, limited research has designed and developed CPS assessments for young students. Based on multimodal learning analytics, we aim to develop and validate a game-based assessment of CPS for primary school students. In this study, evidence centered design approach was used to design and develop the game-based CPS assessment. Specifically, we designed and developed a mobile multiplayer online 3D role-playing game on CPS and a coding scheme for coding students’ gameplay data (i.e., game logs and voice chat) based on the ATC21S CPS framework. A total of 32 primary 5 students participated in this study to play the game in a group of four and complete a questionnaire of CPS skills. The gameplay data were coded based on our coding scheme. Correlation analysis between the coded results and the CPS questionnaire data supported the criterion validity of our game-based assessment measure. Additionally, the results of expert interview facilitated our understanding of assessment design and data use. This study will make methodological and practical contributions to the integration of MMLA into game-based CPS assessments.
- 3 March 2025
- Published by Association for Computing Machinery (ACM)
- p. 963-969
Open AccessMultimodal learning analytics for game-based assessment of collaborative problem solving skills among young students
Collaborative Problem Solving (CPS) has emerged as a key competence for the 21st century. In support of this, valid assessments of CPS skills have become critical. However, limited research has designed and developed CPS assessments for young students. Based on multimodal learning analytics, we aim to develop and validate a game-based assessment of CPS for primary school students. In this study, evidence centered design approach was used to design and develop the game-based CPS assessment. Specifically, we designed and developed a mobile multiplayer online 3D role-playing game on CPS and a coding scheme for coding students’ gameplay data (i.e., game logs and voice chat) based on the ATC21S CPS framework. A total of 32 primary 5 students participated in this study to play the game in a group of four and complete a questionnaire of CPS skills. The gameplay data were coded based on our coding scheme. Correlation analysis between the coded results and the CPS questionnaire data supported the criterion validity of our game-based assessment measure. Additionally, the results of expert interview facilitated our understanding of assessment design and data use. This study will make methodological and practical contributions to the integration of MMLA into game-based CPS assessments.
- Open Access
- 10 July 2024
- Published by Springer Nature in Education and Information Technologies
- Vol. 30 (2) , 1745-1776
Ready or not? Investigating in-service teachers’ integration of learning analytics dashboard for assessing students’ collaborative problem solving in K–12 classrooms
Collaborative problem solving (CPS) has emerged as a crucial 21st century competence that benefits students’ studies, future careers, and general well-being, prevailing across disciplines and learning approaches. Given the complex and dynamic nature of CPS, teacher-facing learning analytics dashboards (LADs) have increasingly been adopted to support teachers’ CPS assessments by analysing and visualising various dimensions of students’ CPS. However, there is limited research investigating K-12 teachers’ integration of LADs for CPS assessments in authentic classrooms. In this study, a LAD was implemented to assist K-12 teachers in assessing students’ CPS skills in an educational game. Based on the person-environment fit theory, this study aimed to (1) examine the extent to which teachers’ environmental and personal factors influence LAD usage intention and behaviour and (2) identify personal factors mediating the relationships between environmental factors and LAD usage intention and behaviour. Survey data of 300 in-service teachers from ten Chinese K-12 schools were collected and analysed using partial least squares structural equation modelling (PLS-SEM). Results indicated that our proposed model showed strong in-sample explanatory power and out-of-sample predictive capability. Additionally, subjective norms affected technological pedagogical content knowledge (TPACK) and self-efficacy, while school support affected technostress and self-efficacy. Moreover, subjective norms, technostress, and self-efficacy predicted behavioural intention, while school support, TPACK, and behavioural intention predicted actual behaviour. As for mediation effects, school support indirectly affected behavioural intention through self-efficacy, while subjective norms indirectly affected behavioural intention through self-efficacy and affected actual behaviour through TPACK. This study makes theoretical, methodological, and practical contributions to technology integration in general and LAD implementation in particular.
- 10 July 2024
- Published by Springer Nature in Education and Information Technologies
- Vol. 30 (2) , 1745-1776
Open AccessReady or not? Investigating in-service teachers’ integration of learning analytics dashboard for assessing students’ collaborative problem solving in K–12 classrooms
Collaborative problem solving (CPS) has emerged as a crucial 21st century competence that benefits students’ studies, future careers, and general well-being, prevailing across disciplines and learning approaches. Given the complex and dynamic nature of CPS, teacher-facing learning analytics dashboards (LADs) have increasingly been adopted to support teachers’ CPS assessments by analysing and visualising various dimensions of students’ CPS. However, there is limited research investigating K-12 teachers’ integration of LADs for CPS assessments in authentic classrooms. In this study, a LAD was implemented to assist K-12 teachers in assessing students’ CPS skills in an educational game. Based on the person-environment fit theory, this study aimed to (1) examine the extent to which teachers’ environmental and personal factors influence LAD usage intention and behaviour and (2) identify personal factors mediating the relationships between environmental factors and LAD usage intention and behaviour. Survey data of 300 in-service teachers from ten Chinese K-12 schools were collected and analysed using partial least squares structural equation modelling (PLS-SEM). Results indicated that our proposed model showed strong in-sample explanatory power and out-of-sample predictive capability. Additionally, subjective norms affected technological pedagogical content knowledge (TPACK) and self-efficacy, while school support affected technostress and self-efficacy. Moreover, subjective norms, technostress, and self-efficacy predicted behavioural intention, while school support, TPACK, and behavioural intention predicted actual behaviour. As for mediation effects, school support indirectly affected behavioural intention through self-efficacy, while subjective norms indirectly affected behavioural intention through self-efficacy and affected actual behaviour through TPACK. This study makes theoretical, methodological, and practical contributions to technology integration in general and LAD implementation in particular.
- 10 November 2023
- Published by Elsevier in Computers & Education
- Vol. 209
Adopt or abandon: Facilitators and barriers of in-service teachers’ integration of game learning analytics in K–12 classrooms?
- 10 November 2023
- Published by Elsevier in Computers & Education
- Vol. 209
Adopt or abandon: Facilitators and barriers of in-service teachers’ integration of game learning analytics in K–12 classrooms?
- 5 October 2023
- Published by Springer Nature in Education and Information Technologies
- Vol. 29 (9) , 10437-10472
How teachers’ self-regulation, emotions, perceptions, and experiences predict their capacities for learning analytics dashboard: A Bayesian approach
- 5 October 2023
- Published by Springer Nature in Education and Information Technologies
- Vol. 29 (9) , 10437-10472
How teachers’ self-regulation, emotions, perceptions, and experiences predict their capacities for learning analytics dashboard: A Bayesian approach
- Open Access
- 13 March 2023
- Published by Association for Computing Machinery (ACM)
- p. 670-676
Leveraging LMS Logs to Analyze Self-Regulated Learning Behaviors in a Maker-based Course
Existing learning analytics (LA) studies on self-regulated learning (SRL) have rarely focused on maker education that emphasizes student autonomy in their learning process. Towards using LA methods for generating evidence of SRL in maker-based courses, this study leverages logs of a learning management system (LMS) with its activity design aligned with the maker-based pedagogy. We explored frequencies and sequential patterns of students’ SRL behaviors as reflected in the LMS logs and their relations with learning performance. Adopting a mixed method approach, we collected and triangulated both quantitative (i.e., system logs, performance scores) and qualitative (i.e., student-written reflections) data sources from 104 students. Based on current LA-based SRL research, we developed an LMS log-based analytic framework to define the SRL phases and behaviors applicable to maker activities. Statistical, data mining, and qualitative analysis methods were conducted on 48,602 logged events and 131 excerpts extracted from student reflections. Results reveal that high-performing students demonstrated some SRL behaviors (e.g., Making Personal Plans, Evaluation) more frequently than their low-performing counterparts, yet the two groups showcased fairly similar sequences of SRL behaviors. Theoretical, methodological and pedagogical implications are drawn for LA-based SRL research and maker education.
- 13 March 2023
- Published by Association for Computing Machinery (ACM)
- p. 670-676
Open AccessLeveraging LMS Logs to Analyze Self-Regulated Learning Behaviors in a Maker-based Course
Existing learning analytics (LA) studies on self-regulated learning (SRL) have rarely focused on maker education that emphasizes student autonomy in their learning process. Towards using LA methods for generating evidence of SRL in maker-based courses, this study leverages logs of a learning management system (LMS) with its activity design aligned with the maker-based pedagogy. We explored frequencies and sequential patterns of students’ SRL behaviors as reflected in the LMS logs and their relations with learning performance. Adopting a mixed method approach, we collected and triangulated both quantitative (i.e., system logs, performance scores) and qualitative (i.e., student-written reflections) data sources from 104 students. Based on current LA-based SRL research, we developed an LMS log-based analytic framework to define the SRL phases and behaviors applicable to maker activities. Statistical, data mining, and qualitative analysis methods were conducted on 48,602 logged events and 131 excerpts extracted from student reflections. Results reveal that high-performing students demonstrated some SRL behaviors (e.g., Making Personal Plans, Evaluation) more frequently than their low-performing counterparts, yet the two groups showcased fairly similar sequences of SRL behaviors. Theoretical, methodological and pedagogical implications are drawn for LA-based SRL research and maker education.
- Open Access
- 23 January 2023
- Published by Frontiers Media SA in Frontiers in Psychology
- Vol. 13, 1096337
Temporal learning analytics to explore traces of self-regulated learning behaviors and their associations with learning performance, cognitive load, and student engagement in an asynchronous online course
Self-regulated learning (SRL) plays a critical role in asynchronous online courses. In recent years, attention has been focused on identifying student subgroups with different patterns of online SRL behaviors and comparing their learning performance. However, there is limited research leveraging traces of SRL behaviors to detect student subgroups and examine the subgroup differences in cognitive load and student engagement. The current study tracked the engagement of 101 graduate students with SRL-enabling tools integrated into an asynchronous online course. According to the recorded SRL behaviors, this study identified two distinct student subgroups, using sequence analysis and cluster analysis: high SRL (H-SRL) and low SRL (L-SRL) groups. The H-SRL group showed lower extraneous cognitive load and higher learning performance, germane cognitive load, and cognitive engagement than the L-SRL group did. Additionally, this study articulated and compared temporal patterns of online SRL behaviors between the student subgroups combining lag sequential analysis and epistemic network analysis. The results revealed that both groups followed three phases of self-regulation but performed off-task behaviors. Additionally, the H-SRL group preferred activating mastery learning goals to improve ethical knowledge, whereas the L-SRL group preferred choosing performance-avoidance learning goals to pass the unit tests. The H-SRL group invested more in time management and notetaking, whereas the L-SRL group engaged more in surface learning approaches. This study offers researchers both theoretical and methodological insights. Additionally, our research findings help inform practitioners about how to design and deploy personalized SRL interventions in asynchronous online courses.
- 23 January 2023
- Published by Frontiers Media SA in Frontiers in Psychology
- Vol. 13, 1096337
Open AccessTemporal learning analytics to explore traces of self-regulated learning behaviors and their associations with learning performance, cognitive load, and student engagement in an asynchronous online course
Self-regulated learning (SRL) plays a critical role in asynchronous online courses. In recent years, attention has been focused on identifying student subgroups with different patterns of online SRL behaviors and comparing their learning performance. However, there is limited research leveraging traces of SRL behaviors to detect student subgroups and examine the subgroup differences in cognitive load and student engagement. The current study tracked the engagement of 101 graduate students with SRL-enabling tools integrated into an asynchronous online course. According to the recorded SRL behaviors, this study identified two distinct student subgroups, using sequence analysis and cluster analysis: high SRL (H-SRL) and low SRL (L-SRL) groups. The H-SRL group showed lower extraneous cognitive load and higher learning performance, germane cognitive load, and cognitive engagement than the L-SRL group did. Additionally, this study articulated and compared temporal patterns of online SRL behaviors between the student subgroups combining lag sequential analysis and epistemic network analysis. The results revealed that both groups followed three phases of self-regulation but performed off-task behaviors. Additionally, the H-SRL group preferred activating mastery learning goals to improve ethical knowledge, whereas the L-SRL group preferred choosing performance-avoidance learning goals to pass the unit tests. The H-SRL group invested more in time management and notetaking, whereas the L-SRL group engaged more in surface learning approaches. This study offers researchers both theoretical and methodological insights. Additionally, our research findings help inform practitioners about how to design and deploy personalized SRL interventions in asynchronous online courses.
- 20 July 2021
- Published by Taylor & Francis in Interactive Learning Environments
- Vol. 31 (7) , 4156-4170
Comparing technology acceptance of AR-based and 3D map-based mobile library applications: a multigroup SEM analysis
This study integrated augmented reality (AR) and three-dimensional (3D) maps into mobile learning for library use instruction. To maximize the benefits of mobile library applications (MLAs), their technology acceptance was examined. Because of the e-learning context, the General Extended Technology Acceptance Model for E-Learning (GETAMEL) developed by Abdullah and Ward ([2016]. Developing a general extended technology acceptance model for e-learning (GETAMEL) by analysing commonly used external factors. Computers in Human Behavior, 56, 238–256) was used. A total of 450 university students participated in this study. Structural equation modeling was conducted to identify factors influencing MLA adoption, to test the measurement invariance of the GETAMEL questionnaire and to compare the structural coefficients of GETAMEL between the AR and 3D map groups. The results showed that subjective norms, enjoyment, computer-related experience, self-efficacy, perceived ease of use, and perceived usefulness are essential for designing MLA. Moreover, the measures of the questionnaire had the same meanings across the two MLAs, and the impacts of perceived usefulness and perceived ease of use on behavioral intention differed significantly across the two groups, suggesting that AR-based MLA suits people who are not familiar with libraries, whereas 3D map-based MLA suits people who want to find research materials immediately.
- 20 July 2021
- Published by Taylor & Francis in Interactive Learning Environments
- Vol. 31 (7) , 4156-4170
Comparing technology acceptance of AR-based and 3D map-based mobile library applications: a multigroup SEM analysis
This study integrated augmented reality (AR) and three-dimensional (3D) maps into mobile learning for library use instruction. To maximize the benefits of mobile library applications (MLAs), their technology acceptance was examined. Because of the e-learning context, the General Extended Technology Acceptance Model for E-Learning (GETAMEL) developed by Abdullah and Ward ([2016]. Developing a general extended technology acceptance model for e-learning (GETAMEL) by analysing commonly used external factors. Computers in Human Behavior, 56, 238–256) was used. A total of 450 university students participated in this study. Structural equation modeling was conducted to identify factors influencing MLA adoption, to test the measurement invariance of the GETAMEL questionnaire and to compare the structural coefficients of GETAMEL between the AR and 3D map groups. The results showed that subjective norms, enjoyment, computer-related experience, self-efficacy, perceived ease of use, and perceived usefulness are essential for designing MLA. Moreover, the measures of the questionnaire had the same meanings across the two MLAs, and the impacts of perceived usefulness and perceived ease of use on behavioral intention differed significantly across the two groups, suggesting that AR-based MLA suits people who are not familiar with libraries, whereas 3D map-based MLA suits people who want to find research materials immediately.