Luc Paquette
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Luc Paquette has a total of 56 co-authors. Here are the top co-authors by number of shared publications:
- Yingbin Zhang
Institute of Artificial Intelligence in Education, South China Normal University, Guangzhou, China
10 shared publications - André Mayers
Université de Sherbrooke
9 shared publications Jean-François Lebeau
Université de Sherbrooke
8 shared publications- Ryan Shaun Baker
Adelaide University
8 shared publications - Juan D. Pinto
University of Illinois Urbana-Champaign
6 shared publications - Nigel Bosch
University of Illinois Urbana-Champaign, Champaign, IL, USA
6 shared publications
Latest Publications
- Open Access
- 3 June 2026
- Published by Wiley in Journal of Computer Assisted Learning
- Vol. 42 (4) , e70269
Leveraging Multimodal Large Language Models to Analyse Student Exploration Behaviours in Educational Game Environments
Background: Video data provides rich opportunities to examine student behaviour in game‐based learning environments, capturing not only observable actions but also subtle indicators of cognitive engagement. However, traditional video analysis is labor‐intensive, and current applications of AI to this task are limited by models trained on general‐purpose datasets, which often fail to capture the pedagogical meaning of student actions in authentic educational contexts. Objectives: This study explores how multimodal large language models (MLLMs), specifically LLaVA‐Video‐7B‐Qwen2, can support qualitative video analysis of student exploration behaviours in a Minecraft‐based STEM learning environment. Methods: We conducted an exploratory case study using screen recordings from a Minecraft‐based STEM learning environment. We tested multiple prompt strategies for guiding MLLM‐generated video descriptions and found that role‐assignment prompting performed most effectively. We evaluated model outputs using a mixed‐method framework that included quantitative scoring, GPT‐based judgement, and researcher validation. Results and Conclusions: Our findings show that MLLMs can reliably identify surface‐level behaviours, such as navigation patterns and object interactions, but struggle to infer the intent or goals behind student actions, leading to a significant rate of over‐interpretation (26.5% when explaining student strategies). The model's outputs are sensitive to prompt phrasing, underscoring the importance of prompt engineering. While current MLLMs show promise for streamlining parts of the video analysis workflow, their use in educational contexts requires structured oversight and careful interpretation to ensure reliability and relevance.
- 3 June 2026
- Published by Wiley in Journal of Computer Assisted Learning
- Vol. 42 (4) , e70269
Open AccessLeveraging Multimodal Large Language Models to Analyse Student Exploration Behaviours in Educational Game Environments
Background: Video data provides rich opportunities to examine student behaviour in game‐based learning environments, capturing not only observable actions but also subtle indicators of cognitive engagement. However, traditional video analysis is labor‐intensive, and current applications of AI to this task are limited by models trained on general‐purpose datasets, which often fail to capture the pedagogical meaning of student actions in authentic educational contexts. Objectives: This study explores how multimodal large language models (MLLMs), specifically LLaVA‐Video‐7B‐Qwen2, can support qualitative video analysis of student exploration behaviours in a Minecraft‐based STEM learning environment. Methods: We conducted an exploratory case study using screen recordings from a Minecraft‐based STEM learning environment. We tested multiple prompt strategies for guiding MLLM‐generated video descriptions and found that role‐assignment prompting performed most effectively. We evaluated model outputs using a mixed‐method framework that included quantitative scoring, GPT‐based judgement, and researcher validation. Results and Conclusions: Our findings show that MLLMs can reliably identify surface‐level behaviours, such as navigation patterns and object interactions, but struggle to infer the intent or goals behind student actions, leading to a significant rate of over‐interpretation (26.5% when explaining student strategies). The model's outputs are sensitive to prompt phrasing, underscoring the importance of prompt engineering. While current MLLMs show promise for streamlining parts of the video analysis workflow, their use in educational contexts requires structured oversight and careful interpretation to ensure reliability and relevance.
- Open Access
- 30 January 2026
- Published by Serious Games Society in International Journal of Serious Games
- p. 19-40
Exploring Player Archetypes in a Minecraft-Based Learning Environment
Games are recognized as valuable tools for learning and interest development. However, the association between behavioral player archetypes and these important outcomes is still underexplored. This study explores the relationship between learning, interest development, and player archetypes (Roamers, Explorers, and Scientists) identified within the WHIMC project, a game-based learning environment where students engage with scientifically accurate hypothetical astronomy scenarios in Minecraft. Grounded in human-computer interaction and player typologies frameworks, we analyze data from 57 participants across four summer camps using Ordered Network Analysis (ONA) and k-means clustering to identify player archetypes emerging from student actions. We then examine how these archetypes relate to learning outcomes and motivational factors. Statistical tests reveal significant differences in in-game actions across archetypes and correlations between player behaviors and learning outcomes. These findings contribute to the design of serious educational games by increasing understanding of how to optimize experiences and enhance science engagement for learners with differing playing styles.
- 30 January 2026
- Published by Serious Games Society in International Journal of Serious Games
- p. 19-40
Open AccessExploring Player Archetypes in a Minecraft-Based Learning Environment
Games are recognized as valuable tools for learning and interest development. However, the association between behavioral player archetypes and these important outcomes is still underexplored. This study explores the relationship between learning, interest development, and player archetypes (Roamers, Explorers, and Scientists) identified within the WHIMC project, a game-based learning environment where students engage with scientifically accurate hypothetical astronomy scenarios in Minecraft. Grounded in human-computer interaction and player typologies frameworks, we analyze data from 57 participants across four summer camps using Ordered Network Analysis (ONA) and k-means clustering to identify player archetypes emerging from student actions. We then examine how these archetypes relate to learning outcomes and motivational factors. Statistical tests reveal significant differences in in-game actions across archetypes and correlations between player behaviors and learning outcomes. These findings contribute to the design of serious educational games by increasing understanding of how to optimize experiences and enhance science engagement for learners with differing playing styles.
- Open Access
- 28 September 2025
- Published by Center for Open Science in EdArXiv
Data Plus Theory Equals Codebook: Leveraging LLMs for Human-AI Codebook Development
Recent research has explored the use of Large Language Models (LLMs) to develop qualitative codebooks, mainly for inductive work with large datasets, where manual review is impractical. Although these efforts show promise, they often neglect the theoretical grounding essential to many types of qualitative analysis. This paper investigates the potential of GPT-4o to support theory-informed codebook development across two educational contexts. In the first study, we employ a three-step approach—drawing on Winne & Hadwin’s and Zimmerman’s Self-Regulated Learning (SRL) theories, think-aloud data, and human refinement—to evaluate GPT-4o’s ability to generate high-quality, theory-aligned codebooks. Results indicate that GPT-4o can effectively leverage its knowledge base to identify SRL constructs reflected in student problem-solving behavior. In the second study, we extend this approach to a STEM game-based learning context guided by Hidi & Renninger’s four-phase model of Interest Development. We compare four prompting strategies: No theories provided, theories named, full references given, and full-text theory papers supplied. Human evaluations show that naming the theory without including full references produced the most practical and usable codebook, while supplying full papers to the prompt enhanced theoretical alignment but reduced applicability. These findings suggest that GPT-4o can be a valuable partner in theory-driven qualitative research when grounded in well-established frameworks, but that attention to prompt design is required. Our results show that widely available foundation models—trained on large-scale open web and licensed datasets—can effectively distill established educational theories to support qualitative research and codebook development.
- 28 September 2025
- Published by Center for Open Science in EdArXiv
Open AccessData Plus Theory Equals Codebook: Leveraging LLMs for Human-AI Codebook Development
Recent research has explored the use of Large Language Models (LLMs) to develop qualitative codebooks, mainly for inductive work with large datasets, where manual review is impractical. Although these efforts show promise, they often neglect the theoretical grounding essential to many types of qualitative analysis. This paper investigates the potential of GPT-4o to support theory-informed codebook development across two educational contexts. In the first study, we employ a three-step approach—drawing on Winne & Hadwin’s and Zimmerman’s Self-Regulated Learning (SRL) theories, think-aloud data, and human refinement—to evaluate GPT-4o’s ability to generate high-quality, theory-aligned codebooks. Results indicate that GPT-4o can effectively leverage its knowledge base to identify SRL constructs reflected in student problem-solving behavior. In the second study, we extend this approach to a STEM game-based learning context guided by Hidi & Renninger’s four-phase model of Interest Development. We compare four prompting strategies: No theories provided, theories named, full references given, and full-text theory papers supplied. Human evaluations show that naming the theory without including full references produced the most practical and usable codebook, while supplying full papers to the prompt enhanced theoretical alignment but reduced applicability. These findings suggest that GPT-4o can be a valuable partner in theory-driven qualitative research when grounded in well-established frameworks, but that attention to prompt design is required. Our results show that widely available foundation models—trained on large-scale open web and licensed datasets—can effectively distill established educational theories to support qualitative research and codebook development.
- Open Access
- 12 February 2025
- Published by Association for Computing Machinery (ACM)
- p. 1337-1343
Investigating the Presence and Development of Student Instructor Preferences in a Large-Scale CS1 Course
Prior research has established the importance of student instructor preferences and identified various influencing factors. However, the dynamics of how student instructor preferences develop and change are less well understood, due to the limitations of common course structures and reliance on one-time measurements. To bridge this gap, we utilize data from a novel learning platform that provides students with access to instructional content created by multiple instructors. This platform enables the quantification of preference emergence and evolution throughout an entire semester, as students repeatedly select content from different instructors. Examining both initial and final student instructor preferences suggests that preference is a dynamic construct continually shaped by experiences. Furthermore, our analysis of the associations between preferences and student characteristics reveals a nuanced picture: while student attributes did not significantly correlate with initial preferences, substantial differences emerged in final preferences across genders and self-reported prior programming experience. This analysis contributes to the existing body of knowledge by expanding our understanding of student instructor preferences and student-instructor relationships in computer science education. We also provide practical insights that institutions and instructors can draw on when multiple instructors collaborate on a course.
- 12 February 2025
- Published by Association for Computing Machinery (ACM)
- p. 1337-1343
Open AccessInvestigating the Presence and Development of Student Instructor Preferences in a Large-Scale CS1 Course
Prior research has established the importance of student instructor preferences and identified various influencing factors. However, the dynamics of how student instructor preferences develop and change are less well understood, due to the limitations of common course structures and reliance on one-time measurements. To bridge this gap, we utilize data from a novel learning platform that provides students with access to instructional content created by multiple instructors. This platform enables the quantification of preference emergence and evolution throughout an entire semester, as students repeatedly select content from different instructors. Examining both initial and final student instructor preferences suggests that preference is a dynamic construct continually shaped by experiences. Furthermore, our analysis of the associations between preferences and student characteristics reveals a nuanced picture: while student attributes did not significantly correlate with initial preferences, substantial differences emerged in final preferences across genders and self-reported prior programming experience. This analysis contributes to the existing body of knowledge by expanding our understanding of student instructor preferences and student-instructor relationships in computer science education. We also provide practical insights that institutions and instructors can draw on when multiple instructors collaborate on a course.
- 2 November 2024
- Published by Springer Nature
- p. 136-151
Using LLM-Based Filtering to Develop Reliable Coding Schemes for Rare Debugging Strategies
- 2 November 2024
- Published by Springer Nature
- p. 136-151
Using LLM-Based Filtering to Develop Reliable Coding Schemes for Rare Debugging Strategies
- Open Access
- 26 October 2024
- Published by Elsevier in International Journal of Artificial Intelligence in Education
- Vol. 35 (3) , 1317-1345
Conditional and Marginal Strengths of Affect Transitions During Computer-Based Learning
- 26 October 2024
- Published by Elsevier in International Journal of Artificial Intelligence in Education
- Vol. 35 (3) , 1317-1345
Open AccessConditional and Marginal Strengths of Affect Transitions During Computer-Based Learning
- 28 September 2024
- Published by Springer Nature
- p. 93-109
Applications of Explainable AI (XAI) in Education
- 28 September 2024
- Published by Springer Nature
- p. 93-109
Applications of Explainable AI (XAI) in Education
- Open Access
- 21 July 2024
- Published by Elsevier in Computers and Education Open
- Vol. 7
Accuracy and effectiveness of an orchestration tool on instructors’ interventions and groups’ collaboration
- 21 July 2024
- Published by Elsevier in Computers and Education Open
- Vol. 7
Open AccessAccuracy and effectiveness of an orchestration tool on instructors’ interventions and groups’ collaboration