Jinnie Shin
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Jinnie Shin has a total of 51 co-authors. Here are the top co-authors by number of shared publications:
- Okan Bulut
Centre for Research in Applied Measurement and Evaluation, University of Alberta, Edmonton, AB T6G 2G5, Canada
6 shared publications Mark J. Gierl
Department of Educational Psychology, University of Alberta, Edmonton, Canada
4 shared publications- Pauline Aguinalde
School of Human Development and Organizational Studies in Education University of Florida Gainesville Florida USA
4 shared publications - Guher Gorgun
Institut für Erziehungswissenschaften, Europa-Universität Flensburg, 24943 Flensburg, Germany
2 shared publications - Maria S. Carlo
University of Miami, USA
2 shared publications - Michelle Banawan
Aboitiz School of Innovation, Technology, and Entrepreneurship, Asian Institute of Management, Makati City, Metro Manila, Philippines
2 shared publications
Latest Publications
- 25 June 2026
- Published by Springer Nature
- p. 309-323
Modeling Completion Time in Mathematics Formative Assessments: Content-Based Prediction of Time Variation
- 25 June 2026
- Published by Springer Nature
- p. 309-323
Modeling Completion Time in Mathematics Formative Assessments: Content-Based Prediction of Time Variation
- 22 January 2026
- Published by Taylor & Francis in Interactive Learning Environments
- Vol. 34 (7) , 1-22
CATALYST: learner feedback mining with an LLM-based automated thematic analysis
- 22 January 2026
- Published by Taylor & Francis in Interactive Learning Environments
- Vol. 34 (7) , 1-22
CATALYST: learner feedback mining with an LLM-based automated thematic analysis
- Top Cited Papers
- 9 January 2026
- Published by Wiley in Journal of Engineering Education
- Vol. 115 (1)
Systematic review of work‐integrated learning in undergraduate engineering education
Background: Work‐integrated learning (WIL) is a pedagogical approach combining classroom learning with practical experience. Despite its growing popularity, there is a need for a comprehensive understanding of the characteristics, trends, and outcomes of intervention studies. Purpose: This systematic review explores the current research on WIL intervention studies, examining publication venues, research aims, methodologies, and outcomes, as well as the implications and challenges. Design/Method: The structured and predefined PRISMA process was used to identify relevant studies published in peer‐reviewed journals and conference proceedings, ensuring rigor, precision, and replicability. A typological framework was developed and applied to extract and categorize data from the included studies, which were then synthesized to identify patterns and trends. Results: The review included 22 studies between 2014 and 2023. Although the study quality was generally low across journal articles and conference proceedings, the included studies nevertheless provided essential insights. International interest in this topic is evident, growing, and exploratory, with a potential bias toward individual factors and little consideration of institutional or cultural factors. The methodologies included various approaches, but the lack of unifying frameworks suggests that the outcomes are likely context‐dependent. The benefits of WIL were numerous and multifaceted, while the challenges highlighted the complexity institutions and industry partners face. Conclusions: This study provides a comprehensive overview of current research on WIL intervention studies. The findings highlight the importance of theoretical underpinnings, research aims, and methodologies in WIL research. The results have implications for educators, policymakers, and researchers seeking to improve the effectiveness of WIL programs.
- 9 January 2026
- Published by Wiley in Journal of Engineering Education
- Vol. 115 (1)
Top Cited PapersSystematic review of work‐integrated learning in undergraduate engineering education
Background: Work‐integrated learning (WIL) is a pedagogical approach combining classroom learning with practical experience. Despite its growing popularity, there is a need for a comprehensive understanding of the characteristics, trends, and outcomes of intervention studies. Purpose: This systematic review explores the current research on WIL intervention studies, examining publication venues, research aims, methodologies, and outcomes, as well as the implications and challenges. Design/Method: The structured and predefined PRISMA process was used to identify relevant studies published in peer‐reviewed journals and conference proceedings, ensuring rigor, precision, and replicability. A typological framework was developed and applied to extract and categorize data from the included studies, which were then synthesized to identify patterns and trends. Results: The review included 22 studies between 2014 and 2023. Although the study quality was generally low across journal articles and conference proceedings, the included studies nevertheless provided essential insights. International interest in this topic is evident, growing, and exploratory, with a potential bias toward individual factors and little consideration of institutional or cultural factors. The methodologies included various approaches, but the lack of unifying frameworks suggests that the outcomes are likely context‐dependent. The benefits of WIL were numerous and multifaceted, while the challenges highlighted the complexity institutions and industry partners face. Conclusions: This study provides a comprehensive overview of current research on WIL intervention studies. The findings highlight the importance of theoretical underpinnings, research aims, and methodologies in WIL research. The results have implications for educators, policymakers, and researchers seeking to improve the effectiveness of WIL programs.
- 20 July 2025
- Published by Springer Nature
- p. 164-171
Modeling Linguistic Synchrony in Online L2 Tutoring: A Transformer-Based Perspective
- 20 July 2025
- Published by Springer Nature
- p. 164-171
Modeling Linguistic Synchrony in Online L2 Tutoring: A Transformer-Based Perspective
- 10 July 2025
- Published by Wiley in Science Education
- Vol. 109 (6) , 1779-1807
Development of an Observation Protocol for Teachers' Culturally and Linguistically Responsive Science Instruction
This study is part of a larger project on culturally and linguistically responsive instruction for multilingual learners (MLs) in biology (CLIMB), aimed at enhancing MLs’ engagement in science practices, biology content, and language development. We developed the CLIMB observation protocol to capture how teachers implement responsive instruction, integrating language development, biology content, and science practices. The protocol is comprised of six elements that align with research‐backed practices to support MLs: Attention to Language, Multiple Modalities, Collaboration, Affirming Identities, Funds of Knowledge, and Sociopolitical Consciousness. Through three iterative phases—domain specification and expert review, item revision with teacher feedback, and pilot testing—we describe the protocol's development and provide validity evidence for its use in observing biology teachers of MLs. Results provide evidence for the validity and reliability of the CLIMB protocol in capturing teachers’ culturally and linguistically responsive instructional practices in secondary biology classrooms. The protocol facilitates systematic observation of instructional elements, offering a tool for researchers and practitioners to document and analyze responsive teaching for MLs. By providing a structured framework for observing instruction, the protocol advances research methodology in science education, particularly for studies involving MLs. Although developed in a biology education context, this protocol offers a model for adaptation to other science disciplines seeking to integrate culturally and linguistically responsive instruction. Future work may use this tool to examine relationships between observed instructional practices and MLs’ science learning outcomes.
- 10 July 2025
- Published by Wiley in Science Education
- Vol. 109 (6) , 1779-1807
Development of an Observation Protocol for Teachers' Culturally and Linguistically Responsive Science Instruction
This study is part of a larger project on culturally and linguistically responsive instruction for multilingual learners (MLs) in biology (CLIMB), aimed at enhancing MLs’ engagement in science practices, biology content, and language development. We developed the CLIMB observation protocol to capture how teachers implement responsive instruction, integrating language development, biology content, and science practices. The protocol is comprised of six elements that align with research‐backed practices to support MLs: Attention to Language, Multiple Modalities, Collaboration, Affirming Identities, Funds of Knowledge, and Sociopolitical Consciousness. Through three iterative phases—domain specification and expert review, item revision with teacher feedback, and pilot testing—we describe the protocol's development and provide validity evidence for its use in observing biology teachers of MLs. Results provide evidence for the validity and reliability of the CLIMB protocol in capturing teachers’ culturally and linguistically responsive instructional practices in secondary biology classrooms. The protocol facilitates systematic observation of instructional elements, offering a tool for researchers and practitioners to document and analyze responsive teaching for MLs. By providing a structured framework for observing instruction, the protocol advances research methodology in science education, particularly for studies involving MLs. Although developed in a biology education context, this protocol offers a model for adaptation to other science disciplines seeking to integrate culturally and linguistically responsive instruction. Future work may use this tool to examine relationships between observed instructional practices and MLs’ science learning outcomes.
- 3 June 2025
- Published by Springer Nature in Behavior Research Methods
- Vol. 57 (7) , 1-18
Investigating the effect of transformer encoder architecture to improve the reliability of classroom observation ratings on high-inference discourse
This study investigates the effect of transformer encoder architecture on the classification accuracy of high-inference discourse elements in classroom set
- 3 June 2025
- Published by Springer Nature in Behavior Research Methods
- Vol. 57 (7) , 1-18
Investigating the effect of transformer encoder architecture to improve the reliability of classroom observation ratings on high-inference discourse
This study investigates the effect of transformer encoder architecture on the classification accuracy of high-inference discourse elements in classroom set
- 1 June 2025
- Published by Wiley in Journal of Educational Measurement
- Vol. 62 (2) , 248-281
Evaluating the Consistency and Reliability of Attribution Methods in Automated Short Answer Grading (ASAG) Systems: Toward an Explainable Scoring System
In recent years, the application of explainability techniques to automated essay scoring and automated short‐answer grading (ASAG) models, particularly those based on transformer architectures, has gained significant attention. However, the reliability and consistency of these techniques remain underexplored. This study systematically investigates the use of attribution scores in ASAG systems, focusing on their consistency in reflecting model decisions. Specifically, we examined how attribution scores generated by different methods—namely Local Interpretable Model‐agnostic Explanations (LIME), Integrated Gradients (IG), Hierarchical Explanation via Divisive Generation (HEDGE), and Leave‐One‐Out (LOO)—compare in their consistency and ability to illustrate the decision‐making processes of transformer‐based scoring systems trained on a publicly available response dataset. Additionally, we analyzed how attribution scores varied across different scoring categories in a polytomously scored response dataset and across two transformer‐based scoring model architectures: Bidirectional Encoder Representations from Transformers (BERT) and Decoding‐enhanced BERT with Disentangled Attention (DeBERTa‐v2). Our findings highlight the challenges in evaluating explainability metrics, with important implications for both high‐stakes and formative assessment contexts. This study contributes to the development of more reliable and transparent ASAG systems.
- 1 June 2025
- Published by Wiley in Journal of Educational Measurement
- Vol. 62 (2) , 248-281
Evaluating the Consistency and Reliability of Attribution Methods in Automated Short Answer Grading (ASAG) Systems: Toward an Explainable Scoring System
In recent years, the application of explainability techniques to automated essay scoring and automated short‐answer grading (ASAG) models, particularly those based on transformer architectures, has gained significant attention. However, the reliability and consistency of these techniques remain underexplored. This study systematically investigates the use of attribution scores in ASAG systems, focusing on their consistency in reflecting model decisions. Specifically, we examined how attribution scores generated by different methods—namely Local Interpretable Model‐agnostic Explanations (LIME), Integrated Gradients (IG), Hierarchical Explanation via Divisive Generation (HEDGE), and Leave‐One‐Out (LOO)—compare in their consistency and ability to illustrate the decision‐making processes of transformer‐based scoring systems trained on a publicly available response dataset. Additionally, we analyzed how attribution scores varied across different scoring categories in a polytomously scored response dataset and across two transformer‐based scoring model architectures: Bidirectional Encoder Representations from Transformers (BERT) and Decoding‐enhanced BERT with Disentangled Attention (DeBERTa‐v2). Our findings highlight the challenges in evaluating explainability metrics, with important implications for both high‐stakes and formative assessment contexts. This study contributes to the development of more reliable and transparent ASAG systems.
- 13 March 2025
- Published by Elsevier in Research Methods in Applied Linguistics
- Vol. 4 (2)
Systematic comparison of computational measures of linguistic synchrony in online educational environments
- 13 March 2025
- Published by Elsevier in Research Methods in Applied Linguistics
- Vol. 4 (2)
Systematic comparison of computational measures of linguistic synchrony in online educational environments
- Open Access
- 3 March 2025
- Published by Association for Computing Machinery (ACM)
- p. 395-406
Talking in Sync: How Linguistic Synchrony Shapes Teacher-Student Conversation in English as a Second Language Tutoring Environment
- 3 March 2025
- Published by Association for Computing Machinery (ACM)
- p. 395-406
Open AccessTalking in Sync: How Linguistic Synchrony Shapes Teacher-Student Conversation in English as a Second Language Tutoring Environment