CMCraig S. Miller

Craig S. Miller

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Craig S. Miller has a total of 23 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Confounding Components: Problems with Cognitive Load Surveys in Introductory Computer Science

    by Andrea Watkins, Amber Settle, Craig S. Miller

    Background: Ongoing debates about the structure of cognitive load theory, which traditionally distinguishes among intrinsic, extraneous, and germane cognitive load, have important implications for how cognitive load is measured in educational research. Cognitive load theorists debate the distinction between germane and intrinsic load, as well as the reliability of self-reported cognitive load measures and their ability to capture germane load. Prior critiques of cognitive load surveys may equally apply to the widely used measurement tools in computer science education. Purpose: We examine whether validity concerns identified in cognitive load surveys persist in instruments adapted for computer science classrooms. Methods: Fifty-four students in an introductory computer science course were instructed using either live coding or static code examples. Students completed a pre-survey, post-test, and two cognitive load surveys. Internal consistency, predictive validity (association with student performance and instructional mode) and construct alignment between the two surveys were analyzed. Findings: One survey showed high internal consistency for intrinsic and germane cognitive load. Student performance was not predicted by either survey. Additionally, we did not find different instructional modes to correlate with cognitive load. The two surveys were consistent in measuring intrinsic and extraneous load, but inconsistent with respect to germane load. Contributions: Our findings highlight limitations of widely-used cognitive load surveys in computer science education, particularly for germane load, and recommend caution and further validation when using these instruments to assess instructional practices.

  • Open Access

    Introduction to the Special Issue on Embodiment in Computing Education

    by Craig S. Miller, Anthony Robins

    This special issue presents papers with a shared focus on the exploration or use of concepts relating to embodiment within the field of computing education. We first summarize many of the related theoretical frameworks that have been based on embodied perception and action within the fields of psychology and AI. We then introduce the 14 papers of the special issue. These cover a wide range of topics, many involving young learners, and they address both typical topics in introductory computing and the emerging field of AI education.

  • Open Access

    Live But Not Active: Minimal Effect with Passive Live Coding

    by Andrea Watkins, Amber Settle, Craig S. Miller, Eric J. Schwabe

    Background: Live coding, or the process of instructors writing code in real time in front of students, is an alternative teaching method to showing students static code examples. Variations of live coding tightly coupled with more active learning approaches are common, which can make it difficult to understand the contribution of live coding alone. Purpose: In this study, we aim to disentangle the benefits of live coding from live coding with explicit active learning approaches. We compare live coding with no added active learning components to presenting students with static code examples. Methods: We present a programming topic to over 100 students using either live coding or static code examples. To more closely parallel showing static code examples, our live coding process involves simply writing and discussing code. We compare student performance and engagement between the two session modes. Findings: Our results show no significant difference between the two presentation modes in terms of learning outcomes. This suggests that live coding in its most basic form may not be sufficiently different from showing static code examples to impact student performance. We also found that live coding students were much more likely to type code, but no more likely to display other engagement behaviors. However, of the engagement activities, only different levels of code typing corresponded with different learning outcomes. Contributions: This research highlights the need for more explicit differentiation and comparisons of live coding with and without active learning strategies.


  • Open Access

    Hash Table Notional Machines: A Comparison of 2D and 3D Representations

    by Colleen M. Lewis, Craig S. Miller, Johan Jeuring, Janice L. Pearce, Andrew Petersen

    Background: Notional machines appear to be an essential aspect of computing education, but there are few papers that identify strengths and weaknesses of particular notional machines. Purpose: This article fills a gap in the notional machine literature by using a randomized controlled trial to compare the effectiveness of different notional machine representations. Methods: Our study used notional machines for two hash table algorithms: chaining and open addressing. Students were randomly assigned a video sequence using either 2D or 3D representations. Findings: We found minimal effect of 2D vs 3D representational form on students' learning and perceptions of helpfulness. Implications: Our paper provides an example of how educational research can inform the design and evaluation of notional machines.


  • Open Access

    Comparing the Experiences of Live Coding versus Static Code Examples for Students and Instructors

    by Andrea Watkins, Craig S. Miller, Amber Settle

    Introductory programming courses can be taught in a variety of ways, including live coding, where instructors write code in real-time in front of students, or static code examples, where pre-prepared code is explained to students. While previous studies have compared live coding and static coding and their impacts on student assessment and cognitive load in large lecture environments, we present our experiences in a single lab session, highlighting student engagement differences. After presenting the same material to groups of students through a live-coding presentation and a static code presentation, we reflect on the observable differences in student engagement through an established framework of cognitive engagement. Additionally, we compare pre-surveys, post-tests, and cognitive load surveys from both groups. While our findings did not result in significant differences in student assessments, our experience highlighted differences between live and static code presentations. Live coding presentations can often take up to twice as long as static code presentations. Students may tend to ask more questions in live coding presentations, suggesting live coding provides instructors and students with more opportunities for further discussion. Live coding may also provide the instructor with additional opportunities to discuss other concepts that may not have been included in a pre-prepared presentation.


  • Open Access

    Parsons Problems and Beyond

    by Barbara J. Ericson, Paul Denny, James Prather, Rodrigo Duran, Arto Hellas, Juho Leinonen, Craig S. Miller, Briana B. Morrison, Janice L. Pearce, Susan H. Rodger

    Programming is a complex task that requires the development of many skills including knowledge of syntax, problem decomposition, algorithm development, and debugging. Code-writing activities are commonly used to help students develop these skills, but the difficulty of writing code from a blank page can overwhelm many novices. Parsons problems offer a simpler alternative to writing code by providing scrambled code blocks that must be placed in the correct order to solve a problem. In the 16 years since their introduction to the computing education community, an expansive body of literature has emerged that documents a range of tools, novel problem variations and makes numerous claims of benefits to learners. In this work, we track the origins of Parsons problems, outline their defining characteristics, and conduct a comprehensive review of the literature to document the evidence of benefits to learners and to identify gaps that require exploration. To facilitate future work, we design empirical studies and develop associated resources that are ready for deployment at a large scale. Collectively, this review and the provided experimental resources will serve as a focal point for researchers interested in advancing our understanding of Parsons problems and their benefits to learners.


  • A Guide Towards a Definition of Computational Thinking in K-12

    by Redar Ismail, Theresa A. Steinbach, Craig S. Miller

    Computational thinking (CT) has been described as a set of valuable skills for tackling complex problems. To foster CT among K-12 students, different initiatives have been introduced by governmental and non-governmental entities, and numerous studies have been carried out by researchers to define and integrate CT into school curriculum. However, previous studies has shown little agreement among researchers, governmental and non-governmental sectors about a unified CT definition. These dissensions have introduced challenges in formulating a definition for CT at the K-12 level. The absence of a unified definition may increase the challenges for teachers to teach and integrate CT into school curriculum. To foster CT among K-12 students, we introduce a definition and framework for CT. We evaluated 39 articles and extracted the most common elements used in the literature to frame CT definition and describe its elements. Several studies have discussed, as well as investigated, the significance of conceptualizing and comprehending the interaction and dependency relationships among computational objects. However, our literature review discovered that little attention has been dedicated to the concept of dependency in the CT body of knowledge. Based on the literature review, we define CT as the thought process used for solving problems, and it encompasses the elements of problem decomposition, abstraction, and algorithmic thinking. We conjecture the CT definition is missing the element of dependency. In the context of CT, we define dependency as the knowledge of comprehending the interrelationships between different sections of a decomposed problem.


  • Comparison of mouse and keyboard efficiency

    by Richard C. Omanson, Craig S. Miller, Elizabeth Young, David Schwantes