Craig J. Sutherland

Craig J. Sutherland

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Craig J. Sutherland has a total of 34 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Educator Experiences of Low Overhead Student Project Risk Management

    by Diana Kirk, Andrew Luxton-Reilly, Ewan Tempero, Tyne Crow, Paul Denny, Allan Fowler, Steffan Hooper, Andrew Meads, Asma Shakil, Paramvir Singh, et al.

    Many software-related courses at tertiary level incorporate group projects in their assessment strategy. Project goals vary according to course learning outcomes, for example, consolidating course content and preparing students for industry by providing experience in teamwork. Studies have shown that many teams experience issues that are detrimental to project goals. In this paper, we explore the use of a risk framework that has been created to support academic group projects. We invited instructors from the computer science (CS) and software engineering (SE) disciplines within our university to use the framework to support their group projects and to report on their experience. Instructors from eight courses used the framework to address different needs. Most educators found the risk framework useful but students were more indifferent or critical. An outcome of our experience is the recommendation that instructors need to ensure risk plans are implemented throughout the project and to assess risk-related activities.


  • Open Access

    Correction: The Effect of Robot Attentional Behaviors on User Perceptions and Behaviors in a Simulated Health Care Interaction: Randomized Controlled Trial

    by Deborah L Johanson, Ho Seok Ahn, Bruce A MacDonald, Byeong Kyu Ahn, JongYoon Lim, Euijun Hwang, Craig J Sutherland, Elizabeth Broadbent

    Journal of Medical Internet Research - International Scientific Journal for Medical Research, Information and Communication on the Internet


  • User Testing of Cognitive Training Games for People with Mild Cognitive Impairment: Design Implications

    by Mikaela Law, Ho Seok Ahn, Bruce MacDonald, Dina-Sara Vasjakovic, JongYoon Lim, Min Ho Lee, Craig Sutherland, Kathy Peri, Ngaire Kerse, Elizabeth Broadbent


  • Open Access

    The Effect of Robot Attentional Behaviors on User Perceptions and Behaviors in a Simulated Health Care Interaction: Randomized Controlled Trial

    by Deborah L Johanson, Ho Seok Ahn, Bruce A MacDonald, Byeong Kyu Ahn, JongYoon Lim, Euijun Hwang, Craig J Sutherland, Elizabeth Broadbent

    Background: For robots to be effectively used in health applications, they need to display appropriate social behaviors. A fundamental requirement in all social interactions is the ability to engage, maintain, and demonstrate attention. Attentional behaviors include leaning forward, self-disclosure, and changes in voice pitch. Objective: This study aimed to examine the effect of robot attentional behaviors on user perceptions and behaviors in a simulated health care interaction. Methods: A parallel randomized controlled trial with a 1:1:1:1 allocation ratio was conducted. We randomized participants to 1 of 4 experimental conditions before engaging in a scripted face-to-face interaction with a fully automated medical receptionist robot. Experimental conditions included a self-disclosure condition, voice pitch change condition, forward lean condition, and neutral condition. Participants completed paper-based postinteraction measures relating to engagement, perceived robot attention, and perceived robot empathy. We video recorded interactions and coded for participant attentional behaviors. Results: A total of 181 participants were recruited from the University of Auckland. Participants who interacted with the robot in the forward lean and self-disclosure conditions found the robot to be significantly more stimulating than those who interacted with the robot in the voice pitch or neutral conditions (P=.03). Participants in the forward lean, self-disclosure, and neutral conditions found the robot to be significantly more interesting than those in the voice pitch condition (P<.001). Participants in the forward lean and self-disclosure conditions spent significantly more time looking at the robot than participants in the neutral condition (P<.001). Significantly, more participants in the self-disclosure condition laughed during the interaction (P=.01), whereas significantly more participants in the forward lean condition leant toward the robot during the interaction (P<.001). Conclusions: The use of self-disclosure and forward lean by a health care robot can increase human engagement and attentional behaviors. Voice pitch changes did not increase attention or engagement. The small effects with regard to participant perceptions are potentially because of the limitations in self-report measures or a lack of comparison for most participants who had never interacted with a robot before. Further research could explore the use of self-disclosure and forward lean using a within-subjects design and in real health care settings.


  • Open Access

    The Effect of Robot Attentional Behaviors on User Perceptions and Behaviors in a Simulated Health Care Interaction: Randomized Controlled Trial (Preprint)

    by Deborah L Johanson, Ho Seok Ahn, Bruce A MacDonald, Byeong Kyu Ahn, JongYoon Lim, Euijun Hwang, Craig J Sutherland, Elizabeth Broadbent

    BACKGROUND For robots to be effectively used in health applications, they need to display appropriate social behaviors. A fundamental requirement in all social interactions is the ability to engage, maintain, and demonstrate attention. Attentional behaviors include leaning forward, self-disclosure, and changes in voice pitch. OBJECTIVE This study aimed to examine the effect of robot attentional behaviors on user perceptions and behaviors in a simulated health care interaction. METHODS A parallel randomized controlled trial with a 1:1:1 allocation ration was conducted. We randomized participants to 1 of 4 experimental conditions before engaging in a scripted face-to-face interaction with a fully automated medical receptionist robot. Experimental conditions included a self-disclosure condition, voice pitch change condition, forward lean condition, and neutral condition. Participants completed paper-based postinteraction measures relating to engagement, perceived robot attention, and perceived robot empathy. We video recorded interactions and coded for participant attentional behaviors. RESULTS A total of 181 participants were recruited from the University of Auckland. Participants who interacted with the robot in the forward lean and self-disclosure conditions found the robot to be significantly more stimulating than those who interacted with the robot in the voice pitch or neutral conditions (P=.03). Participants in the forward lean, self-disclosure, and neutral conditions found the robot to be significantly more interesting than those in the voice pitch condition (P<.001). Participants in the forward lean and self-disclosure conditions spent significantly more time looking at the robot than participants in the neutral condition (P<.001). Significantly, more participants in the self-disclosure condition laughed during the interaction (P=.01), whereas significantly more participants in the forward lean condition leant toward the robot during the interaction (P<.001). CONCLUSIONS The use of self-disclosure and forward lean by a health care robot can increase human engagement and attentional behaviors. Voice pitch changes did not increase attention or engagement. The small effects with regard to participant perceptions are potentially because of the limitations in self-report measures or a lack of comparison for most participants who had never interacted with a robot before. Further research could explore the use of self-disclosure and forward lean using a within-subjects design and in real health care settings.

  • Open Access

    Can social robots help children in healthcare contexts? A scoping review

    by Julia Dawe, Craig Sutherland, Alex Barco, Elizabeth Broadbent

    Objective To review research on social robots to help children in healthcare contexts in order to describe the current state of the literature and explore future directions for research and practice. Design Scoping review. Data sources Engineering Village, IEEE Xplore, Medline, PsycINFO and Scopus databases were searched up until 10 July 2017. Only publications written in English were considered. Identified publications were initially screened by title and abstract, and the full texts of remaining publications were then subsequently screened. Eligibility criteria Publications were included if they were journal articles, conference proceedings or conference proceedings published as monographs that described the conceptualisation, development, testing or evaluation of social robots for use with children with any mental or physical health condition or disability. Publications on autism exclusively, robots for use with children without identified health conditions, physically assistive or mechanical robots, non-physical hardware robots and surgical robots were excluded. Results Seventy-three publications were included in the review, of which 50 included user studies with a range of samples. Most were feasibility studies with small sample sizes, suggesting that the robots were generally accepted. At least 26 different robots were used, with many of these still in development. The most commonly used robot was NAO. The evidence quality was low, with only one randomised controlled trial and a limited number of experimental designs. Conclusions Social robots hold significant promise and potential to help children in healthcare contexts, but higher quality research is required with experimental designs and larger sample sizes.


  • NaoBlocks: A Case Study of Developing a Children's Robot Programming Environment

    by Craig J. Sutherland, Bruce A. MacDonald

    Developing a robotics system can be a complex process, with competing requirements between programmers and end-users. This paper presents a case study on the development of NaoBlocks, a block-based programming environment that allows children to program a Nao robot. NaoBlocks was developed over three phases, with feedback from the end-users (children) guiding the process. Lessons learnt include providing feedback often and early, keeping the editor simple, making the environment robust, allowing override functionality and allowing progressive functionality.


  • Open Access

    Signal to emotion

    by Aslihan Tece Bayrak, Marin Abernethy, Yuang Zhu, Zainab Al Lawati, Craig J. Sutherland


  • Who changed my annotation? An investigation into refitting freeform ink annotations

    by Craig Sutherland, Andrew Luxton-Reilly, Beryl Plimmer

    Pen-based computing allows users to seamlessly add freeform ink annotations to dynamic digital documents. When these documents change, the annotations should adapt, or “refit”, in response to these changes. While previous studies have demonstrated ways of refitting, there have been few investigations in what the users expect to happen. In this paper, we report on an investigation into user expectations for refitting freeform ink annotations. We explored how the four main categories of annotations can be refitted and what user thought of each approach. Our findings indicate the approach depends on the user's overall preference and the category of annotation. Furthermore we suggest ways to implement freeform ink annotations on dynamic digital documents.