CWCraig. A. Watterson

Craig. A. Watterson

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Craig. A. Watterson has a total of 39 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • The Impact of Chatbots on Students' Reflective Thinking in Introductory Programming Course

    by Agatha Rachmat, Craig Watterson, Karsten Lundqvist

    This study investigated New Zealand students' views on utilising chatbots and the impact of using ChatGPT or similar chatbots with suggested prompts on the reflective thinking skills of university students. The research was conducted in an introductory computer programming course (COMP102) in the School of Engineering and Computer Science. This introductory course uses a flipped classroom approach. The students were introduced to an approach to use a generative AI-based chatbot as an intervention. The intervention consisted of a brief explanation of chatbot training and utilisation, along with a specifically designed prompt intended to support learning. An example of prompt usage was demonstrated. Students' feedback was collected through two instruments: a Reflective Thinking Scale questionnaire, which measured students' reflective thinking abilities, and an open-ended student guide questionnaire designed to gather qualitative insights into their views and experiences using chatbots. Employing a mixed-methods research approach, we incorporated quantitative (Reflective Thinking Scale questionnaire) and qualitative (open-ended student guide questionnaire) data collection instruments within an experimental pre-test and post-test control group design. The pretest yielded 86 completed responses, while the post-test had 49 participants out of over 400 students enrolled in the course. The pre-test and posttest results did not yield quantitatively significant results in students' reflective thinking after the intervention. However, 21 out of 29 qualitative post-test respondents who utilise chatbots indicated that their interactions with the chatbot showed evidence of reflective thinking that improved their learning processes. The results revealed that students initially had doubts about using a chatbot for their learning, as they felt it might hinder their learning process or be unnecessary. Students perceived chatbots to be unreliable due to providing wrong answers, inaccurate code snippets, hallucinations, and plagiarised content. Therefore, students preferred to be self-reliant and not dependent on chatbots. Following the intervention, students demonstrated an increase of confidence in utilising chatbots as a learning tool, especially those who also used the suggested prompt. Students found that chatbots and the suggested prompt could be used to support learning and not only to provide answers. The chatbot was beneficial as a learning tool, providing additional information to clarify their understanding and reasoning behind providing simple explanations of programming concepts. Future work will focus on an intervention study in a more controlled environment to isolate the features of generative AI tools' impact and minimise external factors.


  • A Foucauldian Discourse Analysis of an Engineering Programme

    by Craig Watterson

    The extensive literature relating to student barriers within the Science, Technology, Engineering and Mathematics (STEM) fields and, in particular, engineering education illustrates that STEM education has a widespread problem in retaining students. A plethora of studies have concentrated on placing the student at the centre of the problem – for example by focusing on student academic ability, work habits and social background. By analysing staff interviews, and investigating pertinent factors from the surrounding institutional, cultural and social environment, I shift the focus away from the phenomenological experience of individuals to examine the way power relations affect the teaching and learning environment. Foucauldian Discourse Analysis (FDA) offers a theoretical and methodological basis for critically exploring networks of power, through the investigation of discourse and can provide insights into the complex situation in the School of Engineering and Computer Science (ECS). I use FDA to ask: how is power experienced and manifested by lecturers in the Bachelor of Engineering with Honours (BE) first-year teaching and learning environment at Victoria University of Wellington (VUW), New Zealand. I do this by analysing transcripts of interviews with teaching staff, as well as ECS, University, and Government documentation. By adopting an FDA approach to lecturers’ experiences of power, situated in the New Zealand neoliberal educational context, I aim to identify issues that impact the teaching and learning environment. These include academic practices relating to Government and University pressure to increase engineering student recruitment and retention numbers, an academically diverse incoming student cohort, course design, teaching and research. From a Foucauldian perspective, the New Zealand Government, the University, its lecturers, and students are all part of an educational setting comprising a complex network of power relationships active in the operation of the teaching and learning environment. By placing lecturers at the epicentre of the situation and by understanding how lecturers both experience and exercise power in the teaching-learning environment, the issue of student retention may be re-framed. This study offers a unique perspective from which we can assess these problematic experiences at the source, whether that be at government, institution, department, teacher or learner level. As such, by exploring the operation of power, this thesis explores an important aspect of the retention problem which has never been fully investigated in NZ engineering education.

  • Open Access

    Contact Tracing: Ensuring Privacy and Security

    by Daan Storm van Leeuwen, Ali Ahmed, Craig Watterson, Nilufar Baghaei

    Faced with the biggest virus outbreak in a century, world governments at the start of 2020 took unprecedented measures to protect their healthcare systems from being overwhelmed in the light of the COVID-19 pandemic. International travel was halted and lockdowns were imposed. Many nations adopted measures to stop the transmission of the virus, such as imposing the wearing of face masks, social distancing, and limits on social gatherings. Technology was quickly developed for mobile phones, allowing governments to track people’s movements concerning locations of the virus (both people and places). These are called contact tracing applications. Contact tracing applications raise serious privacy and security concerns. Within Europe, two systems evolved: a centralised system, which calculates risk on a central server, and a decentralised system, which calculates risk on the users’ handset. This study examined both systems from a threat perspective to design a framework that enables privacy and security for contact tracing applications. Such a framework is helpful for App developers. The study found that even though both systems comply with the General Data Protection Regulation (GDPR), Europe’s privacy legislation, the centralised system suffers from severe risks against the threats identified. Experiments, research, and reviews tested the decentralised system in various settings but found that it performs better but still suffers from inherent shortcomings. User tracking and re-identification are possible, especially when users report themselves as infected. Based on these data, the study identified and validated a framework that enables privacy and security. The study also found that the current implementations using the decentralised Google/Apple API do not comply with the framework.


  • Improving Engineering Recruitment

    by Dale Anthony Carnegie, Craig A. Watterson

    Improving Engineering RecruitmentAbstract— We are a relatively new engineering provider operating in an environment where engineering is notan option for high school study, there are strong existing providers nearby and engineering is generally notviewed as being a desirable vocation. To inspire and attract students, we conducted a comprehensive survey toinform a new marketing initiative. In response we formed a “geek-hero” theme in print and on-line. This wascomplemented by informative posters and an extremely successful outreach programme. Improving engineering recruitment is a challenge for many institutions internationally. We face severaladditional challenges. A significant factor is that engineering is not covered in our high school curricula.Students are able to participate in science and technology classes, but are generally unaware of howengineering is a distinct discipline. Also we are a relatively new engineering provider and so once we hadinspired students to consider tertiary engineering, we then had to attract them to our institution rather thanone of the more established providers. Our emphasis is on the “digital” areas of engineering, specifically electrical/electronic, mechatronics,networking and software. Our approach was necessarily two-pronged, one to inspire the students and anotherto convince the students’ influencers; their peers, parents, teachers and careers advisors who require a verydifferent approach. To inspire and attract the students, a novel approach to recruitment was required. A demographic studythat spanned both genders, a variety of socio-economic backgrounds and several ethnicities indicated thatstudents with an interest in, and ability to perform in these “digital” areas of engineering strongly identifiedwith and embraced being labeled “geeks”. A new website and booklet were subsequently developed to relatewith this identified geek culture – a major departure from the traditional marketing campaigns. The themewas “become a geek-hero”. The print-booklet embraced this theme in a fun-style, student-orientated mode.The new website, registered in the .geek domain, continued this student focused theme, however there is alsoa section that provides teaching and information resources for high school teachers. Our initial printing ofthe booklet was exhausted within a few months – substantially faster than the formal university prospectus. To augment the quirky geek-based publications, a series of informative posters were developed that willalso be illustrated during the conference presentation. The motivation is to get our university name and logointo the high schools so that the students began to associate engineering with our institution. The targetplacements were science and technology laboratories, mathematics classrooms and careers advisors offices.These posters cover basic Ohm’s law, digital data (emphasis on music and video storage), electroniccomponents, AC vs DC, conductors and superconductors, how the Internet works and how Facebook works.The acceptance on these posters has been extremely pleasing with many schools requesting additional copies. Our survey of first year students reaffirmed that outreach activities are a major influencer in students’enrolment decisions. A major initiative to improve the impact of our outreach activities was the developmentof 1500 micro-controller (Arduino) based electronic boards that were given to students to keep. The studentshad to finish the population of these boards, and in the process learn to read resistor and capacitor values, thefunction of various components, how to solder and other general electronic principles. After boardconstruction, the students created simple programs on the board using C and (in a later version) in Scratch.Class sets of a newer (fully assembled) version of the board were also made available to teachers who couldthen run in-class activities using this resource. The student survey responses were overwhelmingly positive. Our next intake into our engineering programme is in March, and the impact of enrolment from theseinitiatives will be available to be presented at the conference.

  • The Impact Of Integrated Tutorials in Supporting First Year Student Progression In Engineering

    by Howard Lukefahr, Dale A. Carnegie, Craig A. Watterson

    In this full paper we describe an innovative practice regarding the design and introduction of compulsory, small-group, holistic tutorials into our core first year engineering courses. Instead of traditional tutorials which seek to reinforce lecture content or provide guided help with assignments or test revision, these tutorials specifically focus on connecting topics between all courses a student is currently taking. They also aim to clearly demonstrate the value of a cohesive body of knowledge, instead of rote-learning of facts from individual areas. Tutorials are accompanied by practical demonstrations, and collaborative, guided discussions. The inclusion of these tutorials, along with other minor changes to the course content, has shown marked improvements in students' grades, retention, student evaluations and, most importantly, a change in many students' perception of the value of a coherent body of knowledge separate to that necessary to perform well in assessments. Such tutorials appear to have positively affected the retention rate of engineering students in our degree programme.


  • Differences in Grade Outcomes Between ICT Engineering and Computer Science Degrees

    by Dale A. Carnegie, Craig A. Watterson, Morgan Atkins, James Eldridge

    This full-paper relates to research on the effectiveness of GPA thresholding as a predictor of eventual grade performance in engineering study. Rather than rely on High School grades as a predictor of eventual success in tertiary (ICT-related) engineering, we have adopted a more open-entry model, but require a high performance from the students over their compulsory first year courses in order to progress in engineering study. In this paper we examine whether this is a satisfactory predictor of eventual student success (based on grade performance), or is it that issues such as High-School to University transition unduly negatively influence these grades and lead to a decision not to allow an otherwise capable student to progress. To examine this, we compare student GPAs and graduation rates between a four year Bachelor of Engineering and a three year Bachelor of Science degree which share similar courses. The hypothesis to test is whether students who have been excluded from continuing with Engineering study are in fact capable of passing the advanced level technical courses.


  • Are introductory courses suitable pathways for success in the BE(Hons)

    by J. Eldridge, C. Watterson, H. Lukefahr, D. Carnegie

    We investigate the ability of introductory physics and mathematics courses to provide a successful pathway into the Engineering program at Victoria University of Wellington. We find that an increasing number of students require these courses, however neither course appears to adequately prepare students for the completion of an engineering degree. The introductory physics course in particular, does not adequately prepare student to pass subsequent physics courses. We examine both the delivery and curricula of these courses against literature `best practice' models. Finally we make a series of recommended changes be made to either university entry requirements or to these courses to offer allow students a reasonable pathway into the BE(Hons) degree.


  • Beyond academic quality: Lessons from the creation of a new engineering degree

    by D.A. Carnegie, J. Eldridge, C.A. Watterson

    An investigation into the initially high attrition rates in our new Engineering programme uncovered a number of non-academic factors that led to poor rates of student engagement. Dealing with today's “millennials” has required us to focus on meeting student expectations to a greater extent than we ever expected. Indeed, once we began to understand the modern, technically motivated student, we overhauled our first year engineering offering, as our focus on the traditional delivery of “enabling” subjects (physics, mathematics, programming) was failing. The result has been a substantial increase in student satisfaction and in the number of students gaining a GPA that enables them to proceed in engineering study.