Gordon Fraser
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Gordon Fraser has a total of 132 co-authors. Here are the top co-authors by number of shared publications:
- Isabella Graßl
Technical University of Darmstadt, Darmstadt, Germany
9 shared publications - Benedikt Fein
University of Passau, Passau, Germany
8 shared publications - Patric Feldmeier
University of Passau, Passau, Germany
8 shared publications - Ute Heuer
University of Passau, Passau, Germany
8 shared publications - Luisa Greifenstein
University of Passau, Germany
7 shared publications - Philipp Straubinger
University of Passau, Passau, Germany
7 shared publications
Latest Publications
- Open Access
- 4 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-11
AI Defenders: Large Language Model Opponents for Practising Mutation Testing in Code Defenders
- 4 November 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-11
Open AccessAI Defenders: Large Language Model Opponents for Practising Mutation Testing in Code Defenders
- Open Access
- 7 October 2026
- Published by Association for Computing Machinery (ACM)
- p. 3473-3477
ScratchLog+: Live Analytics of Learners’ Exercise Progress
- 7 October 2026
- Published by Association for Computing Machinery (ACM)
- p. 3473-3477
Open AccessScratchLog+: Live Analytics of Learners’ Exercise Progress
- Open Access
- 9 July 2026
- Published by Association for Computing Machinery (ACM)
- p. 142-148
Voice-Controlled S cratch for Children with (Motor) Disabilities
- 9 July 2026
- Published by Association for Computing Machinery (ACM)
- p. 142-148
Open AccessVoice-Controlled S cratch for Children with (Motor) Disabilities
- Open Access
- 30 June 2026
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Software Engineering
- Vol. 3 (FSE) , 4760-4781
Generalizing Test Cases for Comprehensive Test Scenario Coverage
Test cases are essential for software development and maintenance. In practice, developers derive multiple test cases from an implicit pattern based on their understanding of requirements and inference of diverse test scenarios, each validating a specific behavior of the focal method. However, producing comprehensive tests is time-consuming and error-prone: many important tests that should have accompanied the initial test are added only after a significant delay, sometimes only after bugs are triggered. Existing automated test generation techniques largely focus on code coverage. Yet in real projects, practical tests are seldom driven by code coverage alone, since test scenarios do not necessarily align with control-flow branches. Instead, test scenarios originate from requirements, which are often undocumented and implicitly embedded in a project's design and implementation. However, developer-written tests are frequently treated as executable specifications; thus, even a single initial test that reflects the developer's intent can reveal the underlying requirement and the diverse scenarios that should be validated. In this work, we propose TestGeneralizer, a framework for generalizing test cases to comprehensively cover test scenarios. TestGeneralizer orchestrates three stages: (1) enhancing the understanding of the requirement and scenario behind the focal method and initial test; (2) generating a test scenario template and crystallizing it into various test scenario instances; and (3) generating and refining executable test cases from these instances. To ensure accuracy and completeness, TestGeneralizer combines rule-based prompts, automatically optimized via a prompt auto-tuning technique, with crucial project knowledge retrieved through program analysis. We evaluate TestGeneralizer against three state-of-the-art baselines (EvoSuite, gpt-o4-mini, and ChatTester) on 12 open-source Java projects, covering 506 multi-test focal methods and 1,637 test scenarios. TestGeneralizer achieves significant improvements: +57.67% and +59.62% over EvoSuite, +37.44% and +32.82% over gpt-o4-mini, and +31.66% and +23.08% over ChatTester, in mutation-based and LLM-assessed scenario coverage, respectively. In a field study, we submitted 27 generalized tests overlooked by developers; 16 were accepted and merged into official repositories, demonstrating the practical usefulness of TestGeneralizer.
- 30 June 2026
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Software Engineering
- Vol. 3 (FSE) , 4760-4781
Open AccessGeneralizing Test Cases for Comprehensive Test Scenario Coverage
Test cases are essential for software development and maintenance. In practice, developers derive multiple test cases from an implicit pattern based on their understanding of requirements and inference of diverse test scenarios, each validating a specific behavior of the focal method. However, producing comprehensive tests is time-consuming and error-prone: many important tests that should have accompanied the initial test are added only after a significant delay, sometimes only after bugs are triggered. Existing automated test generation techniques largely focus on code coverage. Yet in real projects, practical tests are seldom driven by code coverage alone, since test scenarios do not necessarily align with control-flow branches. Instead, test scenarios originate from requirements, which are often undocumented and implicitly embedded in a project's design and implementation. However, developer-written tests are frequently treated as executable specifications; thus, even a single initial test that reflects the developer's intent can reveal the underlying requirement and the diverse scenarios that should be validated. In this work, we propose TestGeneralizer, a framework for generalizing test cases to comprehensively cover test scenarios. TestGeneralizer orchestrates three stages: (1) enhancing the understanding of the requirement and scenario behind the focal method and initial test; (2) generating a test scenario template and crystallizing it into various test scenario instances; and (3) generating and refining executable test cases from these instances. To ensure accuracy and completeness, TestGeneralizer combines rule-based prompts, automatically optimized via a prompt auto-tuning technique, with crucial project knowledge retrieved through program analysis. We evaluate TestGeneralizer against three state-of-the-art baselines (EvoSuite, gpt-o4-mini, and ChatTester) on 12 open-source Java projects, covering 506 multi-test focal methods and 1,637 test scenarios. TestGeneralizer achieves significant improvements: +57.67% and +59.62% over EvoSuite, +37.44% and +32.82% over gpt-o4-mini, and +31.66% and +23.08% over ChatTester, in mutation-based and LLM-assessed scenario coverage, respectively. In a field study, we submitted 27 generalized tests overlooked by developers; 16 were accepted and merged into official repositories, demonstrating the practical usefulness of TestGeneralizer.
- Open Access
- 13 June 2026
- Published by Springer Nature in Empirical Software Engineering
- Vol. 31 (6) , 166
CDBench: Benchmarking the mutation testing capabilities of LLMs with code defenders
Most traditional benchmarks for evaluating Large Language Models (LLMs) in software development suffer from a narrow focus, high risks of data contamination, and static difficulty levels that fail to keep pace with rapid model evolution. To address these limitations, we introduce CDBench, a novel zero-sum benchmark based on the Code Defenders mutation testing game. By pitting models against each other in a competitive environment—where “attackers” introduce code mutations and “defenders” create tests to detect them—CDBench establishes a dynamic difficulty curve that scales naturally without human intervention. Our experiments reveal that while LLMs can generate diverse mutations, they often struggle with code validity; nevertheless, the framework effectively distinguishes model capabilities, highlighting the superior test generation of models like Gemini 2.5 Pro while exposing the instruction-following limitations of reasoning models. These findings demonstrate that zero-sum games offer a viable, contamination-resistant solution to the stagnation of current evaluation methodologies.
- 13 June 2026
- Published by Springer Nature in Empirical Software Engineering
- Vol. 31 (6) , 166
Open AccessCDBench: Benchmarking the mutation testing capabilities of LLMs with code defenders
Most traditional benchmarks for evaluating Large Language Models (LLMs) in software development suffer from a narrow focus, high risks of data contamination, and static difficulty levels that fail to keep pace with rapid model evolution. To address these limitations, we introduce CDBench, a novel zero-sum benchmark based on the Code Defenders mutation testing game. By pitting models against each other in a competitive environment—where “attackers” introduce code mutations and “defenders” create tests to detect them—CDBench establishes a dynamic difficulty curve that scales naturally without human intervention. Our experiments reveal that while LLMs can generate diverse mutations, they often struggle with code validity; nevertheless, the framework effectively distinguishes model capabilities, highlighting the superior test generation of models like Gemini 2.5 Pro while exposing the instruction-following limitations of reasoning models. These findings demonstrate that zero-sum games offer a viable, contamination-resistant solution to the stagnation of current evaluation methodologies.
- 30 April 2026
- Published by Springer Nature
- p. 66-81
Search-based Hyperparameter Tuning for Python Unit Test Generation
- 30 April 2026
- Published by Springer Nature
- p. 66-81
Search-based Hyperparameter Tuning for Python Unit Test Generation
- 30 April 2026
- Published by Springer Nature
- p. 3-18
Constraint-Guided Unit Test Generation for Machine Learning Libraries
- 30 April 2026
- Published by Springer Nature
- p. 3-18
Constraint-Guided Unit Test Generation for Machine Learning Libraries
- Open Access
- 24 April 2026
- Published by Taylor & Francis in Computer Science Education
- p. 1-33
From drawing to block-based programming: does Ozobot’s pen-and-paper mode support first programming experiences?
- 24 April 2026
- Published by Taylor & Francis in Computer Science Education
- p. 1-33
Open AccessFrom drawing to block-based programming: does Ozobot’s pen-and-paper mode support first programming experiences?
- Open Access
- 13 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 93-97
Understanding Bug-Reproducing Tests: A First Empirical Study
- 13 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 93-97
Open AccessUnderstanding Bug-Reproducing Tests: A First Empirical Study
- Open Access
- 12 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 197-208
From Personas to Programming: Gender-specific Effects of Design Thinking-Based Computing Education at Secondary Schools
Creative approaches to attract students to software engineering at an early age are emerging, yet their differential impact on gender remains unclear. This study investigates whether design thinking’s empathy-driven approach addresses the documented gender gap in interest in software engineering. In a 10-week curriculum-integrated design thinking software development course with 55 secondary school students aged 13-–15 from two schools in Canada, we examined gendered differences in perceived gains in knowledge and interest, as well as in social-emotional experiences. Our results show that both girls and boys gained perceived knowledge in software development. However, girls showed significant improvements in self-efficacy, interest, engagement with sustainability topics, and well-being, including optimism, sense of usefulness, and social connectedness. Positive emotions were strongest during creative, collaborative phases, while technical tasks led to some boredom, especially among boys, though they still benefited overall. This suggests that human-centred design thinking might be one effective way to address gender equity challenges, though we need more differentiated technical implementations.
- 12 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 197-208
Open AccessFrom Personas to Programming: Gender-specific Effects of Design Thinking-Based Computing Education at Secondary Schools
Creative approaches to attract students to software engineering at an early age are emerging, yet their differential impact on gender remains unclear. This study investigates whether design thinking’s empathy-driven approach addresses the documented gender gap in interest in software engineering. In a 10-week curriculum-integrated design thinking software development course with 55 secondary school students aged 13-–15 from two schools in Canada, we examined gendered differences in perceived gains in knowledge and interest, as well as in social-emotional experiences. Our results show that both girls and boys gained perceived knowledge in software development. However, girls showed significant improvements in self-efficacy, interest, engagement with sustainability topics, and well-being, including optimism, sense of usefulness, and social connectedness. Positive emotions were strongest during creative, collaborative phases, while technical tasks led to some boredom, especially among boys, though they still benefited overall. This suggests that human-centred design thinking might be one effective way to address gender equity challenges, though we need more differentiated technical implementations.