LLM-generated tips rival expert-created tips in helping students answer quantum-computing questions
Authors:
Open Access
- 4 March 2025
- journal article
- research article
- Published by Springer Nature in EPJ Quantum Technology
- Vol. 12 (1) , 1-23
Abstract
Alleviating high workloads for teachers is crucial for continuous high quality education. To evaluate if Large Language Models (LLMs) can alleviate this problem in the quantum computing domain, we conducted two complementary studies exploring the use of GPT-4 to automatically generate tips for students. (1) A between-subject survey in which students (N = 46) solved four multiple-choice quantum computing questions with either the help of expert-created or LLMgenerated tips. To correct for possible biases, we additionally introduced two deception conditions. (2) Experienced educators and students (N = 23) directly compared the LLM-generated and expert-created tips. Our results show that the LLM-generated tips were significantly more helpful and pointed better towards relevant concepts while also giving away more of the answers. Furthermore, we found that participants in the first study performed significantly better in answering the quantum computing questions when given tips labeled as LLM-generated, even if they were expert-created. This points towards a placebo effect induced by the participants’ biases for LLM-generated content. Ultimately, we contribute that LLM-generated tips can be used instead of expert tips to support teaching of quantum computing basics.Keywords
All Related Versions
Funding Information
- Bundesministerium für Forschung, Technologie und Raumfahrt (16DHBKI058, FKZ13N15995, FKZ13N15995, FKZ13N15995, FKZ13N15995, 16DHBKI058, 16DHBKI058, FKZ13N15995)
- Rheinland-Pfälzische Technische Universität Kaiserslautern-Landau
This publication has 60 references indexed in Scilit:
- A survey of safety and trustworthiness of large language models through the lens of verification and validationArtificial Intelligence Review, 2024
- Few-shot is enough: exploring ChatGPT prompt engineering method for automatic question generation in english educationEducation and Information Technologies, 2023
- The placebo effect of human augmentation: Anticipating cognitive augmentation increases risk-taking behaviorComputers in Human Behavior, 2023
- Historical Roots and Seminal Papers of Quantum Technology 2.0NanoEthics, 2022
- Mapping the Patent Landscape of Quantum Technologies: Patenting Trends, Innovation and Policy ImplicationsIIC - International Review of Intellectual Property and Competition Law, 2022
- On the Social Shaping of Quantum Technologies: An Analysis of Emerging Expectations Through Grant Proposals from 2002–2020Minerva, 2021
- Building Knowledge Capacity for Quantum Computing in Engineering Education2021
- Instructional Scaffolding in STEM Education2017
- Giving feedback – An integral part of educationBest Practice & Research Clinical Anaesthesiology, 2012
- Performance as a function of resultant achievement motivation (perceived ability) and perceived difficultyJournal of Research in Personality, 1974