Writing with AI: What College Students Learned from Utilizing ChatGPT for a Writing Assignment
Top Cited Papers
Open Access
- 4 September 2024
- journal article
- research article
- Published by MDPI AG in Education Sciences
- Vol. 14 (9) , 976
Abstract
To support the integration of AI in education, this empirical study investigated what lessons college students learned from using Generative AI for writing. We recruited 47 students in the United States from a university writing course. Students completed an assignment in which they used Generative AI tools (e.g., ChatGPT) to draft an application letter or personal statement. Data were collected using a survey of five open-ended questions about their writing process, what worked, what did not work, how to better write with AI, and general lessons learned. We applied thematic analysis and sentiment analysis methods to analyze students’ responses. Results show that (1) students went through multiple rounds of prompting; (2) students identified strengths of AI, such as connection to topic, template generation, and sentence quality; (3) the weaknesses of AI included general language, robotic tone and lacking emotion, lacking personal voice, and lacking critical thinking; (4) students wished to improve AI-generated writing by adding personal stories, connections to posting, feelings and thoughts, and deleting repetitive language; and (5) their overall attitudes toward AI tool were positive. We believe our findings can help relieve some concerns about cheating with AI. We also suggested strategies to regulate the use of AI.Keywords
This publication has 31 references indexed in Scilit:
- Detecting ChatGPT-generated essays in a large-scale writing assessment: Is there a bias against non-native English speakers?Computers & Education, 2024
- Does attitude towards plagiarism predict aigiarism using ChatGPT?AI and Ethics, 2024
- Academic writing and ChatGPT: Students transitioning into college in the shadow of the COVID-19 pandemicDiscover Education, 2024
- Analyzing the students' views, concerns, and perceived ethics about chat GPT usageComputers and Education: Artificial Intelligence, 2023
- Concerns About Using ChatGPT in Education2023
- Will ChatGPT Get You Caught? Rethinking of Plagiarism Detection2023
- Prompt Engineering with ChatGPT: A Guide for Academic WritersAnnals of Biomedical Engineering, 2023
- Collaborating with ChatGPT in argumentative writing classroomsAssessing Writing, 2023
- Impact of ChatGPT on learners in a L2 writing practicum: An exploratory investigationEducation and Information Technologies, 2023
- A survey on sentiment analysis methods, applications, and challengesArtificial Intelligence Review, 2022