College students' credibility assessments of GenAI‐generated information for academic tasks: An interview study
- 28 December 2024
- journal article
- research article
- Published by Wiley in Journal of the Association for Information Science and Technology
- Vol. 76 (6) , 867-883
Abstract
The study explored college students' use of generative artificial intelligence (GenAI) tools, such as ChatGPT, for academic tasks and their perceptions and behaviors in assessing the credibility of GenAI‐generated information. Semistructured interviews were conducted with 25 college students in the United States. Interview transcripts were analyzed using the qualitative content analysis method. The study identified various types of academic tasks for which students used ChatGPT, including writing, programming, and learning. Guided by two models of credibility assessment Hilligoss and Rieh (2008); Metzger (2007), six factors influencing students' motivation and ability to assess the credibility of GenAI‐generated information were identified (e.g., task salience, social pressure). We also identified 9 constructs (e.g., refinedness, explainability), 5 heuristics (e.g., inter‐ and intrasystem consistency heuristics), and 10 cues (e.g., version and tone) used by students to assess the credibility of GenAI‐generated information. This study provides theoretical and empirical findings regarding students' use of GenAI tools in the academic context and credibility evaluation of the system outputs using rich, qualitative interview data.Keywords
This publication has 43 references indexed in Scilit:
- Exploring Applications and User Experience with Generative AI Tools: A Content Analysis of Reddit Posts on ChatGPTProceedings of the Association for Information Science and Technology, 2023
- On ChatGPT and beyond: How generative artificial intelligence may affect research, teaching, and practiceInternational Journal of Research in Marketing, 2023
- The effects of information source and eHealth literacy on consumer health information credibility evaluation behaviorComputers in Human Behavior, 2021
- Explainable AI: from black box to glass boxJournal of the Academy of Marketing Science, 2019
- Web credibility assessment: Conceptualization, operationalization, variability, and modelsJournal of the Association for Information Science and Technology, 2015
- Topic familiarity and information skills in online credibility evaluationJournal of the American Society for Information Science and Technology, 2012
- Social media as information source: Undergraduates' use and evaluation behaviorProceedings of the American Society for Information Science and Technology, 2011
- Making sense of credibility on the Web: Models for evaluating online information and recommendations for future researchJournal of the American Society for Information Science and Technology, 2007
- Credibility: A multidisciplinary frameworkAnnual Review of Information Science and Technology, 2007
- The ethics of persuasive technology2003