Comparative Analysis of Generative Pre-Trained Transformers Responses to Coastal Ecosystem Questions: Implications for GenAI in Environmental Education
Preprint
- 1 April 2024
- preprint
- Published by Springer Nature in Research Square
Abstract
This study presents a comparative analysis of two leading large language models (LLMs), Google’s Bard, powered by the Gemini model, and OpenAI’s ChatGPT 4.0, in the context of their responses to coastal ecosystem science undergraduate student education. Fifty questions related to coastal ecosystem management were posed to each LLM. Expert assessments evaluated the responses of the LLMs based on five key metrics: accuracy, relevance, depth, creativity, and semantic clarity. Knowledge graphs provided a structured framework for assessing and visualizing the AI responses. The analysis identified the strengths and weaknesses of each LLM in addressing complex environmental issues. The findings contribute to a deeper understanding of LLMs’ potential applications in environmental science education and scientific communication. This study acknowledges limitations, such as the inherent subjectivity of expert assessments and the potential for bias within the knowledge graphs used for evaluation. Future research directions include investigating the effectiveness of LLMs in personalized learning environments and exploring their potential for generating educational content tailored to diverse audiences.Keywords
All Related Versions
This publication has 19 references indexed in Scilit:
- Can ChatGPT support prospective teachers in physics task development?Physical Review Physics Education Research, 2023
- Examining Science Education in ChatGPT: An Exploratory Study of Generative Artificial IntelligenceJournal of Science Education and Technology, 2023
- Opinion Paper: “So what if ChatGPT wrote it?” Multidisciplinary perspectives on opportunities, challenges and implications of generative conversational AI for research, practice and policyInternational Journal of Information Management, 2023
- Generating scholarly content with ChatGPT: ethical challenges for medical publishingThe Lancet Digital Health, 2023
- How safe is our reliance on AI, and should we regulate it?AI and Ethics, 2020
- The role of artificial intelligence in achieving the Sustainable Development GoalsNature Communications, 2020
- Chatbot learning partners: Connecting learning experiences, interest and competenceComputers in Human Behavior, 2019
- Evolution and Revolution in Artificial Intelligence in EducationInternational Journal of Artificial Intelligence in Education, 2016
- Proposed U.S. Policy for Ocean, Coast, and Great Lakes StewardshipScience, 2010
- Evolution of co-management: Role of knowledge generation, bridging organizations and social learningJournal of Environmental Management, 2009