Learning Agent-based Modeling with LLM Companions: Experiences of Novices and Experts Using ChatGPT & NetLogo Chat
Open Access
- 11 May 2024
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1-18
Abstract
Large Language Models (LLMs) have the potential to fundamentally change the way people engage in computer programming. Agent-based modeling (ABM) has become ubiquitous in natural and social sciences and education, yet no prior studies have explored the potential of LLMs to assist it. We designed NetLogo Chat to support the learning and practice of NetLogo, a programming language for ABM. To understand how users perceive, use, and need LLM-based interfaces, we interviewed 30 participants from global academia, industry, and graduate schools. Experts reported more perceived benefits than novices and were more inclined to adopt LLMs in their workflow. We found significant differences between experts and novices in their perceptions, behaviors, and needs for human-AI collaboration. We surfaced a knowledge gap between experts and novices as a possible reason for the benefit gap. We identified guidance, personalization, and integration as major needs for LLM-based interfaces to support the programming of ABM.Keywords
All Related Versions
Funding Information
- National Science Foundation (#1842375)
This publication has 76 references indexed in Scilit:
- Augmented intelligence in programming learning: Examining student views on the use of ChatGPT for programming learningComputers in Human Behavior: Artificial Humans, 2023
- Examining Science Education in ChatGPT: An Exploratory Study of Generative Artificial IntelligenceJournal of Science Education and Technology, 2023
- Domain-Specific Modeling Languages in Computer-Based Learning Environments: a Systematic Approach to Support Science Learning through Computational ModelingInternational Journal of Artificial Intelligence in Education, 2020
- Conversational Agents in Support for Collaborative Learning in MOOCs: An Analytical Review2018
- Defining Computational Thinking for Mathematics and Science ClassroomsJournal of Science Education and Technology, 2015
- Constructionist Gaming: Understanding the Benefits of Making Games for LearningEducational Psychologist, 2015
- Integrating computational thinking with K-12 science education using agent-based computation: A theoretical frameworkEducation and Information Technologies, 2013
- Lost while searching: Difficulties in information seeking among end‐user programmersProceedings of the American Society for Information Science and Technology, 2013
- Do moods affect programmers’ debug performance?Cognition, Technology & Work, 2010
- Computational models and empirical constraintsBehavioral and Brain Sciences, 1978