An AI tool for scaffolding complex thinking: challenges and solutions in developing an LLM prompt protocol suite
Open Access
- 14 July 2025
- journal article
- research article
- Published by Springer Nature in Cognition, Technology & Work
- p. 1-43
Abstract
This paper reports an exploratory study examining the interaction between a theoretical framework for Complex Thinking and AI (LLMs), in terms of its potentialities and constraints. The aim was to develop and conduct a preliminary pilot evaluation of a tool comprising a prompt protocol suite for use with an LLM, to scaffold Complex Thinking. The tool is designed for use by an individual or group in relation to a given Target System of Interest (i.e., a real-world system, a problem, or a concern), supporting the development of more complex understandings of such systems that can guide more effective and positive actions and decisions. We describe the process of developing a suite of prompt protocols for scaffolding particular properties of Complex Thinking and report on the outcomes of a pilot test evaluation with a set of users across different domains.Keywords
Funding Information
- Stefan Pernar (Scientific Sponsorship, Scientific Sponsorship, Scientific Sponsorship, Scientific Sponsorship, Scientific Sponsorship, Scientific Sponsorship, Scientific Sponsorship)
- Foundation for Science and Technology (Scientific Employment Support Program: DL57/2016/CP1341/CT0030, Individual Call to Scientific Employment Stimulus: CEEIND/03932/2017)
- Universidade de Coimbra
This publication has 45 references indexed in Scilit:
- When trust is zero sum: automation’s threat to epistemic agencyEthics and Information Technology, 2025
- Complexigraphy: theoretical foundations and methodological challenges of mapping complex thinkingPhenomenology and the Cognitive Sciences, 2025
- Experts or Authorities? The Strange Case of the Presumed Epistemic Superiority of Artificial Intelligence SystemsMinds and Machines, 2024
- Prompting meaning: a hermeneutic approach to optimising prompt engineering with ChatGPTAI & SOCIETY, 2023
- Basic Rules for Asking Questions to ChatGPT2023
- Scaffolding Human Champions: AI as a More Competent OtherHuman Arenas, 2022
- Performing Complexity: Building Foundations for the Practice of Complex Thinking2020
- Thinking (in) complexity: (In) definitions and (mis)conceptionsSystems Research and Behavioral Science, 2019
- (Gardening) Gardening: A Relational Framework for Complex Thinking About Complex Systems2018
- Requisite Variety and Its Implications for the Control of Complex Systems1991