Using Large Language Models for Armchair Auditors
Open Access
- 15 June 2025
- journal article
- Published by Association for Computing Machinery (ACM) in Digital Government: Research and Practice
- Vol. 6 (2) , 1-13
Abstract
Armchair auditors are citizens who use open data to investigate and monitor government activities, typically using analytics and other approaches. Armchair auditors provide a valuable role in holding governments and organizations accountable. This paper investigates the potential use of large language models (LLM) to support armchair auditor analyses of different governmental entities. Unfortunately, the literature, prior to the development of LLM suggested several challenges for armchair auditors. However, the analysis in this paper suggests that LLM can provide substantial data and analytic process support for armchair auditors mitigating issues such as providing guidelines for analyses, guiding users to appropriate communities, suggesting potential data availability opportunities, doing analysis, and other issues. As part of an approach to unifying armchair auditor searches, this paper also suggests a prompt library designed to support, standardize and promote best practice analyzes among armchair auditors. In addition to these issues, this paper also analyzes emerging ethical issues associated with armchair auditors and their use of open data and LLMs. Finally, this paper extends the activity theory model to account for LLMs.Keywords
This publication has 10 references indexed in Scilit:
- A Review of Trustworthy and Explainable Artificial Intelligence (XAI)IEEE Access, 2023
- On the Impact of Explanations on Understanding of Algorithmic Decision-Making2023
- An analysis of three chatbots: BlenderBot, ChatGPT and LaMDAIntelligent Systems in Accounting, Finance and Management, 2023
- Explainable Artificial Intelligence (XAI) in auditingInternational Journal of Accounting Information Systems, 2022
- Massive data language models and conversational artificial intelligence: Emerging issuesIntelligent Systems in Accounting, Finance and Management, 2022
- Cognitive Diagram Understanding and Task Performance in Systems Analysis and DesignMIS Quarterly, 2021
- Ethics for Big Data and AnalyticsIEEE Intelligent Systems, 2016
- Armchair Auditors: Crowdsourcing Analysis of Government ExpendituresJournal of Emerging Technologies in Accounting, 2015
- Knowledge management for best practicesCommunications of the ACM, 2000
- Different firms, different ontologies, and no one best ontologyIEEE Intelligent Systems and their Applications, 2000