GRASP: Municipal Budget AI Chatbots for Enhancing Civic Engagement
Authors:
- 15 December 2024
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 7438-7442
Abstract
There are a growing number of AI applications, but none tailored specifically to help residents answer their questions about municipal budget, a topic most are interested in but few have a solid comprehension of. In this research paper, we propose GRASP, a custom AI chatbot framework which stands for Generation with Retrieval and Action System for Prompts. GRASP provides more truthful and grounded responses to user budget queries than traditional information retrieval systems like general Large Language Models (LLMs) or web searches. These improvements come from the novel combination of a Retrieval-Augmented Generation (RAG) framework ("Generation with Retrieval") and an agentic workflow ("Action System"), as well as prompt engineering techniques, the incorporation of municipal budget domain knowledge, and collaboration with local town officials to ensure response truthfulness. During testing, we found that our GRASP chatbot provided precise and accurate responses for local municipal budget queries 78% percent of the time, while GPT-4o and Gemini were only accurate 60% and 35% of the time, respectively. GRASP chatbots greatly reduce the time and effort needed for the general public to get an intuitive and correct understanding of their town’s budget, thus fostering greater communal discourse, improving government transparency, and allowing citizens to make more informed decisions.Keywords
All Related Versions
This publication has 8 references indexed in Scilit:
- Investigating the Performance of Retrieval-Augmented Generation and Domain-Specific Fine-Tuning for the Development of AI-Driven Knowledge-Based SystemsMachine Learning and Knowledge Extraction, 2025
- A Survey on RAG Meeting LLMs: Towards Retrieval-Augmented Large Language Models2024
- Hallucination Reduction in Large Language Models with Retrieval-Augmented Generation Using Wikipedia KnowledgeOSF Preprints, 2024
- Large Language Models in Civic Education on the Supervision and Risk Assessment of Public Works2024
- Attention Is All You NeedarXiv, 2023
- Application of large language model in intelligent Q&A of digital government2023
- HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answering2018
- FEVER: a Large-scale Dataset for Fact Extraction and VERification2018