Retrieval Augmented Decision-Making: A Requirements-Driven, Multi-Criteria Framework for Structured Decision Support
Preprint
Abstract
Various industries have produced a large number of documents such as industrial plans, technical guidelines, and regulations that are structurally complex and content-wise fragmented. This poses significant challenges for experts and decision-makers in terms of retrieval and understanding. Although existing LLM-based Retrieval-Augmented Generation methods can provide context-related suggestions, they lack quantitative weighting and traceable reasoning paths, making it difficult to offer multi-level and transparent decision support. To address this issue, this paper proposes the RAD method, which integrates Multi-Criteria Decision Making with the semantic understanding capabilities of LLMs. The method automatically extracts key criteria from industry documents, builds a weighted hierarchical decision model, and generates structured reports under model guidance. The RAD framework introduces explicit weight assignment and reasoning chains in decision generation to ensure accuracy, completeness, and traceability. Experiments show that in various decision-making tasks, the decision reports generated by RAD significantly outperform existing methods in terms of detail, rationality, and structure, demonstrating its application value and potential in complex decision support scenarios.Keywords
All Related Versions
This publication has 24 references indexed in Scilit:
- Retrieval augmented generation for 10 large language models and its generalizability in assessing medical fitnessnpj Digital Medicine, 2025
- LLMs for knowledge graph construction and reasoning: recent capabilities and future opportunitiesWorld Wide Web, 2024
- Structured information extraction from scientific text with large language modelsNature Communications, 2024
- Text Mining Oral Histories in Historical ArchaeologyInternational Journal of Historical Archaeology, 2023
- A survey of the extraction and applications of causal relationsNatural Language Engineering, 2022
- The effects of visualization on judgment and decision-making: a systematic literature reviewManagement Review Quarterly, 2021
- Distributed linguistic representations in decision making: Taxonomy, key elements and applications, and challenges in data science and explainable artificial intelligenceInformation Fusion, 2021
- The Proliferation of ICT and Digital Technology Systems and their Influence on the Dynamic Capabilities of Construction FirmsProcedia Engineering, 2017
- Information mining — Reflections on recent advancements and the road ahead in data, text, and media miningDecision Support Systems, 2011
- Analytic hierarchy process: An overview of applicationsEuropean Journal of Operational Research, 2006