A Multi-Hop Retrieval-Augmented Generation Framework for Intelligent Document Question Answering in Financial and Compliance Contexts
Preprint
- 24 June 2025
- preprint
- Published by Springer Nature in Research Square
Abstract
We present FinLLaMA-RAG, a Retrieval-Augmented Generation (RAG) framework built on LLaMA 3 to address complex document-level question answering. The model integrates dense retrieval, contextual fusion, and multi-hop reasoning to extract accurate, coherent answers from long and cross-referenced documents. Designed with high-stakes applications in mind, FinLLaMA-RAG supports automated tax compliance, financial fraud investigation, and regulatory reporting. Through joint optimization of retrieval and generation, it achieves strong results across several financial QA datasets. This work contributes to the development of explainable and reliable AI tools for financial and policy-oriented document analysis.Keywords
All Related Versions
This publication has 5 references indexed in Scilit:
- FinDER: Financial Dataset for Question Answering and Evaluating Retrieval-Augmented Generation2025
- Attention-Driven Interaction Network for E-Commerce Recommendations2025
- Optimizing Retail Sales Forecasting Through a PSO-Enhanced Ensemble Model Integrating LightGBM, XGBoost, and Deep Neural Networks2024
- Evaluating Retrieval-Augmented Generation Models for Financial Report Question and AnsweringApplied Sciences, 2024
- FinTextQA: A Dataset for Long-form Financial Question Answering2024