Improving Large Language Model (LLM) fidelity through context-aware grounding: A systematic approach to reliability and veracity
Authors:
- Wrick TalukdarWTWrick Talukdar
- Anjanava BiswasABAnjanava Biswas
Open Access
- 30 December 2023
- journal article
- Published by GSC Online Press in World Journal of Advanced Engineering Technology and Sciences
- Vol. 10 (2) , 283-296
Abstract
As Large Language Models (LLMs) become increasingly sophisticated and ubiquitous in natural language processing (NLP) applications, ensuring their robustness, trustworthiness, and alignment with human values has become a critical challenge. This paper presents a novel framework for contextual grounding in textual models, with a particular emphasis on the Context Representation stage. Our approach aims to enhance the reliability and ethical alignment of these models through a comprehensive, context-aware methodology. By explicitly capturing and representing relevant situational, cultural, and ethical contexts in a machine-readable format, we lay the foundation for anchoring a model's behavior within these contexts. Our approach leverages techniques from knowledge representation and reasoning, such as ontologies, semantic web technologies, and logic-based formalisms. We evaluate our framework on real-world textual datasets, demonstrating its effectiveness in improving model performance, fairness, and alignment with human expectations, while maintaining high accuracy. Furthermore, we discuss the other key components of the framework, including context-aware encoding, context-aware learning, interpretability and explainability, and continuous monitoring and adaptation. This research contributes to the growing body of work on responsible AI, offering a practical approach to developing more reliable, trustworthy, and ethically-aligned language models. Our findings have significant implications for the deployment of LLMs in sensitive domains such as healthcare, legal systems, and social services, where contextual understanding is paramount.Keywords
All Related Versions
This publication has 7 references indexed in Scilit:
- AttentionViz: A Global View of Transformer AttentionIEEE Transactions on Visualization and Computer Graphics, 2023
- The Use of Artificial Intelligence (AI) in Online Learning and Distance Education Processes: A Systematic Review of Empirical StudiesApplied Sciences, 2023
- Revisiting Group Fairness Metrics: The Effect of NetworksProceedings of the ACM on Human-Computer Interaction, 2022
- Beyond bias and discrimination: redefining the AI ethics principle of fairness in healthcare machine-learning algorithmsAI & SOCIETY, 2022
- Counterfactual explanations and how to find them: literature review and benchmarkingData Mining and Knowledge Discovery, 2022
- BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension2020
- Analyzing and Interpreting Data From Likert-Type ScalesJournal of Graduate Medical Education, 2013