Large Language Models’ Trustworthiness in the Light of the EU AI Act—A Systematic Mapping Study
Open Access
- 8 July 2025
- journal article
- review article
- Published by MDPI AG in Applied Sciences
- Vol. 15 (14) , 7640
Abstract
The recent advancements and emergence of rapidly evolving AI models, such as large language models (LLMs), have sparked interest among researchers and professionals. These models are ubiquitously being fine-tuned and applied across various fields such as healthcare, customer service and support, education, automated driving, and smart factories. This often leads to an increased level of complexity and challenges concerning the trustworthiness of these models, such as the generation of toxic content and hallucinations with high confidence leading to serious consequences. The European Union Artificial Intelligence Act (AI Act) is a regulation concerning artificial intelligence. The EU AI Act has proposed a comprehensive set of guidelines to ensure the responsible usage and development of general-purpose AI systems (such as LLMs) that may pose potential risks. The need arises for strengthened efforts to ensure that these high-performing LLMs adhere to the seven trustworthiness aspects (data governance, record-keeping, transparency, human-oversight, accuracy, robustness, and cybersecurity) recommended by the AI Act. Our study systematically maps research, focusing on identifying the key trends in developing LLMs across different application domains to address the aspects of AI Act-based trustworthiness. Our study reveals the recent trends that indicate a growing interest in emerging models such as LLaMa and BARD, reflecting a shift in research priorities. GPT and BERT remain the most studied models, and newer alternatives like Mistral and Claude remain underexplored. Trustworthiness aspects like accuracy and transparency dominate the research landscape, while cybersecurity and record-keeping remain significantly underexamined. Our findings highlight the urgent need for a more balanced, interdisciplinary research approach to ensure LLM trustworthiness across diverse applications. Expanding studies into underexplored, high-risk domains and fostering cross-sector collaboration can bridge existing gaps. Furthermore, this study also reveals domains (like telecommunication) which are underrepresented, presenting considerable research gaps and indicating a potential direction for the way forward.Keywords
Funding Information
- Ericsson Research Trustworthy AI (TWAI) team
This publication has 51 references indexed in Scilit:
- A comprehensive review of large language models: issues and solutions in learning environmentsDiscover Sustainability, 2025
- Towards trustworthy LLMs: a review on debiasing and dehallucinating in large language modelsArtificial Intelligence Review, 2024
- GPT (Generative Pre-Trained Transformer)— A Comprehensive Review on Enabling Technologies, Potential Applications, Emerging Challenges, and Future DirectionsIEEE Access, 2024
- A Review on Large Language Models: Architectures, Applications, Taxonomies, Open Issues and ChallengesIEEE Access, 2024
- Claude 2.0 large language model: Tackling a real-world classification problem with a new iterative prompt engineering approachIntelligent Systems with Applications, 2024
- 10 Years of research on debugging concurrent and multicore software: a systematic mapping studySoftware Quality Journal, 2016
- Guidelines for conducting systematic mapping studies in software engineering: An updateInformation and Software Technology, 2015
- Experimentation in Software Engineering2012
- Lessons from applying the systematic literature review process within the software engineering domainJournal of Systems and Software, 2007
- Requirements engineering paper classification and evaluation criteria: a proposal and a discussionRequirements Engineering, 2005