Logging Requirement for Continuous Auditing of Responsible Machine Learning-based Applications
Authors:
Preprint
Abstract
Machine learning (ML) is increasingly applied across industries to automate decision-making, but concerns about ethical and legal compliance remain due to limited transparency, fairness, and accountability. Monitoring through logging a long-standing practice in traditional software offers a potential means for auditing ML applications, as logs provide traceable records of system behavior useful for debugging, performance analysis, and continuous auditing. systematically auditing models for compliance or accountability. The findings underscore the need for enhanced logging practices and tooling that systematically integrate responsible AI metrics. Such practices would support the development of auditable, transparent, and ethically responsible ML systems, aligning with growing regulatory requirements and societal expectations. By highlighting specific deficiencies and opportunities, this work provides actionable guidance for both practitioners and tool developers seeking to strengthen the accountability and trustworthiness of ML applications.Keywords
All Related Versions
This publication has 27 references indexed in Scilit:
- Studying logging practice in machine learning-based applicationsInformation and Software Technology, 2024
- Auditing large language models: a three-layered approachAI and Ethics, 2023
- How to certify machine learning based safety-critical systems? A systematic literature reviewAutomated Software Engineering, 2022
- Testing machine learning based systems: a systematic mappingEmpirical Software Engineering, 2020
- Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AIInformation Fusion, 2020
- The IEEE Global Initiative on Ethics of Autonomous and Intelligent Systems2019
- Studying the characteristics of logging practices in mobile apps: a case study on F-DroidEmpirical Software Engineering, 2019
- Which log level should developers choose for a new logging statement?Empirical Software Engineering, 2016
- Continuous monitoring of business process controls: A pilot implementation of a continuous auditing system at SiemensInternational Journal of Accounting Information Systems, 2006
- Auditing, directorships and the demand for monitoringJournal of Accounting and Public Policy, 1993