QI2 -- an Interactive Tool for Data Quality Assurance
Preprint
Abstract
The importance of high data quality is increasing with the growing impact and distribution of ML systems and big data. Also the planned AI Act from the European commission defines challenging legal requirements for data quality especially for the market introduction of safety relevant ML systems. In this paper we introduce a novel approach that supports the data quality assurance process of multiple data quality aspects. This approach enables the verification of quantitative data quality requirements. The concept and benefits are introduced and explained on small example data sets. How the method is applied is demonstrated on the well known MNIST data set based an handwritten digits.Keywords
All Related Versions
This publication has 10 references indexed in Scilit:
- Complete outlier detection and classification framework for WSNs based on OPTICSJournal of Network and Computer Applications, 2022
- Data quality certification using ISO/IEC 25012: Industrial experiencesJournal of Systems and Software, 2021
- Assessing data quality – A probability-based metric for semantic consistencyDecision Support Systems, 2018
- pointblank: Data Validation and Organization of Metadata for Local and Remote Tables2017
- Outliers detection and classification in wireless sensor networksEgyptian Informatics Journal, 2013
- The MNIST Database of Handwritten Digit Images for Machine Learning Research [Best of the Web]IEEE Signal Processing Magazine, 2012
- Data quality: A survey of data quality dimensions2012
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004
- Beyond Accuracy: What Data Quality Means to Data ConsumersJournal of Management Information Systems, 1996
- PRINCIPAL COMPONENT ANALYSIS: A BEGINNER'S GUIDE — I. Introduction and applicationWeather, 1990