Data collection and quality challenges for deep learning
Authors:
Top Cited Papers
Open Access
- 1 August 2020
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in Proceedings of the VLDB Endowment
- Vol. 13 (12) , 3429-3432
Abstract
Software 2.0 refers to the fundamental shift in software engineering where using machine learning becomes the new norm in software with the availability of big data and computing infrastructure. As a result, many software engineering practices need to be rethought from scratch where data becomes a first-class citizen, on par with code. It is well known that 80--90% of the time for machine learning development is spent on data preparation. Also, even the best machine learning algorithms cannot perform well without good data or at least handling biased and dirty data during model training. In this tutorial, we focus on data collection and quality challenges that frequently occur in deep learning applications. Compared to traditional machine learning, there is less need for feature engineering, but more need for significant amounts of data. We thus go through state-of-the-art data collection techniques for machine learning. Then, we cover data validation and cleaning techniques for improving data quality. Even if the data is still problematic, hope is not lost, and we cover fair and robust training techniques for handling data bias and errors. We believe that the data management community is well poised to lead the research in these directions. The presenters have extensive experience in developing machine learning platforms and publishing papers in top-tier database, data mining, and machine learning venues.Keywords
This publication has 9 references indexed in Scilit:
- TRAP: Two-level Regularized Autoencoder-based Embedding for Power-law Distributed Data2020
- Data Cleaning2019
- Algorithmic Fairness2019
- Recurrent Neural Networks for Multivariate Time Series with Missing ValuesScientific Reports, 2018
- Deep Representation Learning for Trajectory Similarity Computation2018
- Controlling False Discoveries During Interactive Data Exploration2017
- Data Management Challenges in Production Machine Learning2017
- Data Management in Machine Learning2017
- S ee DBProceedings of the VLDB Endowment, 2015