Enhancing Missing Data Imputation through Combined Bipartite Graph and Complete Directed Graph
Authors:
- Zhaoyang ZhangZZZhaoyang Zhang
- Hongtu ZhuHZHongtu Zhu
- Ziqi ChenZCZiqi Chen
- Yingjie ZhangYZYingjie Zhang
- Hai ShuHSHai Shu
Preprint
Abstract
In this paper, we aim to address a significant challenge in the field of missing data imputation: identifying and leveraging the interdependencies among features to enhance missing data imputation for tabular data. We introduce a novel framework named the Bipartite and Complete Directed Graph Neural Network (BCGNN). Within BCGNN, observations and features are differentiated as two distinct node types, and the values of observed features are converted into attributed edges linking them. The bipartite segment of our framework inductively learns embedding representations for nodes, efficiently utilizing the comprehensive information encapsulated in the attributed edges. In parallel, the complete directed graph segment adeptly outlines and communicates the complex interdependencies among features. When compared to contemporary leading imputation methodologies, BCGNN consistently outperforms them, achieving a noteworthy average reduction of 15% in mean absolute error for feature imputation tasks under different missing mechanisms. Our extensive experimental investigation confirms that an in-depth grasp of the interdependence structure substantially enhances the model's feature embedding ability. We also highlight the model's superior performance in label prediction tasks involving missing data, and its formidable ability to generalize to unseen data points.Keywords
All Related Versions
This publication has 15 references indexed in Scilit:
- The Expressive Power of Graph Neural Networks: A SurveyIEEE Transactions on Knowledge and Data Engineering, 2024
- The behaviour of rank correlation coefficients for incomplete dataResearch in Mathematics, 2022
- Missing data imputation with adversarially-trained graph convolutional networksNeural Networks, 2020
- Multiple Imputation for Missing Data via Sequential Regression TreesAmerican Journal of Epidemiology, 2010
- A Singular Value Thresholding Algorithm for Matrix CompletionSIAM Journal on Optimization, 2010
- Multiple imputation for missing data in epidemiological and clinical research: potential and pitfallsBMJ, 2009
- Missing data methods in longitudinal studies: a reviewTEST, 2009
- Inverse probability weighted estimation for general missing data problemsJournal of Econometrics, 2007
- Segmentation of Multivariate Mixed Data via Lossy Data Coding and CompressionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2007
- Local Influence for Incomplete Data ModelsJournal of the Royal Statistical Society Series B: Statistical Methodology, 2001