GINet-DGC: Structural Inductive Biases and Dynamic Generalization Control for High-Dimensional Small-Sample Tabular Data
Preprint
- 12 June 2026
- preprint
- Published by MDPI AG in Preprints.org
Abstract
Learning from High-Dimensional Low-Sample Size data has long been a persistent challenge in machine learning, because models must infer reliable patterns from limited observations while handling a large number of variables,this challenge is especially common in biomedical applications. High-dimensional small-sample data make predictive modeling vulnerable to unstable training and overfitting. To address this issue, we propose GINet-DGC, an AI framework that integrates feature-wise structural priors with dynamic generalization monitoring. Instead of directly learning an unconstrained first-layer weight matrix, GINet-DGC generates task-specific weights from multi-view feature descriptors, including latent semantic, global distributional, local topological, and hierarchical representations. This structure-constrained weight generation design narrows the feature-interaction search space and acts as an inductive regularizer against noise and redundant molecular features. Furthermore, we introduce an Overfitting-aware Index to monitor the training trajectory and detect the generalization saturation point for adaptive termination. Experiments on eight publicly accessible real-world biomedical HDLSS gene-expression datasets, evaluated under repeated stratified 5×5 cross-validation, show that GINet-DGC achieves competitive and stable performance against 17 baselines. These results suggest that explicitly encoding structural priors can improve robust AI modeling for data-scarce benchmarks.Keywords
All Related Versions
This publication has 29 references indexed in Scilit:
- Accurate predictions on small data with a tabular foundation modelNature, 2025
- Combining Machine Learning and Computational Chemistry for Predictive Insights Into Chemical SystemsChemical Reviews, 2021
- A primer on deep learning in genomicsNature Genetics, 2018
- XGBoost2016
- Deep learningNature, 2015
- Searching for exotic particles in high-energy physics with deep learningNature Communications, 2014
- ADASYN: Adaptive synthetic sampling approach for imbalanced learning2008
- Random ForestsMachine Learning, 2001
- Learning the parts of objects by non-negative matrix factorizationNature, 1999
- Early Stopping - But When?1998