Wide and Cross GNNs: Cross‐Interactions and Parallel Scaling for Robust Chemical Property Prediction
- 19 May 2026
- journal article
- Published by Wiley in Journal of Chemometrics
- Vol. 40 (6)
Abstract
Graph neural networks (GNNs) have emerged as a powerful tool for molecular property prediction by representing chemical structures as graphs, yet they frequently struggle with oversmoothing and the inefficient capture of high‐order feature interactions. This paper proposes the wide and cross graph isomorphism network (WCGIN), an architecture designed to address these limitations through the integration of explicit cross‐feature interaction layers and a soft mixture‐of‐experts (MoE) parallel scaling paradigm. By incorporating matrix‐based cross‐layers into the graph isomorphism network (GIN) aggregation process, the model explicitly forms nonlinear feature relationships that might otherwise be lost during neighborhood processing. Simultaneously, the parallel MoE structure facilitates scaling by allowing multiple expert GNN modules to learn distinct representations, which are then aggregated via a gating network to mitigate the representational collapse typical of deep sequential stacking. The performance of WCGIN was evaluated across seven molecular benchmarks covering physical chemistry and biology, including four regression and three classification tasks. Experimental results indicate that adding even a single cross‐layer boosts performance in most cases, and the parallel scaling approach significantly outperforms standard stacked configurations for models with fewer than 10 layers. Furthermore, the study demonstrates that specialized mechanisms like load‐balancing loss are not required for these compact models to achieve robust predictive gains. These findings suggest that combining explicit feature interactions with parallel processing offers an efficient and effective pathway for scaling GNNs in chemical property prediction.Keywords
Funding Information
- Politechnika Warszawska
This publication has 10 references indexed in Scilit:
- Recent Advances in the Modeling of Ionic Liquids Using Artificial Neural NetworksJournal of Chemical Information and Modeling, 2025
- Benchmarking machine learning methods for modeling physical properties of ionic liquidsJournal of Molecular Liquids, 2022
- Masked Label Prediction: Unified Message Passing Model for Semi-Supervised Classification2021
- DCN V2: Improved Deep & Cross Network and Practical Lessons for Web-scale Learning to Rank Systems2021
- Mol‐BERT: An Effective Molecular Representation with BERT for Molecular Property PredictionWireless Communications and Mobile Computing, 2021
- DeepGCNs: Can GCNs Go As Deep As CNNs?2019
- SMILES-BERT2019
- Optuna2019
- Extensive Databases and Group Contribution QSPRs of Ionic Liquids Properties. 1. DensityIndustrial & Engineering Chemistry Research, 2019
- Deep & Cross Network for Ad Click Predictions2017