GraphFM: Graph Factorization Machines for Feature Interaction Modelling
Open Access
- 7 January 2025
- journal article
- research article
- Published by Springer Nature in Machine Intelligence Research
- Vol. 22 (2) , 239-253
Abstract
Factorization machine (FM) is a prevalent approach to modelling pairwise (second-order) feature interactions when dealing with high-dimensional sparse data. However, on the one hand, FMs fail to capture higher-order feature interactions suffering from combinatorial expansion. On the other hand, taking into account interactions between every pair of features may introduce noise and degrade the prediction accuracy. To solve these problems, we propose a novel approach, the graph factorization machine (GraphFM), which naturally represents features in the graph structure. In particular, we design a mechanism to select beneficial feature interactions and formulate them as edges between features. Then the proposed model, which integrates the interaction function of the FM into the feature aggregation strategy of the graph neural network (GNN), can model arbitrary-order feature interactions on graph-structured features by stacking layers. Experimental results on several real-world datasets demonstrate the rationality and effectiveness of our proposed approach. The code and data are available at https://github.com/CRIPAC-DIG/GraphCTR .Keywords
All Related Versions
This publication has 43 references indexed in Scilit:
- A Novel Attention-based Global and Local Information Fusion Neural Network for Group RecommendationMachine Intelligence Research, 2022
- Graph-Convolved Factorization Machines for Personalized RecommendationIEEE Transactions on Knowledge and Data Engineering, 2021
- HoAFM: A High-order Attentive Factorization Machine for CTR PredictionInformation Processing & Management, 2020
- Situation Recognition with Graph Neural Networks2017
- 3D Graph Neural Networks for RGBD Semantic Segmentation2017
- The More You Know: Using Knowledge Graphs for Image Classification2017
- Product-Based Neural Networks for User Response Prediction2016
- Deep Learning over Multi-field Categorical Data2016
- Factorization Machines2010
- A new model for learning in graph domains2006