MNL: A Highly-Efficient Model for Large-scale Dynamic Weighted Directed Network Representation
- 31 October 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Big Data
- Vol. 9 (3) , 889-903
Abstract
A Non-negative Latent-factorization-of-tensors model relying on a N onnegative and M ultiplicative U pdate on I ncomplete T ensors (NMU-IT) algorithm facilitates efficient representation learning to a D ynamic W eighted D irected N etwork (DWDN). However, a NMU-IT algorithm leads to slow model convergence and inefficient selection of hyper-parameters. Aiming to address these challenging issues, this work proposes a Momentum-incorporated Biased Non-negative and Adaptive Latent-factorization-of-tensors (MNL) model. It adopts two-fold ideas: 1) incorporating a generalized momentum method into the NMU-IT algorithm to enable fast model convergence; 2) facilitating hyper-parameter slef-adaptation via Particle Swarm Optimization. Empirical studies on four real DWDNs indicate that the proposed MNL is superior to state-of-the-art models in performing efficient representation learning to a DWDN, which is definitely supported by its high computational efficiency and prediction accuracy for missing links of a DWDN. Moreover, its hyper-parameter-free training enables its high practicability in real scenes.Keywords
Funding Information
- National Natural Science Foundation of China (62272078)
- CAAI-Huawei MindSpore Open Fund (CAAIXSJLJJ-2021-035A)
This publication has 69 references indexed in Scilit:
- A Nonnegative Latent Factor Model for Large-Scale Sparse Matrices in Recommender Systems via Alternating Direction MethodIEEE Transactions on Neural Networks and Learning Systems, 2015
- Improved Quantum-Inspired Evolutionary Algorithm for Large-Size Lane ReservationIEEE Transactions on Systems, Man, and Cybernetics: Systems, 2015
- A New Multivariate Approach for Prognostics Based on Extreme Learning Machine and Fuzzy ClusteringIEEE Transactions on Cybernetics, 2015
- Compressive Sensing of Sparse TensorsIEEE Transactions on Image Processing, 2014
- A new adaptive momentum algorithm for split-complex recurrent neural networksNeurocomputing, 2012
- Distributed Optimization and Statistical Learning via the Alternating Direction Method of MultipliersFoundations and Trends in Machine Learning, 2011
- Convergence analysis of a back-propagation algorithm with adaptive momentumNeurocomputing, 2010
- Tensor Decompositions and ApplicationsSIAM Review, 2009
- Factorization meets the neighborhood2008
- Nonlinear ProgrammingJournal of the Operational Research Society, 1997