Applying non-negative matrix factorization with covariates to label matrix for classification
Author:
Open Access
- 25 August 2026
- journal article
- research article
- Published by Springer Nature in Japanese Journal of Statistics and Data Science
- p. 1-26
Abstract
Non-negative matrix factorization (NMF) is widely used for representation learning and interpretable analysis in high-dimensional nonnegative data, but standard formulations are unsupervised and do not directly address classification. Existing supervised extensions typically incorporate labels only through penalties or graph constraints and often require an external classifier. We propose NMF-LAB (Non-negative Matrix Factorization for Label Matrix), a classification framework that directly factorizes the label matrix Y while treating covariates A as explanatory variables. By modeling class labels as the target of factorization, NMF-LAB yields a direct probabilistic mapping from covariates to labels without an additional classifier. The proposed framework gives rise to two complementary designs. NMF-LAB Direct emphasizes feature-level interpretability through its nonnegative and additive structure, whereas NMF-LAB Kernel incorporates nonlinear covariates to improve predictive performance and generalization. Kernel-based similarities are integrated via Gaussian-kernel covariates, and the kernel design scales to large datasets through Nyström approximation. Extensive experiments on diverse datasets, ranging from small- and medium-scale benchmarks to the large-scale MNIST dataset, demonstrate the interpretability of the Direct design through sparse, nonnegative coefficient estimation, and the competitive predictive accuracy of the Kernel design. Overall, NMF-LAB provides a unified, probabilistic, and scalable framework for classification based on nonnegative matrix factorization.Keywords
All Related Versions
Funding Information
- Japan Society for the Promotion of Science (22K11930)
- Fuji Seal Foundation
This publication has 13 references indexed in Scilit:
- Applying non-negative matrix factorization with covariates to multivariate time series data as a vector autoregression modelJapanese Journal of Statistics and Data Science, 2025
- Partial Identifiability for Nonnegative Matrix FactorizationSIAM Journal on Matrix Analysis and Applications, 2023
- Semi-supervised Nonnegative Matrix Factorization for Document Classification2021
- Supervised non-negative matrix factorization methods for MALDI imaging applicationsBioinformatics, 2018
- NMFE-SSCC: Non-negative matrix factorization ensemble for semi-supervised collective classificationKnowledge-Based Systems, 2015
- Robust semi-supervised nonnegative matrix factorization2015
- Lift: Multi-Label Learning with Label-Specific FeaturesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2014
- Nonnegative Matrix and Tensor Factorizations2009
- SVD based initialization: A head start for nonnegative matrix factorizationPattern Recognition, 2008
- Learning the parts of objects by non-negative matrix factorizationNature, 1999