An efficient manifold density estimator for all recommendation systems
Preprint
Abstract
Many unsupervised representation learning methods belong to the class of similarity learning models. While various modality-specific approaches exist for different types of data, a core property of many methods is that representations of similar inputs are close under some similarity function. We propose EMDE (Efficient Manifold Density Estimator) - a framework utilizing arbitrary vector representations with the property of local similarity to succinctly represent smooth probability densities on Riemannian manifolds. Our approximate representation has the desirable properties of being fixed-size and having simple additive compositionality, thus being especially amenable to treatment with neural networks - both as input and output format, producing efficient conditional estimators. We generalize and reformulate the problem of multi-modal recommendations as conditional, weighted density estimation on manifolds. Our approach allows for trivial inclusion of multiple interaction types, modalities of data as well as interaction strengths for any recommendation setting. Applying EMDE to both top-k and session-based recommendation settings, we establish new state-of-the-art results on multiple open datasets in both uni-modal and multi-modal settings.Keywords
All Related Versions
This publication has 19 references indexed in Scilit:
- Geometric mean of probability measures and geodesics of Fisher information metricMathematische Nachrichten, 2023
- Cleora: A Simple, Strong and Scalable Graph Embedding Scheme2021
- Ripple Walk Training: A Subgraph-based Training Framework for Large and Deep Graph Neural Network2021
- Evaluation of session-based recommendation algorithmsUser Modeling and User-Adapted Interaction, 2018
- Variational Autoencoders for Collaborative Filtering2018
- Updatable, Accurate, Diverse, and Scalable Recommendations for Interactive ApplicationsACM Transactions on Interactive Intelligent Systems, 2016
- RecSys Challenge 2015 and the YOOCHOOSE Dataset2015
- SLIM: Sparse Linear Methods for Top-N Recommender Systems2011
- An improved data stream summary: the count-min sketch and its applicationsJournal of Algorithms, 2005
- The Fast Gauss TransformSIAM Journal on Scientific and Statistical Computing, 1991