Large-scale factorization of type-constrained multi-relational data
Authors:
- 1 October 2014
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 18-24
Abstract
The statistical modeling of large multi-relational datasets has increasingly gained attention in recent years. Typical applications involve large knowledge bases like DBpedia, Freebase, YAGO and the recently introduced Google Knowledge Graph that contain millions of entities, hundreds and thousands of relations, and billions of relational tuples. Collective factorization methods have been shown to scale up to these large multi-relational datasets, in particular in form of tensor approaches that can exploit the highly scalable alternating least squares (ALS) algorithms for calculating the factors. In this paper we extend the recently proposed state-of-the-art RESCAL tensor factorization to consider relational type-constraints. Relational type-constraints explicitly define the logic of relations by excluding entities from the subject or object role. In addition we will show that in absence of prior knowledge about type-constraints, local closed-world assumptions can be approximated for each relation by ignoring unobserved subject or object entities in a relation. In our experiments on representative large datasets (Cora, DBpedia), that contain up to millions of entities and hundreds of type-constrained relations, we show that the proposed approach is scalable. It further significantly outperforms RESCAL without type-constraints in both, runtime and prediction quality.Keywords
This publication has 15 references indexed in Scilit:
- Non-negative Multiple Tensor Factorization2013
- Tensor Factorization for Multi-relational Learning2013
- Localized factor models for multi-context recommendation2011
- Modeling and Learning Context-Aware Recommendation Scenarios Using Tensor Decomposition2011
- Learning optimal ranking with tensor factorization for tag recommendation2009
- Relational learning via collective matrix factorization2008
- Temporal Analysis of Semantic Graphs Using ASALSAN2007
- Higher-Order Web Link Analysis Using Multilinear Algebra2006
- Matrix Analysis for Scientists and Engineers2004
- Some Mathematical Notes on Three-Mode Factor AnalysisPsychometrika, 1966