word2vec, node2vec, graph2vec, X2vec: Towards a Theory of Vector Embeddings of Structured Data
Author:
Top Cited Papers
Open Access
- 14 June 2020
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1-16
Abstract
Vector representations of graphs and relational structures, whether hand-crafted feature vectors or learned representations, enable us to apply standard data analysis and machine learning techniques to the structures. A wide range of methods for generating such embeddings have been studied in the machine learning and knowledge representation literature. However, vector embeddings have received relatively little attention from a theoretical point of view. Starting with a survey of embedding techniques that have been used in practice, in this paper we propose two theoretical approaches that we see as central for understanding the foundations of vector embeddings. We draw connections between the various approaches and suggest directions for future research.Keywords
All Related Versions
Funding Information
- Deutsche Forschungsgemeinschaft (GR 1492/16-1)
This publication has 36 references indexed in Scilit:
- Sherali--Adams Relaxations and Indistinguishability in Counting LogicsSIAM Journal on Computing, 2013
- On recognizing graphs by numbers of homomorphismsJournal of Graph Theory, 2010
- Laplacian Eigenmaps for Dimensionality Reduction and Data RepresentationNeural Computation, 2003
- A Global Geometric Framework for Nonlinear Dimensionality ReductionScience, 2000
- Long Short-Term MemoryNeural Computation, 1997
- Support-vector networksMachine Learning, 1995
- The geometry of graphs and some of its algorithmic applicationsCombinatorica, 1995
- An optimal lower bound on the number of variables for graph identificationCombinatorica, 1992
- On the cancellation law among finite relational structuresPeriodica Mathematica Hungarica, 1971
- The Generation of a Unique Machine Description for Chemical Structures-A Technique Developed at Chemical Abstracts Service.Journal of Chemical Documentation, 1965