Quadric Hypersurface Intersection for Manifold Learning in Feature Space
Preprint
Abstract
The knowledge that data lies close to a particular submanifold of the ambient Euclidean space may be useful in a number of ways. For instance, one may want to automatically mark any point far away from the submanifold as an outlier or to use the geometry to come up with a better distance metric. Manifold learning problems are often posed in a very high dimension, e.g. for spaces of images or spaces of words. Today, with deep representation learning on the rise in areas such as computer vision and natural language processing, many problems of this kind may be transformed into problems of moderately high dimension, typically of the order of hundreds. Motivated by this, we propose a manifold learning technique suitable for moderately high dimension and large datasets. The manifold is learned from the training data in the form of an intersection of quadric hypersurfaces -- simple but expressive objects. At test time, this manifold can be used to introduce a computationally efficient outlier score for arbitrary new data points and to improve a given similarity metric by incorporating the learned geometric structure into it.Keywords
All Related Versions
This publication has 10 references indexed in Scilit:
- Out-of-Distribution Detection for Reliable Face RecognitionIEEE Signal Processing Letters, 2020
- Fitting quadrics with a Bayesian priorComputational Visual Media, 2016
- Analysis of principal nested spheresBiometrika, 2012
- Kernel Methods in Computer VisionFoundations and Trends in Computer Graphics and Vision, 2009
- Principal Manifolds and Nonlinear Dimensionality Reduction via Tangent Space AlignmentSIAM Journal on Scientific Computing, 2004
- An improved algorithm for algebraic curve and surface fitting2002
- Nonlinear Dimensionality Reduction by Locally Linear EmbeddingScience, 2000
- A Global Geometric Framework for Nonlinear Dimensionality ReductionScience, 2000
- Circle fitting by linear and nonlinear least squaresJournal of Optimization Theory and Applications, 1993
- Estimation of planar curves, surfaces, and nonplanar space curves defined by implicit equations with applications to edge and range image segmentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 1991