Image Morphing in Deep Feature Spaces: Theory and Applications
Preprint
Abstract
This paper combines image metamorphosis with deep features. To this end, images are considered as maps into a high-dimensional feature space and a structure-sensitive, anisotropic flow regularization is incorporated in the metamorphosis model proposed by Miller, Trouv\'e, Younes and coworkers. For this model a variational time discretization of the Riemannian path energy is presented and the existence of discrete geodesic paths minimizing this energy is demonstrated. Furthermore, convergence of discrete geodesic paths to geodesic paths in the time continuous model is investigated. The spatial discretization is based on a finite difference approximation in image space and a stable spline approximation in deformation space, the fully discrete model is optimized using the iPALM algorithm. Numerical experiments indicate that the incorporation of semantic deep features is superior to intensity-based approaches.Keywords
All Related Versions
This publication has 19 references indexed in Scilit:
- Metamorphoses of Functional Shapes in Sobolev SpacesFoundations of Computational Mathematics, 2018
- Metamorphosis of images in reproducing kernel Hilbert spacesAdvances in Computational Mathematics, 2015
- Variational time discretization of geodesic calculusIMA Journal of Numerical Analysis, 2014
- Diffeomorphic 3D Image Registration via Geodesic Shooting Using an Efficient Adjoint CalculationInternational Journal of Computer Vision, 2011
- Extension to BV functions of the large deformation diffeomorphisms matching approachComptes Rendus Mathematique, 2009
- Metamorphoses Through Lie Group ActionFoundations of Computational Mathematics, 2005
- Computing Large Deformation Metric Mappings via Geodesic Flows of DiffeomorphismsInternational Journal of Computer Vision, 2005
- Variational problems on flows of diffeomorphisms for image matchingQuarterly of Applied Mathematics, 1998
- Global invertibility of Sobolev functions and the interpenetration of matterProceedings of the Royal Society of Edinburgh: Section A Mathematics, 1981
- Convergence of convex sets and of solutions of variational inequalitiesAdvances in Mathematics, 1969