Kornia: an Open Source Differentiable Computer Vision Library for PyTorch
Preprint
Abstract
This work presents Kornia -- an open source computer vision library which consists of a set of differentiable routines and modules to solve generic computer vision problems. The package uses PyTorch as its main backend both for efficiency and to take advantage of the reverse-mode auto-differentiation to define and compute the gradient of complex functions. Inspired by OpenCV, Kornia is composed of a set of modules containing operators that can be inserted inside neural networks to train models to perform image transformations, camera calibration, epipolar geometry, and low level image processing techniques, such as filtering and edge detection that operate directly on high dimensional tensor representations. Examples of classical vision problems implemented using our framework are provided including a benchmark comparing to existing vision libraries.Keywords
All Related Versions
This publication has 32 references indexed in Scilit:
- Matchable Image Retrieval by Learning from Surface Reconstruction2019
- ShapeShifter: Robust Physical Adversarial Attack on Faster R-CNN Object Detector2019
- Image Classification with the Fisher Vector: Theory and PracticeInternational Journal of Computer Vision, 2013
- Aggregating local descriptors into a compact image representation2010
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- Scale & Affine Invariant Interest Point DetectorsInternational Journal of Computer Vision, 2004
- Robust wide-baseline stereo from maximally stable extremal regionsImage and Vision Computing, 2004
- Multiple View Geometry in Computer Vision2004
- Lucas-Kanade 20 Years On: A Unifying FrameworkInternational Journal of Computer Vision, 2004
- Design of an image edge detection filter using the Sobel operatorIEEE Journal of Solid-State Circuits, 1988