Video tooning
Authors:
Open Access
- 1 August 2004
- conference paper
- Published by Association for Computing Machinery (ACM)
- Vol. 23 (3) , 574-583
Abstract
We describe a system for transforming an input video into a highly abstracted, spatio-temporally coherent cartoon animation with a range of styles. To achieve this, we treat video as a space-time volume of image data. We have developed an anisotropic kernel mean shift technique to segment the video data into contiguous volumes. These provide a simple cartoon style in themselves, but more importantly provide the capability to semi-automatically rotoscope semantically meaningful regions.In our system, the user simply outlines objects on keyframes. A mean shift guided interpolation algorithm is then employed to create three dimensional semantic regions by interpolation between the keyframes, while maintaining smooth trajectories along the time dimension. These regions provide the basis for creating smooth two dimensional edge sheets and stroke sheets embedded within the spatio-temporal video volume. The regions, edge sheets, and stroke sheets are rendered by slicing them at particular times. A variety of styles of rendering are shown. The temporal coherence provided by the smoothed semantic regions and sheets results in a temporally consistent non-photorealistic appearance.Keywords
This publication has 16 references indexed in Scilit:
- Image and Video Segmentation by Anisotropic Kernel Mean Shift2004
- Mean shift: a robust approach toward feature space analysisIEEE Transactions on Pattern Analysis and Machine Intelligence, 2002
- Shape matching and object recognition using shape contextsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2002
- Stylized video cubes2002
- SnakeToonz2002
- Computer aided inbetweening2002
- A semi-automatic system for edge tracking with snakesThe Visual Computer, 1996
- Snakes: Active contour modelsInternational Journal of Computer Vision, 1988
- A shortest augmenting path algorithm for dense and sparse linear assignment problemsComputing, 1987
- The estimation of the gradient of a density function, with applications in pattern recognitionIEEE Transactions on Information Theory, 1975