Region-based representations of image and video: segmentation tools for multimedia services
Authors:
- P. SalembierPSP. Salembier
- F. MarquesFMF. Marques
Open Access
- 1 January 1999
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. 9 (8) , 1147-1169
Abstract
This paper discusses region-based representations of image and video that are useful for multimedia services such as those supported by the MPEG-4 and MPEG-7 standards. Classical tools related to the generation of the region-based representations are discussed. After a description of the main processing steps and the corresponding choices in terms of feature spaces, decision spaces, and decision algorithms, the state of the art in segmentation is reviewed. Mainly tools useful in the context of the MPEG-4 and MPEG-7 standards are discussed. The review is structured around the strategies used by the algorithms (transition based or homogeneity based) and the decision spaces (spatial, spatio-temporal, and temporal). The second part of this paper proposes a partition tree representation of images and introduces a processing strategy that involves a similarity estimation step followed by a partition creation step. This strategy tries to find a compromise between what can be done in a systematic and universal way and what has to be application dependent. It is shown in particular how a single partition tree created with an extremely simple similarity feature can support a large number of segmentation applications: spatial segmentation, motion estimation, region-based coding, semantic object extraction, and region-based retrieval.Peer ReviewedPostprint (published versionKeywords
This publication has 52 references indexed in Scilit:
- Automatic segmentation of moving objects for video object plane generationIEEE Transactions on Circuits and Systems for Video Technology, 1998
- A noise robust method for 2D shape estimation of moving objects in video sequences considering a moving cameraSignal Processing, 1998
- Example-based learning for view-based human face detectionIEEE Transactions on Pattern Analysis and Machine Intelligence, 1998
- Probabilistic visual learning for object representationIEEE Transactions on Pattern Analysis and Machine Intelligence, 1997
- Object-based estimation of dense motion fieldsIEEE Transactions on Image Processing, 1997
- Video Annotation by Motion Interpretation Using Optical Flow StreamsJournal of Visual Communication and Image Representation, 1996
- Coding-Oriented Segmentation of Video sequences1996
- Automatic partitioning of full-motion videoMultimedia Systems, 1993
- Morphological segmentationJournal of Visual Communication and Image Representation, 1990
- Graph theory for image analysis: an approach based on the shortest spanning treeIEE Proceedings F Communications, Radar and Signal Processing, 1986