Automatic Semantic Content Extraction in Videos Using a Fuzzy Ontology and Rule-Based Model
- 1 September 2011
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Knowledge and Data Engineering
- Vol. 25 (1) , 47-61
Abstract
Recent increase in the use of video-based applications has revealed the need for extracting the content in videos. Raw data and low-level features alone are not sufficient to fulfill the user 's needs; that is, a deeper understanding of the content at the semantic level is required. Currently, manual techniques, which are inefficient, subjective and costly in time and limit the querying capabilities, are being used to bridge the gap between low-level representative features and high-level semantic content. Here, we propose a semantic content extraction system that allows the user to query and retrieve objects, events, and concepts that are extracted automatically. We introduce an ontology-based fuzzy video semantic content model that uses spatial/temporal relations in event and concept definitions. This metaontology definition provides a wide-domain applicable rule construction standard that allows the user to construct an ontology for a given domain. In addition to domain ontologies, we use additional rule definitions (without using ontology) to lower spatial relation computation cost and to be able to define some complex situations more effectively. The proposed framework has been fully implemented and tested on three different domains. We have obtained satisfactory precision and recall rates for object, event and concept extraction.Keywords
This publication has 23 references indexed in Scilit:
- Automatic detection of salient objects and spatial relations in videos for a video database systemImage and Vision Computing, 2008
- BilVideo: Design and Implementation of a Video Database Management SystemMultimedia Tools and Applications, 2005
- Image database design based on 9D-SPA representation for spatial relationsIEEE Transactions on Knowledge and Data Engineering, 2004
- Video-based event recognition: activity representation and probabilistic recognition methodsComputer Vision and Image Understanding, 2004
- Real-Time Compressed-Domain Spatiotemporal Segmentation and Ontologies for Video Indexing and RetrievalIEEE Transactions on Circuits and Systems for Video Technology, 2004
- Spatio-temporal querying in video databasesInformation Sciences, 2004
- ClassView : Hierarchical Video Shot Classification, Indexing, and AccessingIEEE Transactions on Multimedia, 2004
- Event detection and analysis from video streamsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2001
- MultiView: Multilevel video content representation and retrievalJournal of Electronic Imaging, 2001
- Maintaining knowledge about temporal intervalsCommunications of the ACM, 1983