Optimized Comics-Based Storytelling for Temporal Image Sequences
Authors:
- 18 December 2014
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. 17 (2) , 201-215
Abstract
We propose a system to transform any temporal image sequence into a comics-based presentation, as an effective and interesting storytelling manner. Three main components, including page allocation, layout selection, and speech balloon placement, are respectively formulated as optimization problems, and systematic approaches are proposed to find solutions. Page allocation is viewed as a labeling problem, and the best solution is determined by the genetic algorithm. Importance values of images and predefined layouts are both represented in vector forms, and the best layout is selected by finding the best match between vectors. Feasible solutions of speech balloons constitute a solution space, and the best solution that jointly describes the best locations of all balloons in a page is determined by the particle swarm optimization algorithm. Objective evaluation and subjective evaluation are designed from various perspectives to demonstrate effectiveness and superiority of the proposed system.Keywords
Funding Information
- Ministry of Science and Technology, Taiwan (NSC101-2221-E-194-055-MY2)
This publication has 37 references indexed in Scilit:
- Film Comic Generation with Eye Tracking2013
- Automatic stylistic manga layoutACM Transactions on Graphics, 2012
- Film Comic Reflecting Camera-Works2012
- Effective Comic-Like Representations with Embedded Regions of Interest2012
- Dynamic Video Collage2010
- WEB FORM PAGE IN MOBILE DEVICES - Optimization of Layout with a Simple Genetic Algorithm2009
- The Story Picturing Engine---a system for automatic text illustrationACM Transactions on Multimedia Computing, Communications, and Applications, 2006
- An Automated Procedure for Word Balloon Placement in Cinema Comics2006
- Multimedia content analysis-using both audio and visual cluesIEEE Signal Processing Magazine, 2000
- Video visualization for compact presentation and fast browsing of pictorial contentIEEE Transactions on Circuits and Systems for Video Technology, 1997