Spott
Open Access
- 28 June 2017
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Multimedia Computing, Communications, and Applications
- Vol. 13 (3s) , 1-16
Abstract
Spott is an innovative second screen mobile multimedia application which offers viewers relevant information on objects (e.g., clothing, furniture, food) they see and like on their television screens. The application enables interaction between TV audiences and brands, so producers and advertisers can offer potential consumers tailored promotions, e-shop items, and/or free samples. In line with the current views on innovation management, the technological excellence of the Spott application is coupled with iterative user involvement throughout the entire development process. This article discusses both of these aspects and how they impact each other. First, we focus on the technological building blocks that facilitate the (semi-) automatic interactive tagging process of objects in the video streams. The majority of these building blocks extensively make use of novel and state-of-the-art deep learning concepts and methodologies. We show how these deep learning based video analysis techniques facilitate video summarization, semantic keyframe clustering, and (similar) object retrieval. Secondly, we provide insights in user tests that have been performed to evaluate and optimize the application’s user experience. The lessons learned from these open field tests have already been an essential input in the technology development and will further shape the future modifications to the Spott application.Keywords
Funding Information
- Ghent University, iMinds, the Institute for the Promotion of Innovation by Science and Technology in Flanders (IWT) and Appiness bvba
- IWT/VLAIO O8O Spotshop project
- The project’s related e-commerce service - under the name “Spott”
This publication has 18 references indexed in Scilit:
- Spatio-Temporal Wardrobe Generation of Actors’ Clothing in Video Content2016
- MVC2016
- Summarizing video sequence using a graph-based hierarchical approachNeurocomputing, 2016
- Where to Buy It: Matching Street Clothing Photos in Online Shops2015
- Shot and Scene Detection via Hierarchical Clustering for Re-using Broadcast Video2015
- Learning to compare image patches via convolutional neural networks2015
- Content Based Image Search for Clothing Recommendations in E-Commerce2015
- Video Summarization: Techniques and Classification2012
- CEDD: Color and Edge Directivity Descriptor: A Compact Descriptor for Image Indexing and Retrieval2008
- Innovation diffusion: The need for more accurate consumer insight. Illustration of the PSAP scale as a segmentation instrumentJournal of Targeting, Measurement and Analysis for Marketing, 2004