A Crowd-Powered System for Fashion Similarity Search
Open Access
- 25 April 2016
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Intelligent Systems and Technology
- Vol. 7 (4) , 1-24
Abstract
Driven by the needs of customers and industry, online fashion search and analytics are recently gaining much attention. As fashion is mostly expressed by visual content, the analysis of fashion images in online social networks is a rich source of possible insights on evolving trends and customer preferences. Although a plethora of visual content is available, the modeling of clothes’ physics and movement, the implicit semantics in fashion designs, and the subjectivity of their interpretation pose difficulties to fully automated solutions for fashion search and analysis. In this article, we present the design and evaluation of a crowd-powered system for fashion similarity search from Twitter, supporting trend analysis for fashion professionals. The system enables fashion similarity search based on specific human-based similarity criteria. This is achieved by implementing a novel machine--crowd workflow that supports complex tasks requiring highly subjective judgments where multiple true solutions may coexist. We discuss how this leads to a novel class of crowd-powered systems for which the output of the crowd is not used to verify the automatic analysis but is the desired outcome. Finally, we show how this kind of crowd involvement enables a novel kind of similarity search and represents a crucial factor for the acceptance of system results by the end user.Keywords
Funding Information
- EC FP7 funded project CUBRIK (ICT- 287704)
This publication has 28 references indexed in Scilit:
- What are the Fashion Trends in New York?2014
- Large scale visual recommendations from street fashion images2014
- Using Crowdsourcing to Capture Complexity in Human Interpretations of Multimedia Content2014
- Fashion Parsing With Weak Color-Category LabelsIEEE Transactions on Multimedia, 2013
- Palette power2013
- Sensing Trending Topics in TwitterIEEE Transactions on Multimedia, 2013
- Getting the look2013
- Crowdsourcing subjective fashion advice using VizWiz2012
- A Draw-and-Guess Game to Segment Images2012
- The Interplay of Beauty, Goodness, and Usability in Interactive ProductsHuman–Computer Interaction, 2004