Automatic Generation of Product-Image Sequence in E-commerce
Authors:
Open Access
- 14 August 2022
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 2851-2859
Abstract
Product images are essential for providing desirable user experience in an e-commerce platform. For a platform with billions of products, it is extremely time-costly and labor-expensive to manually pick and organize qualified images. Furthermore, there are the numerous and complicated image rules that a product image needs to comply in order to be generated/selected. To address these challenges, in this paper, we present a new learning framework in order to achieve Automatic Generation of Product-Image Sequence (AGPIS) in e-commerce. To this end, we propose a Multi-modality Unified Image-sequence Classifier (MUIsC), which is able to simultaneously detect all categories of rule violations through learning. MUIsC leverages textual review feedback as the additional training target and utilizes product textual description to provide extra semantic information. %Without using prior knowledge or manually-crafted task, a single MUIsC model is able to learn the holistic knowledge of image reviewing and detect all categories of rule violations simultaneously. Based on offline evaluations, we show that the proposed MUIsC significantly outperforms various baselines. Besides MUIsC, we also integrate some other important modules in the proposed framework, such as primary image selection, non-compliant content detection, and image deduplication. With all these modules, our framework works effectively and efficiently in JD.com recommendation platform. By Dec 2021, our AGPIS framework has generated high-standard images for about 1.5 million products and achieves 13.6% in reject rate. Code of this work is available at https://github.com/efan3000/muisc.Keywords
All Related Versions
This publication has 21 references indexed in Scilit:
- Image aesthetic predictors based on weighted CNNs2016
- Deep Residual Learning for Image Recognition2016
- VQA: Visual Question Answering2015
- A comprehensive aesthetic quality assessment method for natural images using basic rules of photography2015
- Show and tell: A neural image caption generator2015
- Convolutional Neural Networks for No-Reference Image Quality Assessment2014
- Is a picture really worth a thousand words?2014
- A comprehensive model of the effects of online store image on purchase intention in an e-commerce environmentElectronic Commerce Research, 2013
- The Design of High-Level Features for Photo Quality Assessment2006
- Studying Aesthetics in Photographic Images Using a Computational Approach2006