Multimodal Product Identification
Open Access
- 22 October 2021
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 9-13
Abstract
This technical report describes the overview of our approach to the "Watch and Buy: Multimodal Product Identification Challenge". Specifically, we tackle this problem with a three-stage framework, i.e., product detection, retrieval and classification. For the product detection, we leverage the performance by Cascade R-CNN and deformable convolution to alleviate the impact of image distortion. For the product retrieval, we enhance the Multiple Granularity Network (MGN) with global and local context through IBN, SE and Non-local blocks. The task of product classification suffers from fashion variation. To this end, we propose to fuse the global feature of the integral images and local feature of products. Experiments demonstrate that our works could achieve competitive performance with the state-of-the-art methods and our overall approach achieves a F1 score of 0.648, ranking the second place in the final challenge.Keywords
This publication has 21 references indexed in Scilit:
- Focal Loss for Dense Object Detection2017
- Deformable Convolutional Networks2017
- Sampling Matters in Deep Embedding Learning2017
- Soft-NMS — Improving Object Detection with One Line of Code2017
- Feature Pyramid Networks for Object Detection2017
- Large-Scale Item Categorization in e-Commerce Using Multiple Recurrent Neural Networks2016
- Fast R-CNN2015
- Multiple Granularity Descriptors for Fine-Grained Categorization2015
- Deep Metric Learning Using Triplet Network2015
- FaceNet: A unified embedding for face recognition and clustering2015