TROSD: A New RGB-D Dataset for Transparent and Reflective Object Segmentation in Practice
- 9 March 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems for Video Technology
- Vol. 33 (10) , 5721-5733
Abstract
Transparent and reflective objects are omnipresent in our daily life, but their unique visual and optical characteristics are notoriously challenging even for state-of-the-art deep networks of semantic segmentation. To alleviate this challenge, we construct a new large-scale real-world RGB-D dataset called TROSD, which is more comprehensive than existing datasets for transparent and reflective object segmentation. Our TROSD dataset contains 11,060 RGB-D images with three semantic classes in terms of transparent objects, reflective objects, and others, covering a variety of daily scenes. Together with the dataset, we also introduce a novel network (TROSNet) as a high-standard baseline to assist other researchers to develop and benchmark their algorithms of transparent and reflective object segmentation. Moreover, extensive experiments also clearly show that the proposed TROSD dataset has an excellent capacity to facilitate the development of semantic segmentation algorithms with strong generalizability.Keywords
Funding Information
- Shanghai Artificial Intelligence Laboratory
This publication has 43 references indexed in Scilit:
- SCA-CNN: Spatial and Channel-Wise Attention in Convolutional Networks for Image Captioning2017
- ScanNet: Richly-Annotated 3D Reconstructions of Indoor Scenes2017
- Pyramid Scene Parsing Network2017
- RefineNet: Multi-path Refinement Networks for High-Resolution Semantic Segmentation2017
- Deep Residual Learning for Image Recognition2016
- The Cityscapes Dataset for Semantic Urban Scene Understanding2016
- SUN RGB-D: A RGB-D scene understanding benchmark suite2015
- Fully convolutional networks for semantic segmentation2015
- ImageNet Large Scale Visual Recognition ChallengeInternational Journal of Computer Vision, 2015
- The Pascal Visual Object Classes Challenge: A RetrospectiveInternational Journal of Computer Vision, 2014