Deep Dual-resolution Networks for Real-time and Accurate Semantic Segmentation of Road Scenes
Authors:
- Yuanduo HongYHYuanduo Hong
- Huihui PanHPHuihui Pan
- Weichao SunWSWeichao Sun
- Yisong JiaYJYisong Jia
Preprint
Abstract
Semantic segmentation is a key technology for autonomous vehicles to understand the surrounding scenes. The appealing performances of contemporary models usually come at the expense of heavy computations and lengthy inference time, which is intolerable for self-driving. Using light-weight architectures (encoder-decoder or two-pathway) or reasoning on low-resolution images, recent methods realize very fast scene parsing, even running at more than 100 FPS on a single 1080Ti GPU. However, there is still a significant gap in performance between these real-time methods and the models based on dilation backbones. To tackle this problem, we proposed a family of efficient backbones specially designed for real-time semantic segmentation. The proposed deep dual-resolution networks (DDRNets) are composed of two deep branches between which multiple bilateral fusions are performed. Additionally, we design a new contextual information extractor named Deep Aggregation Pyramid Pooling Module (DAPPM) to enlarge effective receptive fields and fuse multi-scale context based on low-resolution feature maps. Our method achieves a new state-of-the-art trade-off between accuracy and speed on both Cityscapes and CamVid dataset. In particular, on a single 2080Ti GPU, DDRNet-23-slim yields 77.4% mIoU at 102 FPS on Cityscapes test set and 74.7% mIoU at 230 FPS on CamVid test set. With widely used test augmentation, our method is superior to most state-of-the-art models and requires much less computation. Codes and trained models are available online.Keywords
All Related Versions
This publication has 20 references indexed in Scilit:
- BiSeNet V2: Bilateral Network with Guided Aggregation for Real-Time Semantic SegmentationInternational Journal of Computer Vision, 2021
- CABiNet: Efficient Context Aggregation Network for Low-Latency Semantic Segmentation2021
- Real-Time Semantic Segmentation With Fast AttentionIEEE Robotics and Automation Letters, 2020
- Object-Contextual Representations for Semantic Segmentation2020
- Semantic Flow for Fast and Accurate Scene Parsing2020
- Coarse-to-Fine Semantic Segmentation From Image-Level LabelsIEEE Transactions on Image Processing, 2019
- Wider or Deeper: Revisiting the ResNet Model for Visual RecognitionPattern Recognition, 2019
- Her2Net: A Deep Framework for Semantic Segmentation and Classification of Cell Membranes and Nuclei in Breast Cancer EvaluationIEEE Transactions on Image Processing, 2018
- Semantic object classes in video: A high-definition ground truth databasePattern Recognition Letters, 2009
- A Wavelet Tour of Signal Processing1999