Learning Semantic Neural Tree for Human Parsing
Preprint
Abstract
The majority of existing human parsing methods formulate the task as semantic segmentation, which regard each semantic category equally and fail to exploit the intrinsic physiological structure of human body, resulting in inaccurate results. In this paper, we design a novel semantic neural tree for human parsing, which uses a tree architecture to encode physiological structure of human body, and designs a coarse to fine process in a cascade manner to generate accurate results. Specifically, the semantic neural tree is designed to segment human regions into multiple semantic subregions (e.g., face, arms, and legs) in a hierarchical way using a new designed attention routing module. Meanwhile, we introduce the semantic aggregation module to combine multiple hierarchical features to exploit more context information for better performance. Our semantic neural tree can be trained in an end-to-end fashion by standard stochastic gradient descent (SGD) with back-propagation. Several experiments conducted on four challenging datasets for both single and multiple human parsing, i.e., LIP, PASCAL-Person-Part, CIHP and MHP-v2, demonstrate the effectiveness of the proposed method. Code can be found at https://isrc.iscas.ac.cn/gitlab/research/sematree.Keywords
All Related Versions
This publication has 25 references indexed in Scilit:
- Mutual Learning to Adapt for Joint Human Parsing and Pose Estimation2018
- Instance-Level Human Parsing via Part Grouping Network2018
- Macro-Micro Adversarial Network for Human Parsing2018
- Interpretable Structure-Evolving LSTM2017
- Semantic Object Parsing with Graph LSTM2016
- Zoom Better to See Clearer: Human and Object Parsing with Hierarchical Auto-Zoom Net2016
- Deep Residual Learning for Image Recognition2016
- Rethinking the Inception Architecture for Computer Vision2016
- Detect What You Can: Detecting and Representing Objects Using Holistic Models and Body Parts2014
- Microsoft COCO: Common Objects in Context2014