UniHCP: A Unified Model for Human-Centric Perceptions
Preprint
Abstract
Human-centric perceptions (e.g., pose estimation, human parsing, pedestrian detection, person re-identification, etc.) play a key role in industrial applications of visual models. While specific human-centric tasks have their own relevant semantic aspect to focus on, they also share the same underlying semantic structure of the human body. However, few works have attempted to exploit such homogeneity and design a general-propose model for human-centric tasks. In this work, we revisit a broad range of human-centric tasks and unify them in a minimalist manner. We propose UniHCP, a Unified Model for Human-Centric Perceptions, which unifies a wide range of human-centric tasks in a simplified end-to-end manner with the plain vision transformer architecture. With large-scale joint training on 33 human-centric datasets, UniHCP can outperform strong baselines on several in-domain and downstream tasks by direct evaluation. When adapted to a specific task, UniHCP achieves new SOTAs on a wide range of human-centric tasks, e.g., 69.8 mIoU on CIHP for human parsing, 86.18 mA on PA-100K for attribute prediction, 90.3 mAP on Market1501 for ReID, and 85.8 JI on CrowdHuman for pedestrian detection, performing better than specialized models tailored for each task.Keywords
All Related Versions
This publication has 26 references indexed in Scilit:
- Mask DINO: Towards A Unified Transformer-based Framework for Object Detection and Segmentation2023
- Poseur: Direct Human Pose Regression with Transformers2022
- Exploring Plain Vision Transformer Backbones for Object Detection2022
- Unifying Visual Perception by Dispersible Points Learning2022
- Fashionformer: A Simple, Effective and Unified Baseline for Human Fashion Segmentation and Recognition2022
- Versatile Multi-Modal Pre-Training for Human-Centric Perception2022
- General Multi-label Image Classification with Transformers2021
- Machine and deep learning for sport-specific movement recognition: a systematic review of model development and performanceJournal of Sports Sciences, 2018
- Multi-label convolutional neural network based pedestrian attribute classificationImage and Vision Computing, 2017
- DeepReID: Deep Filter Pairing Neural Network for Person Re-identification2014