Shai Harel
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Shai Harel has a total of 14 co-authors. Here are the top co-authors by number of shared publications:
- Feng-Ju Chang
Institute for Robotics and Intelligent Systems USC CA USA
1 shared publication - Gerard Medioni
Institute for Robotics and Intelligent Systems USC CA USA
1 shared publication - Iacopo Masi
Department of Computer Science, Sapienza University of Rome, Rome, Italy
1 shared publication - Jatuporn Toy Leksut
University of Southern California, Los Angeles, CA
1 shared publication - Jongmoo Choi
University of Southern California
1 shared publication - Jungyeon Kim
University of Southern California, Los Angeles, CA
1 shared publication
Latest Publications
- 12 January 2018
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 41 (2) , 379-393
Learning Pose-Aware Models for Pose-Invariant Face Recognition in the Wild
We propose a method designed to push the frontiers of unconstrained face recognition in the wild with an emphasis on extreme out-of-plane pose variations. Existing methods either expect a single model to learn pose invariance by training on massive amounts of data or else normalize images by aligning faces to a single frontal pose. Contrary to these, our method is designed to explicitly tackle pose variations. Our proposed Pose-Aware Models (PAM) process a face image using several pose-specific, deep convolutional neural networks (CNN). 3D rendering is used to synthesize multiple face poses from input images to both train these models and to provide additional robustness to pose variations at test time. Our paper presents an extensive analysis on the IJB-A benchmark, evaluating the effects that landmark detection accuracy, CNN layer selection, and pose model selection all have on the performance of the recognition pipeline. It further provides comparative evaluations on the IARPA Janus Benchmarks A (IJB-A) and the PIPA dataset. These tests show that our approach outperforms existing methods, even surprisingly matching the accuracy of methods that were specifically fine-tuned to the target dataset. Parts of this work previously appeared in [1] and [2].
- 12 January 2018
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 41 (2) , 379-393
Learning Pose-Aware Models for Pose-Invariant Face Recognition in the Wild
We propose a method designed to push the frontiers of unconstrained face recognition in the wild with an emphasis on extreme out-of-plane pose variations. Existing methods either expect a single model to learn pose invariance by training on massive amounts of data or else normalize images by aligning faces to a single frontal pose. Contrary to these, our method is designed to explicitly tackle pose variations. Our proposed Pose-Aware Models (PAM) process a face image using several pose-specific, deep convolutional neural networks (CNN). 3D rendering is used to synthesize multiple face poses from input images to both train these models and to provide additional robustness to pose variations at test time. Our paper presents an extensive analysis on the IJB-A benchmark, evaluating the effects that landmark detection accuracy, CNN layer selection, and pose model selection all have on the performance of the recognition pipeline. It further provides comparative evaluations on the IARPA Janus Benchmarks A (IJB-A) and the PIPA dataset. These tests show that our approach outperforms existing methods, even surprisingly matching the accuracy of methods that were specifically fine-tuned to the target dataset. Parts of this work previously appeared in [1] and [2].