Local Directional Ternary Pattern for Facial Expression Recognition

Authors:
Publisher website
Google Scholar
Abstract
This paper presents a new face descriptor, local directional ternary pattern (LDTP), for facial expression recognition. LDTP efficiently encodes information of emotion-related features (ı.e., eyes, eyebrows, upper nose, and mouth) by using the directional information and ternary pattern in order to take advantage of the robustness of edge patterns in the edge region while overcoming weaknesses of edge-based methods in smooth regions. Our proposal, unlike existing histogram-based face description methods that divide the face into several regions and sample the codes uniformly, uses a two-level grid to construct the face descriptor while sampling expression-related information at different scales. We use a coarse grid for stable codes (highly related to non-expression), and a finer one for active codes (highly related to expression). This multi-level approach enables us to do a finer grain description of facial motions while still characterizing the coarse features of the expression. Moreover, we learn the active LDTP codes from the emotion-related facial regions. We tested our method by using person-dependent and independent cross-validation schemes to evaluate the performance. We show that our approaches improve the overall accuracy of facial expression recognition on six data sets.
Funding Information
  • National Research Foundation of Korea Grant through the Korean Government [Ministry of Science, ICT and Future Planning (MSIP)] (NRF-2015R1A2A2A01006412)
  • MSIP, South Korea, under the Grand Information Technology Research Center Support Program supervised by the Institute for Information & communications Technology Promotion (IITP) (IITP-2017-2015-0-00742)

This publication has 54 references indexed in Scilit: