Automatic vocal tract landmark localization from midsagittal MRI data
Open Access
- 30 January 2020
- journal article
- research article
- Published by Springer Nature in Scientific Reports
- Vol. 10 (1) , 1-13
Abstract
The various speech sounds of a language are obtained by varying the shape and position of the articulators surrounding the vocal tract. Analyzing their variations is crucial for understanding speech production, diagnosing speech disorders and planning therapy. Identifying key anatomical landmarks of these structures on medical images is a pre-requisite for any quantitative analysis and the rising amount of data generated in the field calls for an automatic solution. The challenge lies in the high inter- and intra-speaker variability, the mutual interaction between the articulators and the moderate quality of the images. This study addresses this issue for the first time and tackles it by means of Deep Learning. It proposes a dedicated network architecture named Flat-net and its performance are evaluated and compared with eleven state-of-the-art methods from the literature. The dataset contains midsagittal anatomical Magnetic Resonance Images for 9 speakers sustaining 62 articulations with 21 annotated anatomical landmarks per image. Results show that the Flat-net approach outperforms the former methods, leading to an overall Root Mean Square Error of 3.6 pixels/0.36 cm obtained in a leave-one-out procedure over the speakers. The implementation codes are also shared publicly on GitHub.Keywords
All Related Versions
Funding Information
- This research project is supported by the START-Program of the Faculty of Medicine, RWTH Aachen. The data component of this work has been partially funded by the French ANR
This publication has 47 references indexed in Scilit:
- Computerized Tomography Measures During and After Artificial Lengthening of the Vocal Tract in Subjects With Voice DisordersJournal of Voice, 2017
- Flowing ConvNets for Human Pose Estimation in Videos2015
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Landmark Detection for Fusion of Fundus and MRI Toward a Patient-Specific Multimodal Eye ModelIEEE Transactions on Biomedical Engineering, 2014
- Robust image registration of biological microscopic imagesScientific Reports, 2014
- EXPLOITING 3D ULTRASOUND FOR FETAL DIAGNOSTIC PURPOSE THROUGH FACIAL LANDMARKINGImage Analysis and Stereology, 2014
- One millisecond face alignment with an ensemble of regression trees2014
- 300 Faces in-the-Wild Challenge: The First Facial Landmark Localization Challenge2013
- A method of tooth superimposition on MRI data for accurate measurement of vocal tract shape and dimensionsAcoustical Science and Technology, 2004
- Factor analysis of tongue shapesThe Journal of the Acoustical Society of America, 1977