UltraUNet: Real-Time Ultrasound Tongue Segmentation for Diverse Linguistic and Imaging Conditions
Preprint
Abstract
Ultrasound tongue imaging (UTI) is a non-invasive and cost-effective tool for studying speech articulation, motor control, and related disorders. However, real-time tongue contour segmentation remains challenging due to low signal-to-noise ratios, imaging variability, and computational demands. We propose UltraUNet, a lightweight encoder-decoder architecture optimized for real-time segmentation of tongue contours in ultrasound images. UltraUNet incorporates domain-specific innovations such as lightweight Squeeze-and-Excitation blocks, Group Normalization for small-batch stability, and summation-based skip connections to reduce memory and computational overhead. It achieves 250 frames per second and integrates ultrasound-specific augmentations like denoising and blur simulation. Evaluations on 8 datasets demonstrate high accuracy and robustness, with single-dataset Dice = 0.855 and MSD = 0.993px, and cross-dataset Dice averaging 0.734 and 0.761. UltraUNet provides a fast, accurate solution for speech research, clinical diagnostics, and analysis of speech motor disorders.Keywords
All Related Versions
This publication has 20 references indexed in Scilit:
- USE-Net: Incorporating Squeeze-and-Excitation blocks into U-Net for prostate zonal segmentation of multi-institutional MRI datasetsNeurocomputing, 2019
- Fully-automated tongue detection in ultrasound imagesComputers in Biology and Medicine, 2019
- Multi-hypothesis tracking of the tongue surface in ultrasound video recordings of normal and impaired speechMedical Image Analysis, 2018
- DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image SegmentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- Ultrasound as visual feedback in speech habilitation: Exploring consultative use in rural British Columbia, CanadaClinical Linguistics & Phonetics, 2008
- Automatic contour tracking in ultrasound imagesClinical Linguistics & Phonetics, 2005
- Ultrasound in speech therapy with adolescents and adultsClinical Linguistics & Phonetics, 2005
- A guide to analysing tongue motion from ultrasound imagesClinical Linguistics & Phonetics, 2005
- Principal component analysis of cross sections of tongue shapes in vowel productionSpeech Communication, 1997