Novel Videographic-Free Framework for Tracking Anatomical Structures Using Swallowing Accelerometer Signals and Multi-task Transformers
- 3 June 2025
- journal article
- research article
- Published by Springer Nature in Journal of Healthcare Informatics Research
- Vol. 9 (3) , 297-319
Abstract
High-resolution cervical auscultation (HRCA) has emerged as a promising noninvasive method for instrumental swallowing assessment, utilizing accelerometry signals from the patient’s throat during swallowing. Compared to a traditional gold standard assessment technique, such as videofluoroscopic swallowing studies, HRCA offers reduced radiation exposure risks and increased accessibility. While previous studies have demonstrated the potential of machine learning in HRCA-based swallowing kinematics assessment, the accurate tracking of anatomical landmarks has remained a challenge. In this study, we propose a deep learning multi-task model that addresses this limitation by detecting the displacement of multiple anatomical structures during swallowing. By leveraging transformer encoders as sequential models, the proposed model tracks the displacement of the hyoid bone, laryngeal base, and hyolaryngeal approximation (HLA), which is the distance between the center of the hyoid bone and the laryngeal base and plays a crucial role in achieving safe and efficient swallows. For hyoid bone tracking, our model achieved an average relative overlapping (ROP) area exceeding 85%, exceeding the state-of-the-art by more than 30%. Additionally, the proposed model accurately tracks the laryngeal base with an average ROP exceeding 80% and predicts HLA distance in all frames with an average accuracy exceeding 95%, highlighting the transformative potential of our approach in encoding spatial information and the effect of the multi-task learning on tracking correlated structures. Our findings demonstrate significant promise in integrating HRCA into swallowing assessment protocols, marking a substantial advancement towards a noninvasive and comprehensive swallowing assessment method.Keywords
Funding Information
- Eunice Kennedy Shriver National Institute of Child Health and Human Development (R01HD092239)
- Natural Sciences and Engineering Research Council of Canada (RGPIN-2021-02724)
This publication has 45 references indexed in Scilit:
- Automatic Tracking of Hyoid Bone Displacement and Rotation Relative to Cervical Vertebrae in Videofluoroscopic Swallow Studies Using Deep LearningJournal of Imaging Informatics in Medicine, 2024
- Cervical Vertebral Height Approximates Hyoid Displacement in Videofluoroscopic Images of Healthy AdultsDysphagia, 2022
- A Preliminary Investigation of Whether HRCA Signals Can Differentiate Between Swallows from Healthy People and Swallows from People with Neurodegenerative DiseasesDysphagia, 2020
- Tracking Hyoid Bone Displacement During Swallowing Without Videofluoroscopy Using Machine Learning of Vibratory SignalsDysphagia, 2020
- Event Sequence Variability in Healthy Swallowing: Building on Previous FindingsDysphagia, 2014
- Preliminary Investigation of the Effect of Pulse Rate on Judgments of Swallowing Impairment and Treatment RecommendationsDysphagia, 2013
- Baseline Characteristics of Dual-Axis Cervical Accelerometry SignalsAnnals of Biomedical Engineering, 2010
- Radiation Dose in Videofluoroscopic Swallow StudiesDysphagia, 2006
- Structural Displacements in Normal Swallowing: A Videofluoroscopic StudyDysphagia, 2000
- Test-retest variability in normal swallowingDysphagia, 1990