Unveiling Interpretability in Self-Supervised Speech Representations for Parkinson's Diagnosis
Top Cited Papers
Open Access
- 6 February 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Selected Topics in Signal Processing
- Vol. 19 (5) , 717-730
Abstract
Recent works in pathological speech analysis have increasingly relied on powerful self-supervised speech representations, leading to promising results. However, the complex, black-box nature of these embeddings and the limited research on their interpretability significantly restrict their adoption for clinical diagnosis. To address this gap, we propose a novel, interpretable framework specifically designed to support Parkinson's Disease (PD) diagnosis. Through the design of simple yet effective cross-attention mechanisms for both embedding- and temporal-level analysis, the proposed framework offers interpretability from two distinct but complementary perspectives. Experimental findings across five well-established speech benchmarks for PD detection demonstrate the framework's capability to identify meaningful speech patterns within self-supervised representations for a wide range of assessment tasks. Fine-grained temporal analyses further underscore its potential to enhance the interpretability of deep-learning pathological speech models, paving the way for the development of more transparent, trustworthy, and clinically applicable computer-assisted diagnosis systems in this domain. Moreover, in terms of classification accuracy, our method achieves results competitive with state-of-the-art approaches, while also demonstrating robustness in cross-lingual scenarios when applied to spontaneous speech production.Keywords
All Related Versions
This publication has 79 references indexed in Scilit:
- On the Use of a Foundation Acoustic Model to Identify Highly Relevant Phonetic Information of Parkinson’s Speech2024
- Automatic Classification of Parkinson’s Disease Using Wav2vec Embeddings at Phoneme, Syllable, and Word Levels2024
- Reading Between the Frames: Multi-modal Depression Detection in Videos from Non-verbal Cues2024
- Glottal Flow Patterns Analyses for Parkinson’s Disease Detection: Acoustic and Nonlinear Approaches2016
- Laryngeal somatosensory deficits in Parkinson’s disease: implications for speech respiratory and phonatory controlExperimental Brain Research, 2009
- Movement Disorder Society‐sponsored revision of the Unified Parkinson's Disease Rating Scale (MDS‐UPDRS): Scale presentation and clinimetric testing resultsMovement Disorders, 2008
- Speech rate and rhythm in Parkinson's diseaseMovement Disorders, 2008
- Dynamic Time Warping2007
- Movement Disorder Society Task Force report on the Hoehn and Yahr staging scale: Status and recommendations The Movement Disorder Society Task Force on rating scales for Parkinson's diseaseMovement Disorders, 2004
- Interrater reliability of the unified Parkinson's disease rating scale motor examinationMovement Disorders, 1994