Privacy Disclosure of Similarity Rank in Speech and Language Processing
Open Access
- 10 December 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Audio, Speech and Language Processing
- Vol. 34, 196-205
Abstract
Speaker, author, and other biometric identification applications often compare a sample's similarity to a database of templates to determine the identity. Given that data may be noisy and similarity measures can be inaccurate, such a comparison may not reliably identify the true identity as the most similar. Still, even the similarity rank based on an inaccurate similarity measure can disclose private information about the true identity. We propose a methodology for quantifying the privacy disclosure of such a similarity rank by estimating its probability distribution. It is based on either determining the histogram of the similarity rank for the true speaker or, when data are scarce, modeling the histogram with the beta-binomial distribution. We express the disclosure in terms of entropy (bits), such that the disclosure from independent features is additive. Our experiments demonstrate that all tested speaker and author characterizations contain personally identifying information (PII) that can aid in identification, with embeddings from speaker recognition algorithms containing the most information, followed by phone embeddings, linguistic embeddings, and fundamental frequency. Our initial experiments show that the disclosure of PII increases with the length of test samples, but it is bounded by the length of database templates. The provided metric, similarity rank disclosure, provides a way to compare the disclosure of PII between biometric features and merge them to aid identification. It can thus aid in the holistic evaluation of threats to privacy in speech and other biometric technologies.Keywords
All Related Versions
Funding Information
- Designing Inclusive & Trustworthy Digital Public Services for Migrants in Finland (353529)
- Strategic Research Council of Finland
This publication has 36 references indexed in Scilit:
- Privacy in Speech TechnologyProceedings of the IEEE, 2025
- The VoicePrivacy 2022 Challenge: Progress and Perspectives in Voice AnonymisationIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2024
- Fine-Tuning Wav2Vec2 for Speaker Recognition2022
- Speaker recognition based on deep learning: An overviewNeural Networks, 2021
- Speaker identification through artificial intelligence techniques: A comprehensive review and research challengesExpert Systems with Applications, 2021
- Profiling Humans from their Voice2019
- Phonetic posteriorgrams for many-to-one voice conversion without parallel data training2016
- The relation between the secrecy rate of biometric template protection and biometric recognition performance2015
- Librispeech: An ASR corpus based on public domain audio books2015
- Application-independent evaluation of speaker detectionComputer Speech & Language, 2006