Tatheer Hussain Mir
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Tatheer Hussain Mir has a total of 47 co-authors. Here are the top co-authors by number of shared publications:
- Hong-Jie Dai
National Kaohsiung University of Science and Technology
6 shared publications - Ching-Tai Chen
Machine Learning and Bioinformatics Lab, Department of Computer Science, University of Taipei, Taipei, Taiwan
4 shared publications - Jitendra Jonnagaddala
School of Population Health, Faculty of Medicine and Health, UNSW Sydney, Kensington, NSW, Australia
4 shared publications - Hsieh-Chih Hsu
Intelligent System Laboratory, Department of Electrical Engineering, College of Electrical Engineering and Computer Science, National Kaohsiung University of Science and Technology, Kaohsiung, Taiwan
3 shared publications - Omkar Panchal
CGD Health Pvt. Ltd
3 shared publications - Pin-Zhen Chen
Department of Bioinformatics and Medical Engineering, Asia University, Taichung, Taiwan
3 shared publications
Latest Publications
- Open Access
- 27 October 2026
- Published by BMJ in BMJ Health & Care Informatics
- Vol. 33 (1) , e102158
Development of a clinical speech corpus with temporally aligned sensitive health information annotations
- 27 October 2026
- Published by BMJ in BMJ Health & Care Informatics
- Vol. 33 (1) , e102158
Open AccessDevelopment of a clinical speech corpus with temporally aligned sensitive health information annotations
- Top Cited PapersOpen Access
Benchmarking Recording-Level Clinical Speech De-identification for Privacy-Preserving Clinical Audio
Transcript-based de-identification protects textual records but leaves sensitive health information (SHI) directly audible in source recordings, limiting trustworthy reuse of clinical audio. However, standardized evaluations of recording-level SHI detection remain limited. We established the SREDH-AICUP 2025 benchmark to evaluate recording-level SHI detection systems and characterize the approaches. All 22 qualifying systems combined automatic speech recognition with downstream SHI detection, whereas we additionally evaluated end-to-end detection from audio. Pipeline baselines outperformed the end-to-end baseline in transcription (MER, 0.123 vs 0.155) and SHI detection (macro-F1, 0.507-0.653 vs 0.422). Synthetic Mandarin speech-text augmentation enabled the end-to-end model to detect Mandarin SHI that was not identified without augmentation (macro-F1, 0.171 vs 0). Foundation models showed category-specific differences in SHI recognition, and type-aware adaptive routing improved macro-F1 from 0.656 to 0.697. These findings establish standardized reference performance, characterize current system designs, and demonstrate how language-specific augmentation and category-aware model integration can improve recording-level SHI detection.
Top Cited PapersOpen AccessBenchmarking Recording-Level Clinical Speech De-identification for Privacy-Preserving Clinical Audio
Transcript-based de-identification protects textual records but leaves sensitive health information (SHI) directly audible in source recordings, limiting trustworthy reuse of clinical audio. However, standardized evaluations of recording-level SHI detection remain limited. We established the SREDH-AICUP 2025 benchmark to evaluate recording-level SHI detection systems and characterize the approaches. All 22 qualifying systems combined automatic speech recognition with downstream SHI detection, whereas we additionally evaluated end-to-end detection from audio. Pipeline baselines outperformed the end-to-end baseline in transcription (MER, 0.123 vs 0.155) and SHI detection (macro-F1, 0.507-0.653 vs 0.422). Synthetic Mandarin speech-text augmentation enabled the end-to-end model to detect Mandarin SHI that was not identified without augmentation (macro-F1, 0.171 vs 0). Foundation models showed category-specific differences in SHI recognition, and type-aware adaptive routing improved macro-F1 from 0.656 to 0.697. These findings establish standardized reference performance, characterize current system designs, and demonstrate how language-specific augmentation and category-aware model integration can improve recording-level SHI detection.
- Open Access
Development of a Clinical Speech Corpus with Temporally Aligned Sensitive Health Information Annotations
Objectives: Publicly available datasets for clinical speech de-identification remain scarce due to privacy constraints and annotation complexity. We address this gap with the 2025 SREDH/AI Cup SHI Speech Corpus, a time-aligned clinical speech dataset for detecting sensitive health information (SHI). Methods: The dataset integrates three sources: the OpenDeID-v2 corpus, the dataset for automated medical transcription and medical dialogues derived from Taiwanese television dramas, combining English medical speech with Mandarin Chinese utterances. All audio was manually annotated with millisecond-level, time-aligned SHI segments using a schema of eight primary categories and 38 subcategories of which 26 were attested. Results: The corpus comprises approximately 20 hours of annotated audio (19.36 hours English, 0.89 hours Chinese) and 7830 SHI entities, split into training (10 hours, 1539 files), validation (5 hours, 775 files) and test (5 hours, 710 files) sets, supporting evaluation of both automatic speech recognition (ASR) and SHI recognition. Interannotator agreement (Fleiss’s kappa) reached 0.907. In the 2025 SREDH/AI Cup competition, top-performing systems achieved a mixed error rate of 0.1147 in ASR and a macro F1 of 0.7103 in SHI recognition. Discussion: SHI category distribution is long-tailed, and English–Chinese data volume is highly imbalanced, underscoring the scarcity of Chinese clinical speech resources and the difficulty of time-aligned annotation in low-resource settings. Conclusion: This corpus approximates dialogue-based clinical scenarios and supports research on medical speech de-identification, offering a unique reference for low-resource clinical speech privacy protection. Key message: What is already known on this topic: - Publicly available clinical speech datasets containing time-aligned sensitive health information (SHI) annotations for clinical speech de-identification research are limited. What this study adds: - The 2025 SREDH AI Cup SHI Speech Corpus introduces a clinically oriented speech dataset with millisecond-level time-aligned SHI annotations covering 26 of the 38 SHI subcategories defined in the annotation schema. - The corpus integrates structured annotation protocols and standardized data processing to support the reproducible benchmarking of speech-based de-identification models. How this study might affect research, practice or policy: - The availability of time-aligned SHI annotations may facilitate research on real-time or streaming de-identification systems beyond conventional, transcription-focused approaches. - This dataset may support the development of privacy-preserving technologies for clinical speech in bilingual settings involving English and low-resource languages.
Open AccessDevelopment of a Clinical Speech Corpus with Temporally Aligned Sensitive Health Information Annotations
Objectives: Publicly available datasets for clinical speech de-identification remain scarce due to privacy constraints and annotation complexity. We address this gap with the 2025 SREDH/AI Cup SHI Speech Corpus, a time-aligned clinical speech dataset for detecting sensitive health information (SHI). Methods: The dataset integrates three sources: the OpenDeID-v2 corpus, the dataset for automated medical transcription and medical dialogues derived from Taiwanese television dramas, combining English medical speech with Mandarin Chinese utterances. All audio was manually annotated with millisecond-level, time-aligned SHI segments using a schema of eight primary categories and 38 subcategories of which 26 were attested. Results: The corpus comprises approximately 20 hours of annotated audio (19.36 hours English, 0.89 hours Chinese) and 7830 SHI entities, split into training (10 hours, 1539 files), validation (5 hours, 775 files) and test (5 hours, 710 files) sets, supporting evaluation of both automatic speech recognition (ASR) and SHI recognition. Interannotator agreement (Fleiss’s kappa) reached 0.907. In the 2025 SREDH/AI Cup competition, top-performing systems achieved a mixed error rate of 0.1147 in ASR and a macro F1 of 0.7103 in SHI recognition. Discussion: SHI category distribution is long-tailed, and English–Chinese data volume is highly imbalanced, underscoring the scarcity of Chinese clinical speech resources and the difficulty of time-aligned annotation in low-resource settings. Conclusion: This corpus approximates dialogue-based clinical scenarios and supports research on medical speech de-identification, offering a unique reference for low-resource clinical speech privacy protection. Key message: What is already known on this topic: - Publicly available clinical speech datasets containing time-aligned sensitive health information (SHI) annotations for clinical speech de-identification research are limited. What this study adds: - The 2025 SREDH AI Cup SHI Speech Corpus introduces a clinically oriented speech dataset with millisecond-level time-aligned SHI annotations covering 26 of the 38 SHI subcategories defined in the annotation schema. - The corpus integrates structured annotation protocols and standardized data processing to support the reproducible benchmarking of speech-based de-identification models. How this study might affect research, practice or policy: - The availability of time-aligned SHI annotations may facilitate research on real-time or streaming de-identification systems beyond conventional, transcription-focused approaches. - This dataset may support the development of privacy-preserving technologies for clinical speech in bilingual settings involving English and low-resource languages.
- Top Cited PapersOpen Access
- 26 March 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 13, 54040-54068
EFFResNet-ViT: A Fusion-Based Convolutional and Vision Transformer Model for Explainable Medical Image Classification
The rapid advancement of medical imaging technologies requires the development of advanced, automated, and interpretable diagnostic tools for clinical decision-making. Although convolutional neural networks (CNNs) have shown significant promise in medical image analysis, they have limitations in capturing the global context and lack interpretability, thereby hindering their clinical adoption. This study presents EFFResNet-ViT, a novel hybrid deep learning (DL) model designed to address these challenges by combining EfficientNet-B0 and ResNet-50 CNN backbones with a vision transformer (ViT) module. The proposed architecture employs a feature fusion strategy to integrate the local feature extraction strengths of CNNs with the global dependency modeling capabilities of transformers. The extracted features are further refined through a post-transformer CNN and a global average pooling layer to enhance the classification performance. To improve interpretability, EFFResNet-ViT incorporates Grad-CAM visualization techniques to highlight regions contributing to classification decisions and employs t-distributed stochastic neighbor embedding for feature space analysis, providing insights into class separability. The proposed model was evaluated on two benchmark datasets: brain tumor (BT) CE-MRI for brain tumor classification and a retinal image dataset for ophthalmological diagnosis. EFFResNet-ViT achieved state-of-the-art performance, with accuracies of 99.31% and 92.54% on the BT CE-MRI and retinal datasets, respectively. Comparative analyses demonstrate the superior classification performance and interpretability of EFFResNet-ViT over existingViT and CNN-based hybrid models. The explainable design of EFFResNet-ViT addresses the critical need for transparency in artificial intelligence-driven medical diagnostics, facilitating its potential integration into clinical workflows to improve decision-making and patient outcomes.
- 26 March 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 13, 54040-54068
Top Cited PapersOpen AccessEFFResNet-ViT: A Fusion-Based Convolutional and Vision Transformer Model for Explainable Medical Image Classification
The rapid advancement of medical imaging technologies requires the development of advanced, automated, and interpretable diagnostic tools for clinical decision-making. Although convolutional neural networks (CNNs) have shown significant promise in medical image analysis, they have limitations in capturing the global context and lack interpretability, thereby hindering their clinical adoption. This study presents EFFResNet-ViT, a novel hybrid deep learning (DL) model designed to address these challenges by combining EfficientNet-B0 and ResNet-50 CNN backbones with a vision transformer (ViT) module. The proposed architecture employs a feature fusion strategy to integrate the local feature extraction strengths of CNNs with the global dependency modeling capabilities of transformers. The extracted features are further refined through a post-transformer CNN and a global average pooling layer to enhance the classification performance. To improve interpretability, EFFResNet-ViT incorporates Grad-CAM visualization techniques to highlight regions contributing to classification decisions and employs t-distributed stochastic neighbor embedding for feature space analysis, providing insights into class separability. The proposed model was evaluated on two benchmark datasets: brain tumor (BT) CE-MRI for brain tumor classification and a retinal image dataset for ophthalmological diagnosis. EFFResNet-ViT achieved state-of-the-art performance, with accuracies of 99.31% and 92.54% on the BT CE-MRI and retinal datasets, respectively. Comparative analyses demonstrate the superior classification performance and interpretability of EFFResNet-ViT over existingViT and CNN-based hybrid models. The explainable design of EFFResNet-ViT addresses the critical need for transparency in artificial intelligence-driven medical diagnostics, facilitating its potential integration into clinical workflows to improve decision-making and patient outcomes.
- Open Access
- 20 September 2024
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 26 (1) , e58278
Evaluating a Natural Language Processing–Driven, AI-Assisted International Classification of Diseases, 10th Revision, Clinical Modification, Coding System for Diagnosis Related Groups in a Real Hospital Environment: Algorithm Development and Validation Study
Background: International Classification of Diseases codes are widely used to describe diagnosis information, but manual coding relies heavily on human interpretation, which can be expensive, time consuming, and prone to errors. With the transition from the International Classification of Diseases, Ninth Revision, to the International Classification of Diseases, Tenth Revision (ICD-10), the coding process has become more complex, highlighting the need for automated approaches to enhance coding efficiency and accuracy. Inaccurate coding can result in substantial financial losses for hospitals, and a precise assessment of outcomes generated by a natural language processing (NLP)–driven autocoding system thus assumes a critical role in safeguarding the accuracy of the Taiwan diagnosis related groups (Tw-DRGs). Objective: This study aims to evaluate the feasibility of applying an International Classification of Diseases, Tenth Revision, Clinical Modification (ICD-10-CM), autocoding system that can automatically determine diagnoses and codes based on free-text discharge summaries to facilitate the assessment of Tw-DRGs, specifically principal diagnosis and major diagnostic categories (MDCs). Methods: By using the patient discharge summaries from Kaohsiung Medical University Chung-Ho Memorial Hospital (KMUCHH) from April 2019 to December 2020 as a reference data set we developed artificial intelligence (AI)–assisted ICD-10-CM coding systems based on deep learning models. We constructed a web-based user interface for the AI-assisted coding system and deployed the system to the workflow of the certified coding specialists (CCSs) of KMUCHH. The data used for the assessment of Tw-DRGs were manually curated by a CCS with the principal diagnosis and MDC was determined from discharge summaries collected at KMUCHH from February 2023 to April 2023. Results: Both the reference data set and real hospital data were used to assess performance in determining ICD-10-CM coding, principal diagnosis, and MDC for Tw-DRGs. Among all methods, the GPT-2 (OpenAI)-based model achieved the highest F1-score, 0.667 (F1-score 0.851 for the top 50 codes), on the KMUCHH test set and a slightly lower F1-score, 0.621, in real hospital data. Cohen κ evaluation for the agreement of MDC between the models and the CCS revealed that the overall average κ value for GPT-2 (κ=0.714) was approximately 12.2 percentage points higher than that of the hierarchy attention network (κ=0.592). GPT-2 demonstrated superior agreement with the CCS across 6 categories of MDC, with an average κ value of approximately 0.869 (SD 0.033), underscoring the effectiveness of the developed AI-assisted coding system in supporting the work of CCSs. Conclusions: An NLP-driven AI-assisted coding system can assist CCSs in ICD-10-CM coding by offering coding references via a user interface, demonstrating the potential to reduce the manual workload and expedite Tw-DRG assessment. Consistency in performance affirmed the effectiveness of the system in supporting CCSs in ICD-10-CM coding and the judgment of Tw-DRGs.
- 20 September 2024
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 26 (1) , e58278
Open AccessEvaluating a Natural Language Processing–Driven, AI-Assisted International Classification of Diseases, 10th Revision, Clinical Modification, Coding System for Diagnosis Related Groups in a Real Hospital Environment: Algorithm Development and Validation Study
Background: International Classification of Diseases codes are widely used to describe diagnosis information, but manual coding relies heavily on human interpretation, which can be expensive, time consuming, and prone to errors. With the transition from the International Classification of Diseases, Ninth Revision, to the International Classification of Diseases, Tenth Revision (ICD-10), the coding process has become more complex, highlighting the need for automated approaches to enhance coding efficiency and accuracy. Inaccurate coding can result in substantial financial losses for hospitals, and a precise assessment of outcomes generated by a natural language processing (NLP)–driven autocoding system thus assumes a critical role in safeguarding the accuracy of the Taiwan diagnosis related groups (Tw-DRGs). Objective: This study aims to evaluate the feasibility of applying an International Classification of Diseases, Tenth Revision, Clinical Modification (ICD-10-CM), autocoding system that can automatically determine diagnoses and codes based on free-text discharge summaries to facilitate the assessment of Tw-DRGs, specifically principal diagnosis and major diagnostic categories (MDCs). Methods: By using the patient discharge summaries from Kaohsiung Medical University Chung-Ho Memorial Hospital (KMUCHH) from April 2019 to December 2020 as a reference data set we developed artificial intelligence (AI)–assisted ICD-10-CM coding systems based on deep learning models. We constructed a web-based user interface for the AI-assisted coding system and deployed the system to the workflow of the certified coding specialists (CCSs) of KMUCHH. The data used for the assessment of Tw-DRGs were manually curated by a CCS with the principal diagnosis and MDC was determined from discharge summaries collected at KMUCHH from February 2023 to April 2023. Results: Both the reference data set and real hospital data were used to assess performance in determining ICD-10-CM coding, principal diagnosis, and MDC for Tw-DRGs. Among all methods, the GPT-2 (OpenAI)-based model achieved the highest F1-score, 0.667 (F1-score 0.851 for the top 50 codes), on the KMUCHH test set and a slightly lower F1-score, 0.621, in real hospital data. Cohen κ evaluation for the agreement of MDC between the models and the CCS revealed that the overall average κ value for GPT-2 (κ=0.714) was approximately 12.2 percentage points higher than that of the hierarchy attention network (κ=0.592). GPT-2 demonstrated superior agreement with the CCS across 6 categories of MDC, with an average κ value of approximately 0.869 (SD 0.033), underscoring the effectiveness of the developed AI-assisted coding system in supporting the work of CCSs. Conclusions: An NLP-driven AI-assisted coding system can assist CCSs in ICD-10-CM coding by offering coding references via a user interface, demonstrating the potential to reduce the manual workload and expedite Tw-DRG assessment. Consistency in performance affirmed the effectiveness of the system in supporting CCSs in ICD-10-CM coding and the judgment of Tw-DRGs.
- Open Access
- 13 March 2024
- Published by JMIR Publications Inc. in JMIR Preprints
Evaluating a Natural Language Processing–Driven, AI-Assisted International Classification of Diseases, 10th Revision, Clinical Modification, Coding System for Diagnosis Related Groups in a Real Hospital Environment: Algorithm Development and Validation Study (Preprint)
BACKGROUND International Classification of Diseases codes are widely used to describe diagnosis information, but manual coding relies heavily on human interpretation, which can be expensive, time consuming, and prone to errors. With the transition from the International Classification of Diseases, Ninth Revision, to the International Classification of Diseases, Tenth Revision (ICD-10), the coding process has become more complex, highlighting the need for automated approaches to enhance coding efficiency and accuracy. Inaccurate coding can result in substantial financial losses for hospitals, and a precise assessment of outcomes generated by a natural language processing (NLP)–driven autocoding system thus assumes a critical role in safeguarding the accuracy of the Taiwan diagnosis related groups (Tw-DRGs). OBJECTIVE This study aims to evaluate the feasibility of applying an International Classification of Diseases, Tenth Revision, Clinical Modification (ICD-10-CM), autocoding system that can automatically determine diagnoses and codes based on free-text discharge summaries to facilitate the assessment of Tw-DRGs, specifically principal diagnosis and major diagnostic categories (MDCs). METHODS By using the patient discharge summaries from Kaohsiung Medical University Chung-Ho Memorial Hospital (KMUCHH) from April 2019 to December 2020 as a reference data set we developed artificial intelligence (AI)–assisted ICD-10-CM coding systems based on deep learning models. We constructed a web-based user interface for the AI-assisted coding system and deployed the system to the workflow of the certified coding specialists (CCSs) of KMUCHH. The data used for the assessment of Tw-DRGs were manually curated by a CCS with the principal diagnosis and MDC was determined from discharge summaries collected at KMUCHH from February 2023 to April 2023. RESULTS Both the reference data set and real hospital data were used to assess performance in determining ICD-10-CM coding, principal diagnosis, and MDC for Tw-DRGs. Among all methods, the GPT-2 (OpenAI)-based model achieved the highest F1-score, 0.667 (F1-score 0.851 for the top 50 codes), on the KMUCHH test set and a slightly lower F1-score, 0.621, in real hospital data. Cohen κ evaluation for the agreement of MDC between the models and the CCS revealed that the overall average κ value for GPT-2 (κ=0.714) was approximately 12.2 percentage points higher than that of the hierarchy attention network (κ=0.592). GPT-2 demonstrated superior agreement with the CCS across 6 categories of MDC, with an average κ value of approximately 0.869 (SD 0.033), underscoring the effectiveness of the developed AI-assisted coding system in supporting the work of CCSs. CONCLUSIONS An NLP-driven AI-assisted coding system can assist CCSs in ICD-10-CM coding by offering coding references via a user interface, demonstrating the potential to reduce the manual workload and expedite Tw-DRG assessment. Consistency in performance affirmed the effectiveness of the system in supporting CCSs in ICD-10-CM coding and the judgment of Tw-DRGs.
- 13 March 2024
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessEvaluating a Natural Language Processing–Driven, AI-Assisted International Classification of Diseases, 10th Revision, Clinical Modification, Coding System for Diagnosis Related Groups in a Real Hospital Environment: Algorithm Development and Validation Study (Preprint)
BACKGROUND International Classification of Diseases codes are widely used to describe diagnosis information, but manual coding relies heavily on human interpretation, which can be expensive, time consuming, and prone to errors. With the transition from the International Classification of Diseases, Ninth Revision, to the International Classification of Diseases, Tenth Revision (ICD-10), the coding process has become more complex, highlighting the need for automated approaches to enhance coding efficiency and accuracy. Inaccurate coding can result in substantial financial losses for hospitals, and a precise assessment of outcomes generated by a natural language processing (NLP)–driven autocoding system thus assumes a critical role in safeguarding the accuracy of the Taiwan diagnosis related groups (Tw-DRGs). OBJECTIVE This study aims to evaluate the feasibility of applying an International Classification of Diseases, Tenth Revision, Clinical Modification (ICD-10-CM), autocoding system that can automatically determine diagnoses and codes based on free-text discharge summaries to facilitate the assessment of Tw-DRGs, specifically principal diagnosis and major diagnostic categories (MDCs). METHODS By using the patient discharge summaries from Kaohsiung Medical University Chung-Ho Memorial Hospital (KMUCHH) from April 2019 to December 2020 as a reference data set we developed artificial intelligence (AI)–assisted ICD-10-CM coding systems based on deep learning models. We constructed a web-based user interface for the AI-assisted coding system and deployed the system to the workflow of the certified coding specialists (CCSs) of KMUCHH. The data used for the assessment of Tw-DRGs were manually curated by a CCS with the principal diagnosis and MDC was determined from discharge summaries collected at KMUCHH from February 2023 to April 2023. RESULTS Both the reference data set and real hospital data were used to assess performance in determining ICD-10-CM coding, principal diagnosis, and MDC for Tw-DRGs. Among all methods, the GPT-2 (OpenAI)-based model achieved the highest F1-score, 0.667 (F1-score 0.851 for the top 50 codes), on the KMUCHH test set and a slightly lower F1-score, 0.621, in real hospital data. Cohen κ evaluation for the agreement of MDC between the models and the CCS revealed that the overall average κ value for GPT-2 (κ=0.714) was approximately 12.2 percentage points higher than that of the hierarchy attention network (κ=0.592). GPT-2 demonstrated superior agreement with the CCS across 6 categories of MDC, with an average κ value of approximately 0.869 (SD 0.033), underscoring the effectiveness of the developed AI-assisted coding system in supporting the work of CCSs. CONCLUSIONS An NLP-driven AI-assisted coding system can assist CCSs in ICD-10-CM coding by offering coding references via a user interface, demonstrating the potential to reduce the manual workload and expedite Tw-DRG assessment. Consistency in performance affirmed the effectiveness of the system in supporting CCSs in ICD-10-CM coding and the judgment of Tw-DRGs.