An Shao
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Research Interests
An Shao has a total of 14 co-authors. Here are the top co-authors by number of shared publications:
- Jiageng Wu
Zhejiang University
2 shared publications - Jie Yang
Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine, Brigham and Women’s Hospital, Boston, MA, USA
2 shared publications - Juan Ye
Zhejiang University, Eye Center of Second Affiliated Hospital, School of Medicine, China. Zhejiang Provincial Key Laboratory of Ophthalmology. Zhejiang Provincial Clinical Research Center for Eye Diseases. Zhejiang Provincial Engineering Institute on Eye Diseases, Hangzhou, China
2 shared publications - Kai Jin
Eye Center of Second Affiliated Hospital, School of Medicine Zhejiang University Hangzhou China
2 shared publications Panpan Ye
Eye Center, The Second Affiliated Hospital, Zhejiang University, Zhejiang, China
2 shared publications- Wenyue Shen
Organization=Zhejiang University, Eye Center of Second Affiliated Hospital, School of Medicine; Zhejiang Provincial Key Laboratory of Ophthalmology; Zhejiang Provincial Clinical Research Center for Eye Diseases; Zhejiang Provincial Engineering Institute on Eye Diseases, city=Hangzhou, country=China
2 shared publications
Latest Publications
- Top Cited PapersOpen Access
- 22 January 2024
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 26, e51926
Uncovering Language Disparity of ChatGPT on Retinal Vascular Disease Classification: Cross-Sectional Study
Background: Benefiting from rich knowledge and the exceptional ability to understand text, large language models like ChatGPT have shown great potential in English clinical environments. However, the performance of ChatGPT in non-English clinical settings, as well as its reasoning, have not been explored in depth. Objective: This study aimed to evaluate ChatGPT’s diagnostic performance and inference abilities for retinal vascular diseases in a non-English clinical environment. Methods: In this cross-sectional study, we collected 1226 fundus fluorescein angiography reports and corresponding diagnoses written in Chinese and tested ChatGPT with 4 prompting strategies (direct diagnosis or diagnosis with a step-by-step reasoning process and in Chinese or English). Results: Compared with ChatGPT using Chinese prompts for direct diagnosis that achieved an F1-score of 70.47%, ChatGPT using English prompts for direct diagnosis achieved the best diagnostic performance (80.05%), which was inferior to ophthalmologists (89.35%) but close to ophthalmologist interns (82.69%). As for its inference abilities, although ChatGPT can derive a reasoning process with a low error rate (0.4 per report) for both Chinese and English prompts, ophthalmologists identified that the latter brought more reasoning steps with less incompleteness (44.31%), misinformation (1.96%), and hallucinations (0.59%) (all P<.001). Also, analysis of the robustness of ChatGPT with different language prompts indicated significant differences in the recall (P=.03) and F1-score (P=.04) between Chinese and English prompts. In short, when prompted in English, ChatGPT exhibited enhanced diagnostic and inference capabilities for retinal vascular disease classification based on Chinese fundus fluorescein angiography reports. Conclusions: ChatGPT can serve as a helpful medical assistant to provide diagnosis in non-English clinical environments, but there are still performance gaps, language disparities, and errors compared to professionals, which demonstrate the potential limitations and the need to continually explore more robust large language models in ophthalmology practice.
- 22 January 2024
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 26, e51926
Top Cited PapersOpen AccessUncovering Language Disparity of ChatGPT on Retinal Vascular Disease Classification: Cross-Sectional Study
Background: Benefiting from rich knowledge and the exceptional ability to understand text, large language models like ChatGPT have shown great potential in English clinical environments. However, the performance of ChatGPT in non-English clinical settings, as well as its reasoning, have not been explored in depth. Objective: This study aimed to evaluate ChatGPT’s diagnostic performance and inference abilities for retinal vascular diseases in a non-English clinical environment. Methods: In this cross-sectional study, we collected 1226 fundus fluorescein angiography reports and corresponding diagnoses written in Chinese and tested ChatGPT with 4 prompting strategies (direct diagnosis or diagnosis with a step-by-step reasoning process and in Chinese or English). Results: Compared with ChatGPT using Chinese prompts for direct diagnosis that achieved an F1-score of 70.47%, ChatGPT using English prompts for direct diagnosis achieved the best diagnostic performance (80.05%), which was inferior to ophthalmologists (89.35%) but close to ophthalmologist interns (82.69%). As for its inference abilities, although ChatGPT can derive a reasoning process with a low error rate (0.4 per report) for both Chinese and English prompts, ophthalmologists identified that the latter brought more reasoning steps with less incompleteness (44.31%), misinformation (1.96%), and hallucinations (0.59%) (all P<.001). Also, analysis of the robustness of ChatGPT with different language prompts indicated significant differences in the recall (P=.03) and F1-score (P=.04) between Chinese and English prompts. In short, when prompted in English, ChatGPT exhibited enhanced diagnostic and inference capabilities for retinal vascular disease classification based on Chinese fundus fluorescein angiography reports. Conclusions: ChatGPT can serve as a helpful medical assistant to provide diagnosis in non-English clinical environments, but there are still performance gaps, language disparities, and errors compared to professionals, which demonstrate the potential limitations and the need to continually explore more robust large language models in ophthalmology practice.
- Open Access
- 17 August 2023
- Published by JMIR Publications Inc. in JMIR Preprints
Uncovering Language Disparity of ChatGPT on Retinal Vascular Disease Classification: Cross-Sectional Study (Preprint)
BACKGROUND Benefiting from rich knowledge and the exceptional ability to understand text, large language models like ChatGPT have shown great potential in English clinical environments. However, the performance of ChatGPT in non-English clinical settings, as well as its reasoning, have not been explored in depth. OBJECTIVE This study aimed to evaluate ChatGPT’s diagnostic performance and inference abilities for retinal vascular diseases in a non-English clinical environment. METHODS In this cross-sectional study, we collected 1226 fundus fluorescein angiography reports and corresponding diagnoses written in Chinese and tested ChatGPT with 4 prompting strategies (direct diagnosis or diagnosis with a step-by-step reasoning process and in Chinese or English). RESULTS Compared with ChatGPT using Chinese prompts for direct diagnosis that achieved an F1-score of 70.47%, ChatGPT using English prompts for direct diagnosis achieved the best diagnostic performance (80.05%), which was inferior to ophthalmologists (89.35%) but close to ophthalmologist interns (82.69%). As for its inference abilities, although ChatGPT can derive a reasoning process with a low error rate (0.4 per report) for both Chinese and English prompts, ophthalmologists identified that the latter brought more reasoning steps with less incompleteness (44.31%), misinformation (1.96%), and hallucinations (0.59%) (all P<.001). Also, analysis of the robustness of ChatGPT with different language prompts indicated significant differences in the recall (P=.03) and F1-score (P=.04) between Chinese and English prompts. In short, when prompted in English, ChatGPT exhibited enhanced diagnostic and inference capabilities for retinal vascular disease classification based on Chinese fundus fluorescein angiography reports. CONCLUSIONS ChatGPT can serve as a helpful medical assistant to provide diagnosis in non-English clinical environments, but there are still performance gaps, language disparities, and errors compared to professionals, which demonstrate the potential limitations and the need to continually explore more robust large language models in ophthalmology practice.
- 17 August 2023
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessUncovering Language Disparity of ChatGPT on Retinal Vascular Disease Classification: Cross-Sectional Study (Preprint)
BACKGROUND Benefiting from rich knowledge and the exceptional ability to understand text, large language models like ChatGPT have shown great potential in English clinical environments. However, the performance of ChatGPT in non-English clinical settings, as well as its reasoning, have not been explored in depth. OBJECTIVE This study aimed to evaluate ChatGPT’s diagnostic performance and inference abilities for retinal vascular diseases in a non-English clinical environment. METHODS In this cross-sectional study, we collected 1226 fundus fluorescein angiography reports and corresponding diagnoses written in Chinese and tested ChatGPT with 4 prompting strategies (direct diagnosis or diagnosis with a step-by-step reasoning process and in Chinese or English). RESULTS Compared with ChatGPT using Chinese prompts for direct diagnosis that achieved an F1-score of 70.47%, ChatGPT using English prompts for direct diagnosis achieved the best diagnostic performance (80.05%), which was inferior to ophthalmologists (89.35%) but close to ophthalmologist interns (82.69%). As for its inference abilities, although ChatGPT can derive a reasoning process with a low error rate (0.4 per report) for both Chinese and English prompts, ophthalmologists identified that the latter brought more reasoning steps with less incompleteness (44.31%), misinformation (1.96%), and hallucinations (0.59%) (all P<.001). Also, analysis of the robustness of ChatGPT with different language prompts indicated significant differences in the recall (P=.03) and F1-score (P=.04) between Chinese and English prompts. In short, when prompted in English, ChatGPT exhibited enhanced diagnostic and inference capabilities for retinal vascular disease classification based on Chinese fundus fluorescein angiography reports. CONCLUSIONS ChatGPT can serve as a helpful medical assistant to provide diagnosis in non-English clinical environments, but there are still performance gaps, language disparities, and errors compared to professionals, which demonstrate the potential limitations and the need to continually explore more robust large language models in ophthalmology practice.
- 5 April 2023
- Published by Wiley in Experimental Dermatology
- Vol. 32 (6) , 831-839
Deep learning‐based semantic segmentation of non‐melanocytic skin tumors in whole‐slide histopathological images
Basal cell carcinoma (BCC) and squamous cell carcinoma (SCC) are the two most common skin cancer and impose a huge medical burden on society. Histopathological examination based on whole‐slide images (WSIs) remains to be the confirmatory diagnostic method for skin tumors. Accurate segmentation of tumor tissue in WSIs by deep‐learning (DL) models can reduce the workload of pathologists and help surgeons ensure the complete removal of tumors. To accurately segment the tumor areas in WSIs of BCC, SCC and squamous cell papilloma (SCP, homologous to SCC) with robust models. We established a data set (ZJU‐NMSC) containing 151 WSIs of BCC, SCC and SCP in total. Seven models were utilized to segment WSIs, including the state‐of‐the‐art model, models proposed by us and other models. Dice score, intersection over union, accuracy, sensitivity and specificity were used to evaluate and compare the performance of different models. Heatmaps and tumor tissue masks were generated to reflect the results of the segmentation. The processing times of models are also recorded and compared. While the dice score of most models is higher than 0.85, deeplab v3+ has the best performance and the corresponding tumor tissue mask is more consistent with the ground truth tumor areas even with complex and small lobular lesions. This study broadens the use of DL‐based segmentation models in WSIs of skin tumors in terms of tumor types and computational approaches. Segmenting tumor areas can simplify the process of histopathological inspection and benefit the diagnosis and following management of the diseases in practice.
- 5 April 2023
- Published by Wiley in Experimental Dermatology
- Vol. 32 (6) , 831-839
Deep learning‐based semantic segmentation of non‐melanocytic skin tumors in whole‐slide histopathological images
Basal cell carcinoma (BCC) and squamous cell carcinoma (SCC) are the two most common skin cancer and impose a huge medical burden on society. Histopathological examination based on whole‐slide images (WSIs) remains to be the confirmatory diagnostic method for skin tumors. Accurate segmentation of tumor tissue in WSIs by deep‐learning (DL) models can reduce the workload of pathologists and help surgeons ensure the complete removal of tumors. To accurately segment the tumor areas in WSIs of BCC, SCC and squamous cell papilloma (SCP, homologous to SCC) with robust models. We established a data set (ZJU‐NMSC) containing 151 WSIs of BCC, SCC and SCP in total. Seven models were utilized to segment WSIs, including the state‐of‐the‐art model, models proposed by us and other models. Dice score, intersection over union, accuracy, sensitivity and specificity were used to evaluate and compare the performance of different models. Heatmaps and tumor tissue masks were generated to reflect the results of the segmentation. The processing times of models are also recorded and compared. While the dice score of most models is higher than 0.85, deeplab v3+ has the best performance and the corresponding tumor tissue mask is more consistent with the ground truth tumor areas even with complex and small lobular lesions. This study broadens the use of DL‐based segmentation models in WSIs of skin tumors in terms of tumor types and computational approaches. Segmenting tumor areas can simplify the process of histopathological inspection and benefit the diagnosis and following management of the diseases in practice.