ZhiWei Xie
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
ZhiWei Xie has a total of 4 co-authors. Here are the top co-authors by number of shared publications:
- Philip Leung Ho Yu
Department of Mathematics and Information Technology, The Education University of Hong Kong, Hong Kong SAR, China
2 shared publications - Ruibin Zhao
School of Artificial Intelligence, Chuzhou Univeristy, Chuzhou, China
2 shared publications Yipeng Zhuang
1 shared publication- Yipeng Zhuang
The University of Hong Kong
1 shared publication
Latest Publications
- 14 June 2024
- Published by Elsevier in Computers & Education
- Vol. 219
Facilitating self-directed language learning in real-life scene description tasks with automated evaluation
- 14 June 2024
- Published by Elsevier in Computers & Education
- Vol. 219
Facilitating self-directed language learning in real-life scene description tasks with automated evaluation
- 6 February 2024
- Published by World Scientific Pub Co Pte Ltd in International Journal of Neural Systems
- Vol. 34 (03) , 2450009
Automated Quality Evaluation of Large-Scale Benchmark Datasets for Vision-Language Tasks
Large-scale benchmark datasets are crucial in advancing research within the computer science communities. They enable the development of more sophisticated AI models and serve as “golden” benchmarks for evaluating their performance. Thus, ensuring the quality of these datasets is of utmost importance for academic research and the progress of AI systems. For the emerging vision-language tasks, some datasets have been created and frequently used, such as Flickr30k, COCO, and NoCaps, which typically contain a large number of images paired with their ground-truth textual descriptions. In this paper, an automatic method is proposed to assess the quality of large-scale benchmark datasets designed for vision-language tasks. In particular, a new cross-modal matching model is developed, which is capable of automatically scoring the textual descriptions of visual images. Subsequently, this model is employed to evaluate the quality of vision-language datasets by automatically assigning a score to each ‘ground-truth’ description for every image picture. With a good agreement between manual and automated scoring results on the datasets, our findings reveal significant disparities in the quality of the ground-truth descriptions included in the benchmark datasets. Even more surprising, it is evident that a small portion of the descriptions are unsuitable for serving as reliable ground-truth references. These discoveries emphasize the need for careful utilization of these publicly accessible benchmark databases.
- 6 February 2024
- Published by World Scientific Pub Co Pte Ltd in International Journal of Neural Systems
- Vol. 34 (03) , 2450009
Automated Quality Evaluation of Large-Scale Benchmark Datasets for Vision-Language Tasks
Large-scale benchmark datasets are crucial in advancing research within the computer science communities. They enable the development of more sophisticated AI models and serve as “golden” benchmarks for evaluating their performance. Thus, ensuring the quality of these datasets is of utmost importance for academic research and the progress of AI systems. For the emerging vision-language tasks, some datasets have been created and frequently used, such as Flickr30k, COCO, and NoCaps, which typically contain a large number of images paired with their ground-truth textual descriptions. In this paper, an automatic method is proposed to assess the quality of large-scale benchmark datasets designed for vision-language tasks. In particular, a new cross-modal matching model is developed, which is capable of automatically scoring the textual descriptions of visual images. Subsequently, this model is employed to evaluate the quality of vision-language datasets by automatically assigning a score to each ‘ground-truth’ description for every image picture. With a good agreement between manual and automated scoring results on the datasets, our findings reveal significant disparities in the quality of the ground-truth descriptions included in the benchmark datasets. Even more surprising, it is evident that a small portion of the descriptions are unsuitable for serving as reliable ground-truth references. These discoveries emphasize the need for careful utilization of these publicly accessible benchmark databases.