Jingyu Liu
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Jingyu Liu has a total of 20 co-authors. Here are the top co-authors by number of shared publications:
- Jun Ai
School of Reliability and Systems Engineering, Beihang University, Beijing 100191, China
6 shared publications - Tao Shi
School of Reliability and Systems Engineering, Beihang University, Beijing 100191, China
3 shared publications - Haoxiang Shi
Harbin Institute of Technology (Shenzhen), Shenzhen, China and Pengcheng Laboratory, Shenzhen, China
2 shared publications - Jiaxi Xu
China Electronic Product Reliability and Environmental Testing Research Institute,Guangzhou,Guangdong,China
2 shared publications - Jie Wang
School of Reliability and Systems Engineering, Beihang University
2 shared publications Dan Yu
1 shared publication
Latest Publications
- Open Access
- 9 June 2026
- Published by Association for Computing Machinery (ACM) in ACM Computing Surveys
- Vol. 58 (12) , 1-40
A Survey of Neural Network Robustness Assessment in Image Recognition
In recent years, there has been significant attention given to the robustness assessment of neural networks. Robustness plays a critical role in ensuring reliable operation of artificial intelligence (AI) systems in complex and uncertain environments. Deep learning's robustness problem is particularly significant, highlighted by the discovery of adversarial attacks on image classification models. Researchers have dedicated efforts to evaluate robustness in diverse perturbation conditions for image recognition tasks. Robustness assessment encompasses two main techniques: robustness verification/certification for deliberate adversarial attacks and robustness testing for random data corruptions. In this survey, we present a detailed examination of both adversarial robustness (AR) and corruption robustness (CR) in neural network assessment. Analyzing current research papers and standards, we provide an extensive overview of robustness assessment in image recognition. Three essential aspects are analyzed: concepts, metrics, and assessment methods. We investigate the perturbation metrics and range representations used to measure the degree of perturbations on images, as well as the robustness metrics specifically for the robustness conditions of classification models. The strengths and limitations of the existing methods are also discussed, and some potential directions for future research are provided.
- 9 June 2026
- Published by Association for Computing Machinery (ACM) in ACM Computing Surveys
- Vol. 58 (12) , 1-40
Open AccessA Survey of Neural Network Robustness Assessment in Image Recognition
In recent years, there has been significant attention given to the robustness assessment of neural networks. Robustness plays a critical role in ensuring reliable operation of artificial intelligence (AI) systems in complex and uncertain environments. Deep learning's robustness problem is particularly significant, highlighted by the discovery of adversarial attacks on image classification models. Researchers have dedicated efforts to evaluate robustness in diverse perturbation conditions for image recognition tasks. Robustness assessment encompasses two main techniques: robustness verification/certification for deliberate adversarial attacks and robustness testing for random data corruptions. In this survey, we present a detailed examination of both adversarial robustness (AR) and corruption robustness (CR) in neural network assessment. Analyzing current research papers and standards, we provide an extensive overview of robustness assessment in image recognition. Three essential aspects are analyzed: concepts, metrics, and assessment methods. We investigate the perturbation metrics and range representations used to measure the degree of perturbations on images, as well as the robustness metrics specifically for the robustness conditions of classification models. The strengths and limitations of the existing methods are also discussed, and some potential directions for future research are provided.
- 12 May 2026
- Published by Elsevier in Journal of Systems and Software
- Vol. 240
OTBD: Overfitting tendency assessment based on benchmark deviation for dependable model training
- 12 May 2026
- Published by Elsevier in Journal of Systems and Software
- Vol. 240
OTBD: Overfitting tendency assessment based on benchmark deviation for dependable model training
- Open Access
- 22 February 2026
- Published by MDPI AG in Applied Sciences
- Vol. 16 (4) , 2124
Repairing DNN Numerical Defects with Semantic-Driven Knowledge Graph Retrieval
Ensuring numerical robustness in deep neural networks (DNNs) is critical, as defects like overflow or NaN can cause silent failures. However, automated repair is challenged by fragmented domain knowledge and the semantic gap for general-purpose large language models (LLMs). This work proposes NCKG, a Numerical–Conceptual Knowledge Graph-based method for retrieval-augmented repair of DNN numerical defects. NCKG introduces a unified semantic formalization that explicitly models DNN execution contexts, numerical defects, mitigation methods, and constraint knowledge, transforming dispersed defect knowledge into a consistent, machine-interpretable representation. Based on this formalization, a multi-view semantic graph index is constructed, enabling a hybrid semantic-driven retrieval mechanism that combines structure-aware graph matching with vector similarity. Retrieved, semantically aligned defect–repair knowledge is then used to guide LLMs in generating context-aware repairs. Experimental results demonstrate that NCKG significantly outperforms standard retrieval baselines and consistently improves the quality and correctness of LLM-generated fixes across different model scales. This work demonstrates that explicit semantic structuring and retrieval of domain knowledge are crucial for enabling reliable, automated numerical defect repair in DNNs.
- 22 February 2026
- Published by MDPI AG in Applied Sciences
- Vol. 16 (4) , 2124
Open AccessRepairing DNN Numerical Defects with Semantic-Driven Knowledge Graph Retrieval
Ensuring numerical robustness in deep neural networks (DNNs) is critical, as defects like overflow or NaN can cause silent failures. However, automated repair is challenged by fragmented domain knowledge and the semantic gap for general-purpose large language models (LLMs). This work proposes NCKG, a Numerical–Conceptual Knowledge Graph-based method for retrieval-augmented repair of DNN numerical defects. NCKG introduces a unified semantic formalization that explicitly models DNN execution contexts, numerical defects, mitigation methods, and constraint knowledge, transforming dispersed defect knowledge into a consistent, machine-interpretable representation. Based on this formalization, a multi-view semantic graph index is constructed, enabling a hybrid semantic-driven retrieval mechanism that combines structure-aware graph matching with vector similarity. Retrieved, semantically aligned defect–repair knowledge is then used to guide LLMs in generating context-aware repairs. Experimental results demonstrate that NCKG significantly outperforms standard retrieval baselines and consistently improves the quality and correctness of LLM-generated fixes across different model scales. This work demonstrates that explicit semantic structuring and retrieval of domain knowledge are crucial for enabling reliable, automated numerical defect repair in DNNs.
- Open Access
A Survey of Neural Network Robustness Assessment in Image Recognition
In recent years, there has been significant attention given to the robustness assessment of neural networks. Robustness plays a critical role in ensuring reliable operation of artificial intelligence (AI) systems in complex and uncertain environments. Deep learning's robustness problem is particularly significant, highlighted by the discovery of adversarial attacks on image classification models. Researchers have dedicated efforts to evaluate robustness in diverse perturbation conditions for image recognition tasks. Robustness assessment encompasses two main techniques: robustness verification/ certification for deliberate adversarial attacks and robustness testing for random data corruptions. In this survey, we present a detailed examination of both adversarial robustness (AR) and corruption robustness (CR) in neural network assessment. Analyzing current research papers and standards, we provide an extensive overview of robustness assessment in image recognition. Three essential aspects are analyzed: concepts, metrics, and assessment methods. We investigate the perturbation metrics and range representations used to measure the degree of perturbations on images, as well as the robustness metrics specifically for the robustness conditions of classification models. The strengths and limitations of the existing methods are also discussed, and some potential directions for future research are provided.
Open AccessA Survey of Neural Network Robustness Assessment in Image Recognition
In recent years, there has been significant attention given to the robustness assessment of neural networks. Robustness plays a critical role in ensuring reliable operation of artificial intelligence (AI) systems in complex and uncertain environments. Deep learning's robustness problem is particularly significant, highlighted by the discovery of adversarial attacks on image classification models. Researchers have dedicated efforts to evaluate robustness in diverse perturbation conditions for image recognition tasks. Robustness assessment encompasses two main techniques: robustness verification/ certification for deliberate adversarial attacks and robustness testing for random data corruptions. In this survey, we present a detailed examination of both adversarial robustness (AR) and corruption robustness (CR) in neural network assessment. Analyzing current research papers and standards, we provide an extensive overview of robustness assessment in image recognition. Three essential aspects are analyzed: concepts, metrics, and assessment methods. We investigate the perturbation metrics and range representations used to measure the degree of perturbations on images, as well as the robustness metrics specifically for the robustness conditions of classification models. The strengths and limitations of the existing methods are also discussed, and some potential directions for future research are provided.
- Open Access
- 19 September 2023
- Published by MDPI AG in Applied Sciences
- Vol. 13 (18) , 10466
Improving Software Defect Prediction in Noisy Imbalanced Datasets
Software defect prediction is a popular method for optimizing software testing and improving software quality and reliability. However, software defect datasets usually have quality problems, such as class imbalance and data noise. Oversampling by generating the minority class samples is one of the most well-known methods to improving the quality of datasets; however, it often introduces overfitting noise to datasets. To better improve the quality of these datasets, this paper proposes a method called US-PONR, which uses undersampling to remove duplicate samples from version iterations and then uses oversampling through propensity score matching to reduce class imbalance and noise samples in datasets. The effectiveness of this method was validated in a software prediction experiment that involved 24 versions of software data in 11 projects from PROMISE in noisy environments that varied from 0% to 30% noise level. The experiments showed a significant improvement in the quality of datasets pre-processed by US-PONR in noisy imbalanced datasets, especially the noisiest ones, compared with 12 other advanced dataset processing methods. The experiments also demonstrated that the US-PONR method can effectively identify the label noise samples and remove them.
- 19 September 2023
- Published by MDPI AG in Applied Sciences
- Vol. 13 (18) , 10466
Open AccessImproving Software Defect Prediction in Noisy Imbalanced Datasets
Software defect prediction is a popular method for optimizing software testing and improving software quality and reliability. However, software defect datasets usually have quality problems, such as class imbalance and data noise. Oversampling by generating the minority class samples is one of the most well-known methods to improving the quality of datasets; however, it often introduces overfitting noise to datasets. To better improve the quality of these datasets, this paper proposes a method called US-PONR, which uses undersampling to remove duplicate samples from version iterations and then uses oversampling through propensity score matching to reduce class imbalance and noise samples in datasets. The effectiveness of this method was validated in a software prediction experiment that involved 24 versions of software data in 11 projects from PROMISE in noisy environments that varied from 0% to 30% noise level. The experiments showed a significant improvement in the quality of datasets pre-processed by US-PONR in noisy imbalanced datasets, especially the noisiest ones, compared with 12 other advanced dataset processing methods. The experiments also demonstrated that the US-PONR method can effectively identify the label noise samples and remove them.
- 7 June 2023
- Published by Elsevier in Journal of Systems and Software
- Vol. 204
Semantic feature learning for software defect prediction from source code and external knowledge
- 7 June 2023
- Published by Elsevier in Journal of Systems and Software
- Vol. 204
Semantic feature learning for software defect prediction from source code and external knowledge
- 19 April 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Reliability
- Vol. 71 (2) , 850-864
ACGDP: An Augmented Code Graph-Based System for Software Defect Prediction
Recognizing and repairing defects to enhance quality in software life circle has become a critical research topic. Unfortunately, it is difficult to guarantee the validity of the defect prediction method based on manually designed features proposed in previous studies. Numerous scholars have endeavored to use a single model to obtain prediction results for different types of fault, but this is difficult to perform. This article improves the defect representation and prediction model in software defect prediction, proposing Augmented-Code Property Graph (CPG) based defect prediction method (ACGDP). Augmented-CPG is a novel encoding graph format introduced in this article. Based on Augmented-CPG, we suggested defect region candidate extraction approach linked to the defect category. Graph neural networks are used for obtaining defect characteristics. Experiments on three distinct types of defects indicate that ACGDP can predict certain classed of defects effectively.
- 19 April 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Reliability
- Vol. 71 (2) , 850-864
ACGDP: An Augmented Code Graph-Based System for Software Defect Prediction
Recognizing and repairing defects to enhance quality in software life circle has become a critical research topic. Unfortunately, it is difficult to guarantee the validity of the defect prediction method based on manually designed features proposed in previous studies. Numerous scholars have endeavored to use a single model to obtain prediction results for different types of fault, but this is difficult to perform. This article improves the defect representation and prediction model in software defect prediction, proposing Augmented-Code Property Graph (CPG) based defect prediction method (ACGDP). Augmented-CPG is a novel encoding graph format introduced in this article. Based on Augmented-CPG, we suggested defect region candidate extraction approach linked to the defect category. Graph neural networks are used for obtaining defect characteristics. Experiments on three distinct types of defects indicate that ACGDP can predict certain classed of defects effectively.