Antonio Guerriero
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Antonio Guerriero has a total of 41 co-authors. Here are the top co-authors by number of shared publications:
- Roberto Pietrantuono
University of Naples Federico II
12 shared publications - Stefano Russo
University of Naples Federico II, Naples, Naples, Italy
8 shared publications - Luca Giamattei
University of Naples Federico II, Naples, Naples, Italy
7 shared publications - Ivano Malavolta
Vrije Universiteit Amsterdam, Amsterdam, Netherlands
4 shared publications - Francesco Pietra
Accademia Lucchese di Scienze Lettere e Arti, Classe di Scienze, Palazzo Pretorio, Via Vittorio Veneto 1, Lucca, Italy
2 shared publications - Michele D'Ambrosio
Laboratory of Bio-Organic Chemistry, Department of Physics, University of Trento, via Sommarive 14, 38123 Trento, Italy
2 shared publications
Latest Publications
- 7 September 2026
- Published by Springer Nature
- p. 176-192
Schema-Constrained Document-Level Event Argument Extraction with Lightweight LLM Fine-Tuning
- 7 September 2026
- Published by Springer Nature
- p. 176-192
Schema-Constrained Document-Level Event Argument Extraction with Lightweight LLM Fine-Tuning
- Open Access
- 22 September 2025
- Published by Elsevier in Journal of Systems and Software
- Vol. 231
Multivariate anomaly detection and root cause analysis of energy issues in microservice-based systems
- 22 September 2025
- Published by Elsevier in Journal of Systems and Software
- Vol. 231
Open AccessMultivariate anomaly detection and root cause analysis of energy issues in microservice-based systems
- 28 June 2025
- Published by Springer Nature
- p. 3-15
Detecting DDoS Attacks in Microservice Architectures via AI-Based Agents
- 28 June 2025
- Published by Springer Nature
- p. 3-15
Detecting DDoS Attacks in Microservice Architectures via AI-Based Agents
- Open Access
- 25 December 2024
- Published by Springer Nature in Research Square
From Testing to Evaluation of NLP and LLM Systems: An Analysis of Researchers and Practitioners Perspectives through Systematic Literature Review and Developers’ Community Platforms Mining
Natural Language Processing (NLP) systems and Large Language Models (LLMs) are core components of applications driven by Artificial Intelligence, today widely spread in many fields including healthcare, finance, legal services. The evaluation of quality attributes of NLP/LLM-based systems is currently of great interest of researchers as well as of professionals. This study presents an analysis of the evaluation of quality attributes of NLP/LLM-based systems in the perspectives of both researchers and practitioners. The former is based on a systematic review of the scientific literature. The latter is based on data mined from professional platforms (StackOverflow, DataScience Stack-Exchange, AI StackExchange) used by developers’ communities to share knowledge and technical solutions. The systematic literature review features a quantitative analysis of: 1) the quality attributes that researchers target in their NLP/LLMs evaluation studies; 2) the tasks, datasets and models used, and 3) the evaluation methods employed in research studies. The mining of discussion data from professional platforms features a trend analysis of the significance of quality attributes and of the difficulty of their evaluation in the developers’ perspective. Overall, the comparison between researchers’ and practitioners’ perspectives provides insights on how challenges related to the evaluation of NLP/LLM quality attributes are addressed, reveals several interesting differences, and draws useful implications for both.
- 25 December 2024
- Published by Springer Nature in Research Square
Open AccessFrom Testing to Evaluation of NLP and LLM Systems: An Analysis of Researchers and Practitioners Perspectives through Systematic Literature Review and Developers’ Community Platforms Mining
Natural Language Processing (NLP) systems and Large Language Models (LLMs) are core components of applications driven by Artificial Intelligence, today widely spread in many fields including healthcare, finance, legal services. The evaluation of quality attributes of NLP/LLM-based systems is currently of great interest of researchers as well as of professionals. This study presents an analysis of the evaluation of quality attributes of NLP/LLM-based systems in the perspectives of both researchers and practitioners. The former is based on a systematic review of the scientific literature. The latter is based on data mined from professional platforms (StackOverflow, DataScience Stack-Exchange, AI StackExchange) used by developers’ communities to share knowledge and technical solutions. The systematic literature review features a quantitative analysis of: 1) the quality attributes that researchers target in their NLP/LLMs evaluation studies; 2) the tasks, datasets and models used, and 3) the evaluation methods employed in research studies. The mining of discussion data from professional platforms features a trend analysis of the significance of quality attributes and of the difficulty of their evaluation in the developers’ perspective. Overall, the comparison between researchers’ and practitioners’ perspectives provides insights on how challenges related to the evaluation of NLP/LLM quality attributes are addressed, reveals several interesting differences, and draws useful implications for both.
- Open Access
- 15 April 2024
- Published by Association for Computing Machinery (ACM)
- p. 149-153
Identifying Performance Issues in Microservice Architectures through Causal Reasoning
Evaluating the performance of Microservices Architectures (MSA) is essential to ensure their proper functioning and meet end-user satisfaction. For MSA performance analysts, one of the most challenging tasks is to determine the cause of any deviation of relevant metrics from the specified range. We introduce CAR-PT (CAusal-Reasoning-driven Performance Testing), a model-based technique for workload generation designed for the performance testing of MSA. CAR-PT leverages causal reasoning to effectively explore the space of operational conditions, with the goal of identifying those that lead to performance issues. Preliminary results show that CAR-PT is effective in generating configurations for discovering performance issues of an MSA.
- 15 April 2024
- Published by Association for Computing Machinery (ACM)
- p. 149-153
Open AccessIdentifying Performance Issues in Microservice Architectures through Causal Reasoning
Evaluating the performance of Microservices Architectures (MSA) is essential to ensure their proper functioning and meet end-user satisfaction. For MSA performance analysts, one of the most challenging tasks is to determine the cause of any deviation of relevant metrics from the specified range. We introduce CAR-PT (CAusal-Reasoning-driven Performance Testing), a model-based technique for workload generation designed for the performance testing of MSA. CAR-PT leverages causal reasoning to effectively explore the space of operational conditions, with the goal of identifying those that lead to performance issues. Preliminary results show that CAR-PT is effective in generating configurations for discovering performance issues of an MSA.
- Open Access
- 12 April 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-12
DeepSample: DNN sampling-based testing for operational accuracy assessment
Deep Neural Networks (DNN) are core components for classification and regression tasks of many software systems. Companies incur in high costs for testing DNN with datasets representative of the inputs expected in operation, as these need to be manually labelled. The challenge is to select a representative set of test inputs as small as possible to reduce the labelling cost, while sufficing to yield unbiased high-confidence estimates of the expected DNN accuracy. At the same time, testers are interested in exposing as many DNN mispredictions as possible to improve the DNN, ending up in the need for techniques pursuing a threefold aim: small dataset size, trustworthy estimates, mispredictions exposure. This study presents DeepSample, a family of DNN testing techniques for cost-effective accuracy assessment based on probabilistic sampling. We investigate whether, to what extent, and under which conditions probabilistic sampling can help to tackle the outlined challenge. We implement five new sampling-based testing techniques, and perform a comprehensive comparison of such techniques and of three further state-of-the-art techniques for both DNN classification and regression tasks. Results serve as guidance for best use of sampling-based testing for faithful and high-confidence estimates of DNN accuracy in operation at low cost.
- 12 April 2024
- Published by Association for Computing Machinery (ACM)
- p. 1-12
Open AccessDeepSample: DNN sampling-based testing for operational accuracy assessment
Deep Neural Networks (DNN) are core components for classification and regression tasks of many software systems. Companies incur in high costs for testing DNN with datasets representative of the inputs expected in operation, as these need to be manually labelled. The challenge is to select a representative set of test inputs as small as possible to reduce the labelling cost, while sufficing to yield unbiased high-confidence estimates of the expected DNN accuracy. At the same time, testers are interested in exposing as many DNN mispredictions as possible to improve the DNN, ending up in the need for techniques pursuing a threefold aim: small dataset size, trustworthy estimates, mispredictions exposure. This study presents DeepSample, a family of DNN testing techniques for cost-effective accuracy assessment based on probabilistic sampling. We investigate whether, to what extent, and under which conditions probabilistic sampling can help to tackle the outlined challenge. We implement five new sampling-based testing techniques, and perform a comprehensive comparison of such techniques and of three further state-of-the-art techniques for both DNN classification and regression tasks. Results serve as guidance for best use of sampling-based testing for faithful and high-confidence estimates of DNN accuracy in operation at low cost.
- Open Access
- 15 March 2024
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Software Engineering and Methodology
- Vol. 33 (3) , 1-35
Causality-driven Testing of Autonomous Driving Systems
Testing Autonomous Driving Systems (ADS) is essential for safe development of self-driving cars. For thorough and realistic testing, ADS are usually embedded in a simulator and tested in interaction with the simulated environment. However, their high complexity and the multiple safety requirements lead to costly and ineffective testing. Recent techniques exploit many-objective strategies and ML to efficiently search the huge input space. Despite the indubitable advances, the need for smartening the search keep being pressing. This article presents CART ( CAusal-Reasoning-driven Testing ), a new technique that formulates testing as a causal reasoning task. Learning causation, unlike correlation, allows assessing the effect of actively changing an input on the output, net of possible confounding variables. CART first infers the causal relations between test inputs and outputs, then looks for promising tests by querying the learnt model. Only tests suggested by the model are run on the simulator. An extensive empirical evaluation, using Pylot as ADS and CARLA as simulator, compares CART with state-of-the-art algorithms used recently on ADS. CART shows a significant gain in exposing more safety violations and does so more efficiently. More broadly, the work opens to a wider exploitation of causal learning beside (or on top of) ML for testing-related tasks.
- 15 March 2024
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Software Engineering and Methodology
- Vol. 33 (3) , 1-35
Open AccessCausality-driven Testing of Autonomous Driving Systems
Testing Autonomous Driving Systems (ADS) is essential for safe development of self-driving cars. For thorough and realistic testing, ADS are usually embedded in a simulator and tested in interaction with the simulated environment. However, their high complexity and the multiple safety requirements lead to costly and ineffective testing. Recent techniques exploit many-objective strategies and ML to efficiently search the huge input space. Despite the indubitable advances, the need for smartening the search keep being pressing. This article presents CART ( CAusal-Reasoning-driven Testing ), a new technique that formulates testing as a causal reasoning task. Learning causation, unlike correlation, allows assessing the effect of actively changing an input on the output, net of possible confounding variables. CART first infers the causal relations between test inputs and outputs, then looks for promising tests by querying the learnt model. Only tests suggested by the model are run on the simulator. An extensive empirical evaluation, using Pylot as ADS and CARLA as simulator, compares CART with state-of-the-art algorithms used recently on ADS. CART shows a significant gain in exposing more safety violations and does so more efficiently. More broadly, the work opens to a wider exploitation of causal learning beside (or on top of) ML for testing-related tasks.
- Top Cited PapersOpen Access
- 22 November 2023
- Published by Elsevier in Journal of Systems and Software
- Vol. 208
Monitoring tools for DevOps and microservices: A systematic grey literature review
- 22 November 2023
- Published by Elsevier in Journal of Systems and Software
- Vol. 208
Top Cited PapersOpen AccessMonitoring tools for DevOps and microservices: A systematic grey literature review
- 20 November 2023
- Published by Springer Nature
- p. 181-196
An Empirical Evaluation of the Energy and Performance Overhead of Monitoring Tools on Docker-Based Systems
- 20 November 2023
- Published by Springer Nature
- p. 181-196
An Empirical Evaluation of the Energy and Performance Overhead of Monitoring Tools on Docker-Based Systems
- Open Access
- 5 October 2023
- Published by Elsevier in Journal of Systems and Software
- Vol. 207
Automated functional and robustness testing of microservice architectures
- 5 October 2023
- Published by Elsevier in Journal of Systems and Software
- Vol. 207
Open AccessAutomated functional and robustness testing of microservice architectures