Wallace Albertini
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Wallace Albertini has a total of 10 co-authors. Here are the top co-authors by number of shared publications:
- Marcos Kalinowski
Pontifical Catholic University of Rio de Janeiro (PUC-Rio), Rio de Janeiro, Brazil
3 shared publications - Marina Condé Araújo
Colorado State University, Fort Collins, Colorado, USA
3 shared publications - Antonio Pedro Santos Alves
Pontifical Catholic University of Rio de Janeiro (PUC-Rio), Rio de Janeiro, Rio de janeiro, Brazil
2 shared publications - Júlia Condé Araújo
Colorado State University, Fort Collins, Colorado, USA
2 shared publications - Eduardo Motta
Pontifical Catholic University of Rio de Janeiro, Rio de Janeiro, Brazil
1 shared publication - Hélio Lopes
Department of Informatics, Pontifical Catholic University of Rio de Janeiro (PUC-Rio), Rio de Janeiro, Brazil
1 shared publication
Latest Publications
- Open Access
- 12 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 121-131
Statistical Confidence in Functional Correctness: An Approach for AI Product Functional Correctness Evaluation
- 12 April 2026
- Published by Association for Computing Machinery (ACM)
- p. 121-131
Open AccessStatistical Confidence in Functional Correctness: An Approach for AI Product Functional Correctness Evaluation
- Open Access
Statistical Confidence in Functional Correctness: An Approach for AI Product Functional Correctness Evaluation
The quality assessment of Artificial Intelligence (AI) systems is a fundamental challenge due to their inherently probabilistic nature. Standards such as ISO/IEC 25059 provide a quality model, but they lack practical and statistically robust methods for assessing functional correctness. This paper proposes and evaluates the Statistical Confidence in Functional Correctness (SCFC) approach, which seeks to fill this gap by connecting business requirements to a measure of statistical confidence that considers both the model's average performance and its variability. The approach consists of four steps: defining quantitative specification limits, performing stratified and probabilistic sampling, applying bootstrapping to estimate a confidence interval for the performance metric, and calculating a capability index as a final indicator. The approach was evaluated through a case study on two real-world AI systems in industry involving interviews with AI experts. Valuable insights were collected from the experts regarding the utility, ease of use, and intention to adopt the methodology in practical scenarios. We conclude that the proposed approach is a feasible and valuable way to operationalize the assessment of functional correctness, moving the evaluation from a point estimate to a statement of statistical confidence.
Open AccessStatistical Confidence in Functional Correctness: An Approach for AI Product Functional Correctness Evaluation
The quality assessment of Artificial Intelligence (AI) systems is a fundamental challenge due to their inherently probabilistic nature. Standards such as ISO/IEC 25059 provide a quality model, but they lack practical and statistically robust methods for assessing functional correctness. This paper proposes and evaluates the Statistical Confidence in Functional Correctness (SCFC) approach, which seeks to fill this gap by connecting business requirements to a measure of statistical confidence that considers both the model's average performance and its variability. The approach consists of four steps: defining quantitative specification limits, performing stratified and probabilistic sampling, applying bootstrapping to estimate a confidence interval for the performance metric, and calculating a capability index as a final indicator. The approach was evaluated through a case study on two real-world AI systems in industry involving interviews with AI experts. Valuable insights were collected from the experts regarding the utility, ease of use, and intention to adopt the methodology in practical scenarios. We conclude that the proposed approach is a feasible and valuable way to operationalize the assessment of functional correctness, moving the evaluation from a point estimate to a statement of statistical confidence.
- Open Access
- 18 February 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IT Professional
- Vol. 28 (1) , 81-87
Practical Insights Into AI System Product Quality Evaluation
This study investigates the application of the ISO/IEC 25059 standard in the quality evaluation of artificial intelligence (AI) systems, focusing on functional suitability. Through a case study evaluating an AI system developed for analyzing images of oil platform decks, we discuss the practical nuances of evaluating functional correctness. We share information on specific properties defined to operationalize the evaluation. We emphasize the need to thoroughly discuss acceptable specification limits, especially in safety-critical contexts. Furthermore, the representativeness and sample size of the test cases should be systematically considered to reflect the profile of real-world operational conditions.
- 18 February 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IT Professional
- Vol. 28 (1) , 81-87
Open AccessPractical Insights Into AI System Product Quality Evaluation
This study investigates the application of the ISO/IEC 25059 standard in the quality evaluation of artificial intelligence (AI) systems, focusing on functional suitability. Through a case study evaluating an AI system developed for analyzing images of oil platform decks, we discuss the practical nuances of evaluating functional correctness. We share information on specific properties defined to operationalize the evaluation. We emphasize the need to thoroughly discuss acceptable specification limits, especially in safety-critical contexts. Furthermore, the representativeness and sample size of the test cases should be systematically considered to reflect the profile of real-world operational conditions.