WAWallace Albertini

Wallace Albertini

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Wallace Albertini has a total of 10 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Statistical Confidence in Functional Correctness: An Approach for AI Product Functional Correctness Evaluation

    by Wallace Albertini, Marina Condé Araújo, Júlia Condé Araújo, Antonio Pedro Santos Alves, Marcos Kalinowski

  • Open Access

    Statistical Confidence in Functional Correctness: An Approach for AI Product Functional Correctness Evaluation

    by Wallace Albertini, Marina Condé Araújo, Júlia Condé Araújo, Antonio Pedro Santos Alves, Marcos Kalinowski

    The quality assessment of Artificial Intelligence (AI) systems is a fundamental challenge due to their inherently probabilistic nature. Standards such as ISO/IEC 25059 provide a quality model, but they lack practical and statistically robust methods for assessing functional correctness. This paper proposes and evaluates the Statistical Confidence in Functional Correctness (SCFC) approach, which seeks to fill this gap by connecting business requirements to a measure of statistical confidence that considers both the model's average performance and its variability. The approach consists of four steps: defining quantitative specification limits, performing stratified and probabilistic sampling, applying bootstrapping to estimate a confidence interval for the performance metric, and calculating a capability index as a final indicator. The approach was evaluated through a case study on two real-world AI systems in industry involving interviews with AI experts. Valuable insights were collected from the experts regarding the utility, ease of use, and intention to adopt the methodology in practical scenarios. We conclude that the proposed approach is a feasible and valuable way to operationalize the assessment of functional correctness, moving the evaluation from a point estimate to a statement of statistical confidence.

  • Open Access

    Practical Insights Into AI System Product Quality Evaluation

    by Wallace Albertini, Jesús Oviedo, Eduardo Motta, Julia Araújo, Marina Araújo, Moisés Rodríguez, Helio Lopes, Marcos Kalinowski, Mario Piattini

    This study investigates the application of the ISO/IEC 25059 standard in the quality evaluation of artificial intelligence (AI) systems, focusing on functional suitability. Through a case study evaluating an AI system developed for analyzing images of oil platform decks, we discuss the practical nuances of evaluating functional correctness. We share information on specific properties defined to operationalize the evaluation. We emphasize the need to thoroughly discuss acceptable specification limits, especially in safety-critical contexts. Furthermore, the representativeness and sample size of the test cases should be systematically considered to reflect the profile of real-world operational conditions.