Francesco Fabris
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Francesco Fabris has a total of 42 co-authors. Here are the top co-authors by number of shared publications:
- Alberto Casagrande
Università degli Studi di Udine, Italy
13 shared publications - Rossano Girometti
Institute of Radiology, Department of Medicine, University of Udine, University Hospital S. Maria della Misericordia, Udine, Italy
7 shared publications - Piero Paolo Battaglini
University of Trieste
3 shared publications - Andrea Sgarro
University of Trieste
2 shared publications Joanna Jarmolowska
Department of Life Sciences, University of Trieste, Trieste, Italy
2 shared publications- Marco Bernardo
Dipartimento di Scienze Pure e Applicate Università di Urbino Italy
2 shared publications
Latest Publications
- Open Access
- 22 September 2025
- Published by Springer Nature in Statistics and Computing
- Vol. 35 (6) , 1-18
Significativity Indices for Agreement Values
Agreement measures, such as Cohen’s kappa or intraclass correlation, gauge the matching between two or more classifiers. They are used in a wide range of contexts from medicine, where they evaluate the effectiveness of medical treatments and clinical trials, to artificial intelligence, where they can quantify the approximation due to the reduction of a classifier. The consistency of different classifiers to a gold standard can be compared simply by using the order induced by their agreement measure with respect to the gold standard itself. Nevertheless, labelling an approach as good or bad exclusively by using the value of an agreement measure requires a scale or a significativity index. Some quality scales have been proposed in the literature for Cohen’s kappa, but they are mainly naïve, and their boundaries are arbitrary. We propose a general approach to evaluate the significance of any agreement value between two classifiers as the probability of randomly choosing a confusion matrix, built over the same data set, with a lower agreement value. This measure, named significativity, gauges the relevance of the observed agreement value rather than replacing the agreement measure used to calculate it. This work introduces two significativity indices: one dealing with finite data sets, the other one handling classification probability distributions. This manuscript also addresses the computational challenges of evaluating such indices and proposes some efficient algorithms for their evaluation.
- 22 September 2025
- Published by Springer Nature in Statistics and Computing
- Vol. 35 (6) , 1-18
Open AccessSignificativity Indices for Agreement Values
Agreement measures, such as Cohen’s kappa or intraclass correlation, gauge the matching between two or more classifiers. They are used in a wide range of contexts from medicine, where they evaluate the effectiveness of medical treatments and clinical trials, to artificial intelligence, where they can quantify the approximation due to the reduction of a classifier. The consistency of different classifiers to a gold standard can be compared simply by using the order induced by their agreement measure with respect to the gold standard itself. Nevertheless, labelling an approach as good or bad exclusively by using the value of an agreement measure requires a scale or a significativity index. Some quality scales have been proposed in the literature for Cohen’s kappa, but they are mainly naïve, and their boundaries are arbitrary. We propose a general approach to evaluate the significance of any agreement value between two classifiers as the probability of randomly choosing a confusion matrix, built over the same data set, with a lower agreement value. This measure, named significativity, gauges the relevance of the observed agreement value rather than replacing the agreement measure used to calculate it. This work introduces two significativity indices: one dealing with finite data sets, the other one handling classification probability distributions. This manuscript also addresses the computational challenges of evaluating such indices and proposes some efficient algorithms for their evaluation.
- Open Access
- 19 August 2025
- Published by Elsevier in Blockchain: Research and Applications
- Vol. 7 (4)
Learning from Terra-Luna: A Simulation-Based Study on Stabilizing Algorithmic Stablecoins
- 19 August 2025
- Published by Elsevier in Blockchain: Research and Applications
- Vol. 7 (4)
Open AccessLearning from Terra-Luna: A Simulation-Based Study on Stabilizing Algorithmic Stablecoins
- Open Access
- 9 June 2025
- Published by Association for Computing Machinery (ACM)
- p. 122-133
Impact of Network Topologies on Blockchain Performance
- 9 June 2025
- Published by Association for Computing Machinery (ACM)
- p. 122-133
Open AccessImpact of Network Topologies on Blockchain Performance
- 17 December 2024
- Published by Springer Nature in Network Modeling Analysis in Health Informatics and Bioinformatics
- Vol. 14 (1) , 1-12
A prevalence-robust measure of diagnostic test performance
- 17 December 2024
- Published by Springer Nature in Network Modeling Analysis in Health Informatics and Bioinformatics
- Vol. 14 (1) , 1-12
A prevalence-robust measure of diagnostic test performance
- Open Access
- 20 March 2023
- Published by Springer Nature in European Radiology Experimental
- Vol. 7 (1) , 1-7
An information-oriented paradigm in evaluating accuracy and agreement in radiology
The goal of any radiological diagnostic process is to gain information about the patient’s status. However, the mathematical notion of information is usually not adopted to measure the performance of a diagnostic test or the agreement among readers in providing a certain diagnosis. Indeed, commonly used metrics for assessing diagnostic accuracy (e.g., sensitivity and specificity) or inter-reader agreement (Cohen $$\kappa$$ statistics) use confusion matrices containing the number of true- and false positives/negatives results of a test, or the number of concordant/discordant categorizations, respectively, thus lacking proper information content. We present a methodological paradigm, based on Shannon’s information theory, aiming to measure both accuracy and agreement in diagnostic radiology. This approach models the information flow as a “diagnostic channel” connecting the state of the patient’s disease and the radiologist or, in the case of agreement analysis, as an “agreement channel” linking two or more radiologists evaluating the same set of images. For both cases, we proposed some measures, derived from Shannon’s mutual information, which can represent an alternative way to express diagnostic accuracy and agreement in radiology.Key points• Diagnostic processes can be modeled with information theory (IT).• IT metrics of diagnostic accuracy are independent from disease prevalence.• IT metrics of inter-reader agreements can overcome Cohen κ pitfalls.- 20 March 2023
- Published by Springer Nature in European Radiology Experimental
- Vol. 7 (1) , 1-7
Open AccessAn information-oriented paradigm in evaluating accuracy and agreement in radiology
The goal of any radiological diagnostic process is to gain information about the patient’s status. However, the mathematical notion of information is usually not adopted to measure the performance of a diagnostic test or the agreement among readers in providing a certain diagnosis. Indeed, commonly used metrics for assessing diagnostic accuracy (e.g., sensitivity and specificity) or inter-reader agreement (Cohen $$\kappa$$ statistics) use confusion matrices containing the number of true- and false positives/negatives results of a test, or the number of concordant/discordant categorizations, respectively, thus lacking proper information content. We present a methodological paradigm, based on Shannon’s information theory, aiming to measure both accuracy and agreement in diagnostic radiology. This approach models the information flow as a “diagnostic channel” connecting the state of the patient’s disease and the radiologist or, in the case of agreement analysis, as an “agreement channel” linking two or more radiologists evaluating the same set of images. For both cases, we proposed some measures, derived from Shannon’s mutual information, which can represent an alternative way to express diagnostic accuracy and agreement in radiology.Key points• Diagnostic processes can be modeled with information theory (IT).• IT metrics of diagnostic accuracy are independent from disease prevalence.• IT metrics of inter-reader agreements can overcome Cohen κ pitfalls. - Open Access
- 23 February 2022
- Published by Springer Nature in Medical & Biological Engineering & Computing
- Vol. 60 (4) , 941-955
Fifty years of Shannon information theory in assessing the accuracy and agreement of diagnostic tests
Since 1948, Shannon theoretic methods for modeling information have found a wide range of applications in several areas where information plays a key role, which goes well beyond the original scopes for which they have been conceived, namely data compression and error correction over a noisy channel. Among other uses, these methods have been applied in the broad field of medical diagnostics since the 1970s, to quantify diagnostic information, to evaluate diagnostic test performance, but also to be used as technical tools in image processing and registration. This review illustrates the main contributions in assessing the accuracy of diagnostic tests and the agreement between raters, focusing on diagnostic test performance measurements and paired agreement evaluation. This work also presents a recent unified, coherent, and hopefully, final information-theoretical approach to deal with the flows of information involved among the patient, the diagnostic test performed to appraise the state of disease, and the raters who are checking the test results. The approach is assessed by considering two case studies: the first one is related to evaluating extra-prostatic cancers; the second concerns the quality of rapid tests for COVID-19 detection.
- 23 February 2022
- Published by Springer Nature in Medical & Biological Engineering & Computing
- Vol. 60 (4) , 941-955
Open AccessFifty years of Shannon information theory in assessing the accuracy and agreement of diagnostic tests
Since 1948, Shannon theoretic methods for modeling information have found a wide range of applications in several areas where information plays a key role, which goes well beyond the original scopes for which they have been conceived, namely data compression and error correction over a noisy channel. Among other uses, these methods have been applied in the broad field of medical diagnostics since the 1970s, to quantify diagnostic information, to evaluate diagnostic test performance, but also to be used as technical tools in image processing and registration. This review illustrates the main contributions in assessing the accuracy of diagnostic tests and the agreement between raters, focusing on diagnostic test performance measurements and paired agreement evaluation. This work also presents a recent unified, coherent, and hopefully, final information-theoretical approach to deal with the flows of information involved among the patient, the diagnostic test performed to appraise the state of disease, and the raters who are checking the test results. The approach is assessed by considering two case studies: the first one is related to evaluating extra-prostatic cancers; the second concerns the quality of rapid tests for COVID-19 detection.
- 29 December 2021
- Published by Springer Nature in Journal of Clinical Monitoring and Computing
- Vol. 36 (5) , 1499-1508
Pressure-flow breath representation eases asynchrony identification in mechanically ventilated patients
Breathing asynchronies are mismatches between the requests of mechanically ventilated subjects and the support provided by mechanical ventilators. The most widespread technique in identifying these pathological conditions is the visual analysis of the intra-tracheal pressure and flow time-trends. This work considers a recently introduced pressure-flow representation technique and investigates whether it can help nurses in the early detection of anomalies that can represent asynchronies. Twenty subjects—ten Intensive Care Unit (ICU) nurses and ten persons inexperienced in medical practice—were asked to find asynchronies in 200 breaths pre-labeled by three experts. The new representation increases significantly the detection capability of the subjects—average sensitivity soared from 0.622 to 0.905—while decreasing the classification time—from 1107.0 to 567.1 s on average—at the price of a not statistically significant rise in the number of wrong identifications—specificity average descended from 0.589 to 0.52. Moreover, the differences in experience between the nurse group and the inexperienced group do not affect the sensitivity, specificity, or classification times. The pressure-flow diagram significantly increases sensitivity and decreases the response time of early asynchrony detection performed by nurses. Moreover, the data suggest that operator experience does not affect the identification results. This outcome leads us to believe that, in emergency contexts with a shortage of nurses, intensive care nurses can be supplemented, for the sole identification of possible respiratory asynchronies, by inexperienced staff.
- 29 December 2021
- Published by Springer Nature in Journal of Clinical Monitoring and Computing
- Vol. 36 (5) , 1499-1508
Pressure-flow breath representation eases asynchrony identification in mechanically ventilated patients
Breathing asynchronies are mismatches between the requests of mechanically ventilated subjects and the support provided by mechanical ventilators. The most widespread technique in identifying these pathological conditions is the visual analysis of the intra-tracheal pressure and flow time-trends. This work considers a recently introduced pressure-flow representation technique and investigates whether it can help nurses in the early detection of anomalies that can represent asynchronies. Twenty subjects—ten Intensive Care Unit (ICU) nurses and ten persons inexperienced in medical practice—were asked to find asynchronies in 200 breaths pre-labeled by three experts. The new representation increases significantly the detection capability of the subjects—average sensitivity soared from 0.622 to 0.905—while decreasing the classification time—from 1107.0 to 567.1 s on average—at the price of a not statistically significant rise in the number of wrong identifications—specificity average descended from 0.589 to 0.52. Moreover, the differences in experience between the nurse group and the inexperienced group do not affect the sensitivity, specificity, or classification times. The pressure-flow diagram significantly increases sensitivity and decreases the response time of early asynchrony detection performed by nurses. Moreover, the data suggest that operator experience does not affect the identification results. This outcome leads us to believe that, in emergency contexts with a shortage of nurses, intensive care nurses can be supplemented, for the sole identification of possible respiratory asynchronies, by inexperienced staff.
- 16 December 2020
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1432-1439
Extending Information Agreement by Continuity
Agreement measures are useful metrics to both compare different evaluations of the same diagnostic outcomes and validate new rating systems or devices. While many of them have been proposed in the literature so far, Cohen's n is still the de facto standard in gauging the agreement.Information Agreement (IA) is a novel two-observers information-theoretic-based metric introduced to overcome all the limitations and alleged pitfalls of Cohen's n. It offers an operative meaning to the agreement since it measures - in both dichotomous and multi-value ordered-categorical cases-the information shared between two raters through the virtual diagnostic channel connecting them: the more information exchanged between the raters, the higher their agreement. Unfortunately, this measure is only able to deal with agreement matrices whose values are all strictly positive numbers.This work extends IA by admitting also 0 as a possible value for the entries of an agreement matrix. Moreover, a Python software library to compute the extended version of IA, together with some of the most used agreement measures, is presented and tested.
- 16 December 2020
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1432-1439
Extending Information Agreement by Continuity
Agreement measures are useful metrics to both compare different evaluations of the same diagnostic outcomes and validate new rating systems or devices. While many of them have been proposed in the literature so far, Cohen's n is still the de facto standard in gauging the agreement.Information Agreement (IA) is a novel two-observers information-theoretic-based metric introduced to overcome all the limitations and alleged pitfalls of Cohen's n. It offers an operative meaning to the agreement since it measures - in both dichotomous and multi-value ordered-categorical cases-the information shared between two raters through the virtual diagnostic channel connecting them: the more information exchanged between the raters, the higher their agreement. Unfortunately, this measure is only able to deal with agreement matrices whose values are all strictly positive numbers.This work extends IA by admitting also 0 as a possible value for the entries of an agreement matrix. Moreover, a Python software library to compute the extended version of IA, together with some of the most used agreement measures, is presented and tested.
- Open Access
- 3 November 2020
- Published by Springer Nature in Medical & Biological Engineering & Computing
- Vol. 58 (12) , 3089-3099
Beyond kappa: an informational index for diagnostic agreement in dichotomous and multivalue ordered-categorical ratings
Agreement measures are useful tools to both compare different evaluations of the same diagnostic outcomes and validate new rating systems or devices. Cohen’s kappa (κ) certainly is the most popular agreement method between two raters, and proved its effectiveness in the last sixty years. In spite of that, this method suffers from some alleged issues, which have been highlighted since the 1970s; moreover, its value is strongly dependent on the prevalence of the disease in the considered sample. This work introduces a new agreement index, the informational agreement (IA), which seems to avoid some of Cohen’s kappa’s flaws, and separates the contribution of the prevalence from the nucleus of agreement. These goals are achieved by modelling the agreement—in both dichotomous and multivalue ordered-categorical cases—as the information shared between two raters through the virtual diagnostic channel connecting them: the more information exchanged between the raters, the higher their agreement. In order to test its fair behaviour and the effectiveness of the method, IA has been tested on some cases known to be problematic for κ, in the machine learning context and in a clinical scenario to compare ultrasound (US) and automated breast volume scanner (ABVS) in the setting of breast cancer imaging.
- 3 November 2020
- Published by Springer Nature in Medical & Biological Engineering & Computing
- Vol. 58 (12) , 3089-3099
Open AccessBeyond kappa: an informational index for diagnostic agreement in dichotomous and multivalue ordered-categorical ratings
Agreement measures are useful tools to both compare different evaluations of the same diagnostic outcomes and validate new rating systems or devices. Cohen’s kappa (κ) certainly is the most popular agreement method between two raters, and proved its effectiveness in the last sixty years. In spite of that, this method suffers from some alleged issues, which have been highlighted since the 1970s; moreover, its value is strongly dependent on the prevalence of the disease in the considered sample. This work introduces a new agreement index, the informational agreement (IA), which seems to avoid some of Cohen’s kappa’s flaws, and separates the contribution of the prevalence from the nucleus of agreement. These goals are achieved by modelling the agreement—in both dichotomous and multivalue ordered-categorical cases—as the information shared between two raters through the virtual diagnostic channel connecting them: the more information exchanged between the raters, the higher their agreement. In order to test its fair behaviour and the effectiveness of the method, IA has been tested on some cases known to be problematic for κ, in the machine learning context and in a clinical scenario to compare ultrasound (US) and automated breast volume scanner (ABVS) in the setting of breast cancer imaging.