Fiammetta Menchetti
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Fiammetta Menchetti has a total of 10 co-authors. Here are the top co-authors by number of shared publications:
Iavor Bojinov
Harvard University - Technology & Operations Management Unit
2 shared publications- Bruno Bertaccini
University of Florence, IT
1 shared publication Christine Choirat
Swiss Data Science Center, ETH Zürich and EPFL, Lausanne & Institute of Global Health, Faculty of medicine, University of Geneva, Geneva, Switzerland
1 shared publicationCorwin M. Zigler
Department of Statistics and Data Sciences, Department of Women’s Health, University of Texas at Austin, Austin, USA
1 shared publication- Fabrizia Mealli
Department of Statistics, Computer Science, Applications, University of Florence, Florence, Italy
1 shared publication - Fabrizio Cipollini
Department of Statistics, Computer Science, Applications, University of Florence
1 shared publication
Latest Publications
- 10 February 2026
- Published by Taylor & Francis in Technometrics
- Vol. 68 (3) , 1-15
Time Series Models for Cultural Heritage Preservation: The Case of the Brunelleschi’s Dome
- 10 February 2026
- Published by Taylor & Francis in Technometrics
- Vol. 68 (3) , 1-15
Time Series Models for Cultural Heritage Preservation: The Case of the Brunelleschi’s Dome
- Open Access
- 1 January 2024
- Published by Elsevier in SSRN Electronic Journal
Winner Take All: Exploiting Asymmetry in Factorial Designs
Researchers and practitioners have embraced factorial experiments to simultaneously test multiple treatments, each with different levels. With the rise of technologies like Generative AI, factorial experimentation has become even more accessible: it is easier than ever to generate different versions of potential treatments. Typically, in large-scale factorial experiments, the primary objective is to identify the treatment with the largest causal effect. This is especially true for experiments that suffer from measurement error, attrition, non-compliance, and censoring: point estimates are unreliable, but—as we show—the asymmetry in the largest treatment effect makes it possible to identify the most impactful treatment even when point estimates are biased. To exploit this asymmetry, we propose using a Fisher randomization test as a general non-parametric approach for inference, which we apply to an existing field experiment that measured intern performance at a large financial firm. We show that the earliest possible intervention has an immediate and enduring impact: performance improves in the week of the intervention and in future weeks, sometimes even to a greater extent than interventions in those future weeks. The takeaway—intervene early—has important consequences across the many contexts of workplace programs.
- 1 January 2024
- Published by Elsevier in SSRN Electronic Journal
Open AccessWinner Take All: Exploiting Asymmetry in Factorial Designs
Researchers and practitioners have embraced factorial experiments to simultaneously test multiple treatments, each with different levels. With the rise of technologies like Generative AI, factorial experimentation has become even more accessible: it is easier than ever to generate different versions of potential treatments. Typically, in large-scale factorial experiments, the primary objective is to identify the treatment with the largest causal effect. This is especially true for experiments that suffer from measurement error, attrition, non-compliance, and censoring: point estimates are unreliable, but—as we show—the asymmetry in the largest treatment effect makes it possible to identify the most impactful treatment even when point estimates are biased. To exploit this asymmetry, we propose using a Fisher randomization test as a general non-parametric approach for inference, which we apply to an existing field experiment that measured intern performance at a large financial firm. We show that the earliest possible intervention has an immediate and enduring impact: performance improves in the week of the intervention and in future weeks, sometimes even to a greater extent than interventions in those future weeks. The takeaway—intervene early—has important consequences across the many contexts of workplace programs.
- 5 January 2023
- Published by Springer Nature in Health Services and Outcomes Research Methodology
- Vol. 23 (4) , 433-451
Evaluating federal policies using Bayesian time series models: estimating the causal impact of the hospital readmissions reduction program
Researchers are often faced with evaluating the effect of a policy or program that was simultaneously initiated across an entire population of units at a single point in time, and its effects over the targeted population can manifest at any time period afterwards. In the presence of data measured over time, Bayesian time series models have been used to impute what would have happened after the policy was initiated, had the policy not taken place, in order to estimate causal effects. However, the considerations regarding the definition of the target estimands, the underlying assumptions, the plausibility of such assumptions, and the choice of an appropriate model have not been thoroughly investigated. In this paper, we establish useful estimands for the evaluation of large-scale policies. We discuss that imputation of missing potential outcomes relies on an assumption which, even though untestable, can be partially evaluated using observed data. We illustrate an approach to evaluate this key causal assumption and facilitate model elicitation based on data from the time interval before policy initiation and using classic statistical techniques. As an illustration, we study the Hospital Readmissions Reduction Program (HRRP), a US federal intervention aiming to improve health outcomes for patients with pneumonia, acute myocardial infraction, or congestive failure admitted to a hospital. We evaluate the effect of the HRRP on population mortality among the elderly across the US and in four geographic subregions, and at different time windows. We find that the HRRP increased mortality from pneumonia and acute myocardial infraction across at least one geographical region and time horizon, and is likely to have had a detrimental effect on public health.
- 5 January 2023
- Published by Springer Nature in Health Services and Outcomes Research Methodology
- Vol. 23 (4) , 433-451
Evaluating federal policies using Bayesian time series models: estimating the causal impact of the hospital readmissions reduction program
Researchers are often faced with evaluating the effect of a policy or program that was simultaneously initiated across an entire population of units at a single point in time, and its effects over the targeted population can manifest at any time period afterwards. In the presence of data measured over time, Bayesian time series models have been used to impute what would have happened after the policy was initiated, had the policy not taken place, in order to estimate causal effects. However, the considerations regarding the definition of the target estimands, the underlying assumptions, the plausibility of such assumptions, and the choice of an appropriate model have not been thoroughly investigated. In this paper, we establish useful estimands for the evaluation of large-scale policies. We discuss that imputation of missing potential outcomes relies on an assumption which, even though untestable, can be partially evaluated using observed data. We illustrate an approach to evaluate this key causal assumption and facilitate model elicitation based on data from the time interval before policy initiation and using classic statistical techniques. As an illustration, we study the Hospital Readmissions Reduction Program (HRRP), a US federal intervention aiming to improve health outcomes for patients with pneumonia, acute myocardial infraction, or congestive failure admitted to a hospital. We evaluate the effect of the HRRP on population mortality among the elderly across the US and in four geographic subregions, and at different time windows. We find that the HRRP increased mortality from pneumonia and acute myocardial infraction across at least one geographical region and time horizon, and is likely to have had a detrimental effect on public health.
- Open Access
- 2 October 2020
- Published by Elsevier in SSRN Electronic Journal
Estimating Causal Effects in the Presence of Partial Interference Using Multivariate Bayesian Structural Time Series Models
Researchers regularly use synthetic control methods for estimating causal effects when a sub-set of units receive a single persistent treatment, and the rest are unaffected by the change. In many applications, however, units not assigned to treatment are nevertheless impacted by the intervention because of cross-unit interactions. This paper extends the synthetic control methods to accommodate partial interference, allowing interactions within predefined groups, but not between them. Focusing on a class of causal estimands that capture the effect both on the treated and control units, we develop a multivariate Bayesian structural time series model for generating synthetic controls that would have occurred in the absence of an intervention enabling us to estimate our novel effects. In a simulation study, we explore our Bayesian procedure’s empirical properties and show that it achieves good frequentists coverage even when the model is misspecified. Our work is motivated by an analysis of a marketing campaign’s effectiveness by an Italian supermarket chain that permanently reduced the price of hundreds of store-brand products. We use our new methodology to make causal statements about the impact on sales of the affected store-brands and their direct competitors. Our proposed approach is implemented in the CausalMBSTS R package.
- 2 October 2020
- Published by Elsevier in SSRN Electronic Journal
Open AccessEstimating Causal Effects in the Presence of Partial Interference Using Multivariate Bayesian Structural Time Series Models
Researchers regularly use synthetic control methods for estimating causal effects when a sub-set of units receive a single persistent treatment, and the rest are unaffected by the change. In many applications, however, units not assigned to treatment are nevertheless impacted by the intervention because of cross-unit interactions. This paper extends the synthetic control methods to accommodate partial interference, allowing interactions within predefined groups, but not between them. Focusing on a class of causal estimands that capture the effect both on the treated and control units, we develop a multivariate Bayesian structural time series model for generating synthetic controls that would have occurred in the absence of an intervention enabling us to estimate our novel effects. In a simulation study, we explore our Bayesian procedure’s empirical properties and show that it achieves good frequentists coverage even when the model is misspecified. Our work is motivated by an analysis of a marketing campaign’s effectiveness by an Italian supermarket chain that permanently reduced the price of hundreds of store-brand products. We use our new methodology to make causal statements about the impact on sales of the affected store-brands and their direct competitors. Our proposed approach is implemented in the CausalMBSTS R package.