FMFiammetta Menchetti

Fiammetta Menchetti

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Fiammetta Menchetti has a total of 10 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Time Series Models for Cultural Heritage Preservation: The Case of the Brunelleschi’s Dome

    by Fiammetta Menchetti, Silvia Bacci, Fabrizio Cipollini, Bruno Bertaccini

  • Open Access

    Winner Take All: Exploiting Asymmetry in Factorial Designs

    by Matthew DosSantos DiSorbo, Iavor Bojinov, Fiammetta Menchetti

    Researchers and practitioners have embraced factorial experiments to simultaneously test multiple treatments, each with different levels. With the rise of technologies like Generative AI, factorial experimentation has become even more accessible: it is easier than ever to generate different versions of potential treatments. Typically, in large-scale factorial experiments, the primary objective is to identify the treatment with the largest causal effect. This is especially true for experiments that suffer from measurement error, attrition, non-compliance, and censoring: point estimates are unreliable, but—as we show—the asymmetry in the largest treatment effect makes it possible to identify the most impactful treatment even when point estimates are biased. To exploit this asymmetry, we propose using a Fisher randomization test as a general non-parametric approach for inference, which we apply to an existing field experiment that measured intern performance at a large financial firm. We show that the earliest possible intervention has an immediate and enduring impact: performance improves in the week of the intervention and in future weeks, sometimes even to a greater extent than interventions in those future weeks. The takeaway—intervene early—has important consequences across the many contexts of workplace programs.

  • Evaluating federal policies using Bayesian time series models: estimating the causal impact of the hospital readmissions reduction program

    by Georgia Papadogeorgou, Fiammetta Menchetti, Christine Choirat, Jason H. Wasfy, Corwin M. Zigler, Fabrizia Mealli

    Researchers are often faced with evaluating the effect of a policy or program that was simultaneously initiated across an entire population of units at a single point in time, and its effects over the targeted population can manifest at any time period afterwards. In the presence of data measured over time, Bayesian time series models have been used to impute what would have happened after the policy was initiated, had the policy not taken place, in order to estimate causal effects. However, the considerations regarding the definition of the target estimands, the underlying assumptions, the plausibility of such assumptions, and the choice of an appropriate model have not been thoroughly investigated. In this paper, we establish useful estimands for the evaluation of large-scale policies. We discuss that imputation of missing potential outcomes relies on an assumption which, even though untestable, can be partially evaluated using observed data. We illustrate an approach to evaluate this key causal assumption and facilitate model elicitation based on data from the time interval before policy initiation and using classic statistical techniques. As an illustration, we study the Hospital Readmissions Reduction Program (HRRP), a US federal intervention aiming to improve health outcomes for patients with pneumonia, acute myocardial infraction, or congestive failure admitted to a hospital. We evaluate the effect of the HRRP on population mortality among the elderly across the US and in four geographic subregions, and at different time windows. We find that the HRRP increased mortality from pneumonia and acute myocardial infraction across at least one geographical region and time horizon, and is likely to have had a detrimental effect on public health.


  • Open Access

    Estimating Causal Effects in the Presence of Partial Interference Using Multivariate Bayesian Structural Time Series Models

    by Fiammetta Menchetti, Iavor Bojinov

    Researchers regularly use synthetic control methods for estimating causal effects when a sub-set of units receive a single persistent treatment, and the rest are unaffected by the change. In many applications, however, units not assigned to treatment are nevertheless impacted by the intervention because of cross-unit interactions. This paper extends the synthetic control methods to accommodate partial interference, allowing interactions within predefined groups, but not between them. Focusing on a class of causal estimands that capture the effect both on the treated and control units, we develop a multivariate Bayesian structural time series model for generating synthetic controls that would have occurred in the absence of an intervention enabling us to estimate our novel effects. In a simulation study, we explore our Bayesian procedure’s empirical properties and show that it achieves good frequentists coverage even when the model is misspecified. Our work is motivated by an analysis of a marketing campaign’s effectiveness by an Italian supermarket chain that permanently reduced the price of hundreds of store-brand products. We use our new methodology to make causal statements about the impact on sales of the affected store-brands and their direct competitors. Our proposed approach is implemented in the CausalMBSTS R package.