Ivana Malenica
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Ivana Malenica has a total of 229 co-authors. Here are the top co-authors by number of shared publications:
- Nima S. Hejazi
Department of Biostatistics, Harvard University, Cambridge, Massachusetts, USA
7 shared publications - Alan E. Hubbard
School of Public Health, University of California, Berkeley, Berkeley, CA USA
6 shared publications Mark J. van der Laan
Division of Epidemiology and Biostatistics, University of California, Berkeley, Berkeley, USA
6 shared publicationsSonali Rosete
Division of Epidemiology and Biostatistics, University of California, Berkeley, Berkeley, USA
6 shared publications- Andrew Mertens
University of California, Berkeley
5 shared publications - Anna Nguyen
Stanford University
5 shared publications
Latest Publications
- Open Access
- 29 November 2024
- Published by Oxford University Press (OUP) in Journal of the Royal Statistical Society Series C: Applied Statistics
- Vol. 74 (3) , 617-637
Personalized dynamic super learning: an application in predicting hemodiafiltration convection volumes
Obtaining continuously updated predictions is a major challenge for personalized medicine. Leveraging combinations of parametric regressions and machine learning algorithms, the personalized online super learner (POSL) can achieve such dynamic and personalized predictions. We adapt POSL to predict a repeated continuous outcome dynamically and propose a new way to validate such personalized or dynamic prediction models. We illustrate its performance by predicting the convection volume of patients undergoing hemodiafiltration. POSL outperformed its candidate learners with respect to median absolute error, calibration-in-the-large, discrimination, and net benefit. We finally discuss the choices and challenges underlying the use of POSL.
- 29 November 2024
- Published by Oxford University Press (OUP) in Journal of the Royal Statistical Society Series C: Applied Statistics
- Vol. 74 (3) , 617-637
Open AccessPersonalized dynamic super learning: an application in predicting hemodiafiltration convection volumes
Obtaining continuously updated predictions is a major challenge for personalized medicine. Leveraging combinations of parametric regressions and machine learning algorithms, the personalized online super learner (POSL) can achieve such dynamic and personalized predictions. We adapt POSL to predict a repeated continuous outcome dynamically and propose a new way to validate such personalized or dynamic prediction models. We illustrate its performance by predicting the convection volume of patients undergoing hemodiafiltration. POSL outperformed its candidate learners with respect to median absolute error, calibration-in-the-large, discrimination, and net benefit. We finally discuss the choices and challenges underlying the use of POSL.
- 26 June 2024
- Published by Oxford University Press (OUP) in Clinical Infectious Diseases
- Vol. 79 (5) , 1182-1189
Remdesivir for Treatment of COVID-19 Requiring Oxygen Support: A Cross-Study Comparison From 2 Large, Open-Label Studies
Background: Remdesivir, an RNA-polymerase prodrug inhibitor approved for treatment of coronavirus disease 2019 (COVID-19), shortens recovery time and improves clinical outcomes. This prespecified analysis compared remdesivir plus standard of care (SOC) with SOC alone in adults hospitalized with COVID-19 requiring oxygen support in the early stage of the pandemic. Methods: Data for 10-day remdesivir treatment plus SOC from the extension phase of an open-label study (NCT04292899) were compared with real-world, retrospective data on SOC alone (EUPAS34303). Both studies included patients aged ≥18 years hospitalized with severe acute respiratory syndrome coronavirus 2 up to 30 May 2020, with oxygen saturation ≤94% on room air or supplemental oxygen (all forms), and with pulmonary infiltrates. Propensity score weighting was used to balance patient demographics and clinical characteristics across treatment groups. The primary endpoint was time to all-cause mortality or end of study (day 28). Time to discharge, with a 10-day landmark to account for duration of remdesivir treatment, was a secondary endpoint. Results: A total of 1974 patients treated with remdesivir plus SOC, and 1426 with SOC alone, were included after weighting. Remdesivir significantly reduced mortality versus SOC (hazard ratio [HR], 0.46; 95% confidence interval, .39–.54). This association was observed at each oxygen support level, with the lowest HR for patients on low-flow oxygen. Remdesivir significantly increased the likelihood of discharge at day 28 versus SOC in the 10-day landmark analysis (HR, 1.64; 95% confidence interval: 1.43–1.87). Conclusions: Remdesivir plus early-2020 SOC was associated with a 54% lower mortality risk and shorter hospital stays compared with SOC alone in patients hospitalized with COVID-19 requiring oxygen support. Clinical Trials Registration. ClinicalTrials.gov NCT04292899 and EUPAS34303.
- 26 June 2024
- Published by Oxford University Press (OUP) in Clinical Infectious Diseases
- Vol. 79 (5) , 1182-1189
Remdesivir for Treatment of COVID-19 Requiring Oxygen Support: A Cross-Study Comparison From 2 Large, Open-Label Studies
Background: Remdesivir, an RNA-polymerase prodrug inhibitor approved for treatment of coronavirus disease 2019 (COVID-19), shortens recovery time and improves clinical outcomes. This prespecified analysis compared remdesivir plus standard of care (SOC) with SOC alone in adults hospitalized with COVID-19 requiring oxygen support in the early stage of the pandemic. Methods: Data for 10-day remdesivir treatment plus SOC from the extension phase of an open-label study (NCT04292899) were compared with real-world, retrospective data on SOC alone (EUPAS34303). Both studies included patients aged ≥18 years hospitalized with severe acute respiratory syndrome coronavirus 2 up to 30 May 2020, with oxygen saturation ≤94% on room air or supplemental oxygen (all forms), and with pulmonary infiltrates. Propensity score weighting was used to balance patient demographics and clinical characteristics across treatment groups. The primary endpoint was time to all-cause mortality or end of study (day 28). Time to discharge, with a 10-day landmark to account for duration of remdesivir treatment, was a secondary endpoint. Results: A total of 1974 patients treated with remdesivir plus SOC, and 1426 with SOC alone, were included after weighting. Remdesivir significantly reduced mortality versus SOC (hazard ratio [HR], 0.46; 95% confidence interval, .39–.54). This association was observed at each oxygen support level, with the lowest HR for patients on low-flow oxygen. Remdesivir significantly increased the likelihood of discharge at day 28 versus SOC in the 10-day landmark analysis (HR, 1.64; 95% confidence interval: 1.43–1.87). Conclusions: Remdesivir plus early-2020 SOC was associated with a 54% lower mortality risk and shorter hospital stays compared with SOC alone in patients hospitalized with COVID-19 requiring oxygen support. Clinical Trials Registration. ClinicalTrials.gov NCT04292899 and EUPAS34303.
- Open Access
- 29 January 2024
- Published by Oxford University Press (OUP) in Biometrics
- Vol. 80 (1)
Adaptive sequential surveillance with network and temporal dependence
Strategic test allocation is important for control of both emerging and existing pandemics (eg, COVID-19, HIV). It supports effective epidemic control by (1) reducing transmission via identifying cases and (2) tracking outbreak dynamics to inform targeted interventions. However, infectious disease surveillance presents unique statistical challenges. For instance, the true outcome of interest (positive infection status) is often a latent variable. In addition, presence of both network and temporal dependence reduces data to a single observation. In this work, we study an adaptive sequential design, which allows for unspecified dependence among individuals and across time. Our causal parameter is the mean latent outcome we would have obtained, if, starting at time t given the observed past, we had carried out a stochastic intervention that maximizes the outcome under a resource constraint. The key strength of the method is that we do not have to model network and time dependence: a short-term performance Online Super Learner is used to select among dependence models and randomization schemes. The proposed strategy learns the optimal choice of testing over time while adapting to the current state of the outbreak and learning across samples, through time, or both. We demonstrate the superior performance of the proposed strategy in an agent-based simulation modeling a residential university environment during the COVID-19 pandemic.
- 29 January 2024
- Published by Oxford University Press (OUP) in Biometrics
- Vol. 80 (1)
Open AccessAdaptive sequential surveillance with network and temporal dependence
Strategic test allocation is important for control of both emerging and existing pandemics (eg, COVID-19, HIV). It supports effective epidemic control by (1) reducing transmission via identifying cases and (2) tracking outbreak dynamics to inform targeted interventions. However, infectious disease surveillance presents unique statistical challenges. For instance, the true outcome of interest (positive infection status) is often a latent variable. In addition, presence of both network and temporal dependence reduces data to a single observation. In this work, we study an adaptive sequential design, which allows for unspecified dependence among individuals and across time. Our causal parameter is the mean latent outcome we would have obtained, if, starting at time t given the observed past, we had carried out a stochastic intervention that maximizes the outcome under a resource constraint. The key strength of the method is that we do not have to model network and time dependence: a short-term performance Online Super Learner is used to select among dependence models and randomization schemes. The proposed strategy learns the optimal choice of testing over time while adapting to the current state of the outbreak and learning across samples, through time, or both. We demonstrate the superior performance of the proposed strategy in an agent-based simulation modeling a residential university environment during the COVID-19 pandemic.
- Open Access
- 13 October 2023
- Published by Springer Nature in Nature
- Vol. 623 (7985) , E1
Author Correction: Child wasting and concurrent stunting in low- and middle-income countries
- 13 October 2023
- Published by Springer Nature in Nature
- Vol. 623 (7985) , E1
Open AccessAuthor Correction: Child wasting and concurrent stunting in low- and middle-income countries
- Top Cited PapersOpen Access
- 13 September 2023
- Published by Springer Nature in Nature
- Vol. 621 (7979) , 558-567
Child wasting and concurrent stunting in low- and middle-income countries
Sustainable Development Goal 2.2—to end malnutrition by 2030—includes the elimination of child wasting, defined as a weight-for-length z-score that is more than two standard deviations below the median of the World Health Organization standards for child growth1. Prevailing methods to measure wasting rely on cross-sectional surveys that cannot measure onset, recovery and persistence—key features that inform preventive interventions and estimates of disease burden. Here we analyse 21 longitudinal cohorts and show that wasting is a highly dynamic process of onset and recovery, with incidence peaking between birth and 3 months. Many more children experience an episode of wasting at some point during their first 24 months than prevalent cases at a single point in time suggest. For example, at the age of 24 months, 5.6% of children were wasted, but by the same age (24 months), 29.2% of children had experienced at least one wasting episode and 10.0% had experienced two or more episodes. Children who were wasted before the age of 6 months had a faster recovery and shorter episodes than did children who were wasted at older ages; however, early wasting increased the risk of later growth faltering, including concurrent wasting and stunting (low length-for-age z-score), and thus increased the risk of mortality. In diverse populations with high seasonal rainfall, the population average weight-for-length z-score varied substantially (more than 0.5 z in some cohorts), with the lowest mean z-scores occurring during the rainiest months; this indicates that seasonally targeted interventions could be considered. Our results show the importance of establishing interventions to prevent wasting from birth to the age of 6 months, probably through improved maternal nutrition, to complement current programmes that focus on children aged 6–59 months.
- 13 September 2023
- Published by Springer Nature in Nature
- Vol. 621 (7979) , 558-567
Top Cited PapersOpen AccessChild wasting and concurrent stunting in low- and middle-income countries
Sustainable Development Goal 2.2—to end malnutrition by 2030—includes the elimination of child wasting, defined as a weight-for-length z-score that is more than two standard deviations below the median of the World Health Organization standards for child growth1. Prevailing methods to measure wasting rely on cross-sectional surveys that cannot measure onset, recovery and persistence—key features that inform preventive interventions and estimates of disease burden. Here we analyse 21 longitudinal cohorts and show that wasting is a highly dynamic process of onset and recovery, with incidence peaking between birth and 3 months. Many more children experience an episode of wasting at some point during their first 24 months than prevalent cases at a single point in time suggest. For example, at the age of 24 months, 5.6% of children were wasted, but by the same age (24 months), 29.2% of children had experienced at least one wasting episode and 10.0% had experienced two or more episodes. Children who were wasted before the age of 6 months had a faster recovery and shorter episodes than did children who were wasted at older ages; however, early wasting increased the risk of later growth faltering, including concurrent wasting and stunting (low length-for-age z-score), and thus increased the risk of mortality. In diverse populations with high seasonal rainfall, the population average weight-for-length z-score varied substantially (more than 0.5 z in some cohorts), with the lowest mean z-scores occurring during the rainiest months; this indicates that seasonally targeted interventions could be considered. Our results show the importance of establishing interventions to prevent wasting from birth to the age of 6 months, probably through improved maternal nutrition, to complement current programmes that focus on children aged 6–59 months.
- Top Cited PapersOpen Access
- 13 September 2023
- Published by Springer Nature in Nature
- Vol. 621 (7979) , 568-576
Causes and consequences of child growth faltering in low-resource settings
Growth faltering in children (low length for age or low weight for length) during the first 1,000 days of life (from conception to 2 years of age) influences short-term and long-term health and survival1,2. Interventions such as nutritional supplementation during pregnancy and the postnatal period could help prevent growth faltering, but programmatic action has been insufficient to eliminate the high burden of stunting and wasting in low- and middle-income countries. Identification of age windows and population subgroups on which to focus will benefit future preventive efforts. Here we use a population intervention effects analysis of 33 longitudinal cohorts (83,671 children, 662,763 measurements) and 30 separate exposures to show that improving maternal anthropometry and child condition at birth accounted for population increases in length-for-agez-scores of up to 0.40 and weight-for-lengthz-scores of up to 0.15 by 24 months of age. Boys had consistently higher risk of all forms of growth faltering than girls. Early postnatal growth faltering predisposed children to subsequent and persistent growth faltering. Children with multiple growth deficits exhibited higher mortality rates from birth to 2 years of age than children without growth deficits (hazard ratios 1.9 to 8.7). The importance of prenatal causes and severe consequences for children who experienced early growth faltering support a focus on pre-conception and pregnancy as a key opportunity for new preventive interventions.
- 13 September 2023
- Published by Springer Nature in Nature
- Vol. 621 (7979) , 568-576
Top Cited PapersOpen AccessCauses and consequences of child growth faltering in low-resource settings
Growth faltering in children (low length for age or low weight for length) during the first 1,000 days of life (from conception to 2 years of age) influences short-term and long-term health and survival1,2. Interventions such as nutritional supplementation during pregnancy and the postnatal period could help prevent growth faltering, but programmatic action has been insufficient to eliminate the high burden of stunting and wasting in low- and middle-income countries. Identification of age windows and population subgroups on which to focus will benefit future preventive efforts. Here we use a population intervention effects analysis of 33 longitudinal cohorts (83,671 children, 662,763 measurements) and 30 separate exposures to show that improving maternal anthropometry and child condition at birth accounted for population increases in length-for-agez-scores of up to 0.40 and weight-for-lengthz-scores of up to 0.15 by 24 months of age. Boys had consistently higher risk of all forms of growth faltering than girls. Early postnatal growth faltering predisposed children to subsequent and persistent growth faltering. Children with multiple growth deficits exhibited higher mortality rates from birth to 2 years of age than children without growth deficits (hazard ratios 1.9 to 8.7). The importance of prenatal causes and severe consequences for children who experienced early growth faltering support a focus on pre-conception and pregnancy as a key opportunity for new preventive interventions.
- Open Access
Multi-task Highly Adaptive Lasso
We propose a novel, fully nonparametric approach for the multi-task learning, the Multi-task Highly Adaptive Lasso (MT-HAL). MT-HAL simultaneously learns features, samples and task associations important for the common model, while imposing a shared sparse structure among similar tasks. Given multiple tasks, our approach automatically finds a sparse sharing structure. The proposed MTL algorithm attains a powerful dimension-free convergence rate of $o_p(n^{-1/4})$ or better. We show that MT-HAL outperforms sparsity-based MTL competitors across a wide range of simulation studies, including settings with nonlinear and linear relationships, varying levels of sparsity and task correlations, and different numbers of covariates and sample size.Open AccessMulti-task Highly Adaptive Lasso
We propose a novel, fully nonparametric approach for the multi-task learning, the Multi-task Highly Adaptive Lasso (MT-HAL). MT-HAL simultaneously learns features, samples and task associations important for the common model, while imposing a shared sparse structure among similar tasks. Given multiple tasks, our approach automatically finds a sparse sharing structure. The proposed MTL algorithm attains a powerful dimension-free convergence rate of $o_p(n^{-1/4})$ or better. We show that MT-HAL outperforms sparsity-based MTL competitors across a wide range of simulation studies, including settings with nonlinear and linear relationships, varying levels of sparsity and task correlations, and different numbers of covariates and sample size. - 16 January 2023
- Published by Wiley in Statistics in Medicine
- Vol. 42 (7) , 1013-1044
Personalized online ensemble machine learning with applications for dynamic data streams
In this work we introduce the personalized online super learner (POSL), an online personalizable ensemble machine learning algorithm for streaming data. POSL optimizes predictions with respect to baseline covariates, so personalization can vary from completely individualized, that is, optimization with respect to subject ID, to many individuals, that is, optimization with respect to common baseline covariates. As an online algorithm, POSL learns in real time. As a super learner, POSL is grounded in statistical optimality theory and can leverage a diversity of candidate algorithms, including online algorithms with different training and update times, fixed/offline algorithms that are not updated during POSL's fitting procedure, pooled algorithms that learn from many individuals' time series, and individualized algorithms that learn from within a single time series. POSL's ensembling of the candidates can depend on the amount of data collected, the stationarity of the time series, and the mutual characteristics of a group of time series. Depending on the underlying data‐generating process and the information available in the data, POSL is able to adapt to learning across samples, through time, or both. For a range of simulations that reflect realistic forecasting scenarios and in a medical application, we examine the performance of POSL relative to other current ensembling and online learning methods. We show that POSL is able to provide reliable predictions for both short and long time series, and it's able to adjust to changing data‐generating environments. We further cultivate POSL's practicality by extending it to settings where time series dynamically enter and exit.
- 16 January 2023
- Published by Wiley in Statistics in Medicine
- Vol. 42 (7) , 1013-1044
Personalized online ensemble machine learning with applications for dynamic data streams
In this work we introduce the personalized online super learner (POSL), an online personalizable ensemble machine learning algorithm for streaming data. POSL optimizes predictions with respect to baseline covariates, so personalization can vary from completely individualized, that is, optimization with respect to subject ID, to many individuals, that is, optimization with respect to common baseline covariates. As an online algorithm, POSL learns in real time. As a super learner, POSL is grounded in statistical optimality theory and can leverage a diversity of candidate algorithms, including online algorithms with different training and update times, fixed/offline algorithms that are not updated during POSL's fitting procedure, pooled algorithms that learn from many individuals' time series, and individualized algorithms that learn from within a single time series. POSL's ensembling of the candidates can depend on the amount of data collected, the stationarity of the time series, and the mutual characteristics of a group of time series. Depending on the underlying data‐generating process and the information available in the data, POSL is able to adapt to learning across samples, through time, or both. For a range of simulations that reflect realistic forecasting scenarios and in a medical application, we examine the performance of POSL relative to other current ensembling and online learning methods. We show that POSL is able to provide reliable predictions for both short and long time series, and it's able to adjust to changing data‐generating environments. We further cultivate POSL's practicality by extending it to settings where time series dynamically enter and exit.
- Open Access
Adaptive Sequential Surveillance with Network and Temporal Dependence
Strategic test allocation plays a major role in the control of both emerging and existing pandemics (e.g., COVID-19, HIV). Widespread testing supports effective epidemic control by (1) reducing transmission via identifying cases, and (2) tracking outbreak dynamics to inform targeted interventions. However, infectious disease surveillance presents unique statistical challenges. For instance, the true outcome of interest - one's positive infectious status, is often a latent variable. In addition, presence of both network and temporal dependence reduces the data to a single observation. As testing entire populations regularly is neither efficient nor feasible, standard approaches to testing recommend simple rule-based testing strategies (e.g., symptom based, contact tracing), without taking into account individual risk. In this work, we study an adaptive sequential design involving n individuals over a period of {\tau} time-steps, which allows for unspecified dependence among individuals and across time. Our causal target parameter is the mean latent outcome we would have obtained after one time-step, if, starting at time t given the observed past, we had carried out a stochastic intervention that maximizes the outcome under a resource constraint. We propose an Online Super Learner for adaptive sequential surveillance that learns the optimal choice of tests strategies over time while adapting to the current state of the outbreak. Relying on a series of working models, the proposed method learns across samples, through time, or both: based on the underlying (unknown) structure in the data. We present an identification result for the latent outcome in terms of the observed data, and demonstrate the superior performance of the proposed strategy in a simulation modeling a residential university environment during the COVID-19 pandemic.
Open AccessAdaptive Sequential Surveillance with Network and Temporal Dependence
Strategic test allocation plays a major role in the control of both emerging and existing pandemics (e.g., COVID-19, HIV). Widespread testing supports effective epidemic control by (1) reducing transmission via identifying cases, and (2) tracking outbreak dynamics to inform targeted interventions. However, infectious disease surveillance presents unique statistical challenges. For instance, the true outcome of interest - one's positive infectious status, is often a latent variable. In addition, presence of both network and temporal dependence reduces the data to a single observation. As testing entire populations regularly is neither efficient nor feasible, standard approaches to testing recommend simple rule-based testing strategies (e.g., symptom based, contact tracing), without taking into account individual risk. In this work, we study an adaptive sequential design involving n individuals over a period of {\tau} time-steps, which allows for unspecified dependence among individuals and across time. Our causal target parameter is the mean latent outcome we would have obtained after one time-step, if, starting at time t given the observed past, we had carried out a stochastic intervention that maximizes the outcome under a resource constraint. We propose an Online Super Learner for adaptive sequential surveillance that learns the optimal choice of tests strategies over time while adapting to the current state of the outbreak. Relying on a series of working models, the proposed method learns across samples, through time, or both: based on the underlying (unknown) structure in the data. We present an identification result for the latent outcome in terms of the observed data, and demonstrate the superior performance of the proposed strategy in a simulation modeling a residential university environment during the COVID-19 pandemic.
- 16 February 2022
- Published by Wiley in Statistics in Medicine
- Vol. 41 (12) , 2132-2165
Evaluating the robustness of targeted maximum likelihood estimators via realistic simulations in nutrition intervention trials
Several recently developed methods have the potential to harness machine learning in the pursuit of target quantities inspired by causal inference, including inverse weighting, doubly robust estimating equations and substitution estimators like targeted maximum likelihood estimation. There are even more recent augmentations of these procedures that can increase robustness, by adding a layer of cross‐validation (cross‐validated targeted maximum likelihood estimation and double machine learning, as applied to substitution and estimating equation approaches, respectively). While these methods have been evaluated individually on simulated and experimental data sets, a comprehensive analysis of their performance across real data based simulations have yet to be conducted. In this work, we benchmark multiple widely used methods for estimation of the average treatment effect using ten different nutrition intervention studies data. A nonparametric regression method, undersmoothed highly adaptive lasso, is used to generate the simulated distribution which preserves important features from the observed data and reproduces a set of true target parameters. For each simulated data, we apply the methods above to estimate the average treatment effects as well as their standard errors and resulting confidence intervals. Based on the analytic results, a general recommendation is put forth for use of the cross‐validated variants of both substitution and estimating equation estimators. We conclude that the additional layer of cross‐validation helps in avoiding unintentional over‐fitting of nuisance parameter functionals and leads to more robust inferences.
- 16 February 2022
- Published by Wiley in Statistics in Medicine
- Vol. 41 (12) , 2132-2165
Evaluating the robustness of targeted maximum likelihood estimators via realistic simulations in nutrition intervention trials
Several recently developed methods have the potential to harness machine learning in the pursuit of target quantities inspired by causal inference, including inverse weighting, doubly robust estimating equations and substitution estimators like targeted maximum likelihood estimation. There are even more recent augmentations of these procedures that can increase robustness, by adding a layer of cross‐validation (cross‐validated targeted maximum likelihood estimation and double machine learning, as applied to substitution and estimating equation approaches, respectively). While these methods have been evaluated individually on simulated and experimental data sets, a comprehensive analysis of their performance across real data based simulations have yet to be conducted. In this work, we benchmark multiple widely used methods for estimation of the average treatment effect using ten different nutrition intervention studies data. A nonparametric regression method, undersmoothed highly adaptive lasso, is used to generate the simulated distribution which preserves important features from the observed data and reproduces a set of true target parameters. For each simulated data, we apply the methods above to estimate the average treatment effects as well as their standard errors and resulting confidence intervals. Based on the analytic results, a general recommendation is put forth for use of the cross‐validated variants of both substitution and estimating equation estimators. We conclude that the additional layer of cross‐validation helps in avoiding unintentional over‐fitting of nuisance parameter functionals and leads to more robust inferences.