Stefan Heyder
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Research Interests
Stefan Heyder has a total of 235 co-authors. Here are the top co-authors by number of shared publications:
- Daniel Wolffram
Karlsruhe Institute of Technology
7 shared publications - Thomas Hotz
TU Ilmenau, Institut für Mathematik, Ilmenau, Deutschland
7 shared publications - Johannes Bracher
Karlsruhe Institute of Technology
6 shared publications - Sebastian Funk
London School of Hygiene & Tropical Medicine
6 shared publications - Alexander Ullrich
Robert Koch Institute
5 shared publications - Ekaterina Krymova
Swiss Data Science Center
5 shared publications
Latest Publications
- Open Access
- 27 November 2023
- Published by Public Library of Science (PLoS) in PLOS Computational Biology
- Vol. 19 (11) , e1011653
Why are different estimates of the effective reproductive number so different? A case study on COVID-19 in Germany
The effective reproductive number Rt has taken a central role in the scientific, political, and public discussion during the COVID-19 pandemic, with numerous real-time estimates of this quantity routinely published. Disagreement between estimates can be substantial and may lead to confusion among decision-makers and the general public. In this work, we compare different estimates of the national-level effective reproductive number of COVID-19 in Germany in 2020 and 2021. We consider the agreement between estimates from the same method but published at different time points (within-method agreement) as well as retrospective agreement across eight different approaches (between-method agreement). Concerning the former, estimates from some methods are very stable over time and hardly subject to revisions, while others display considerable fluctuations. To evaluate between-method agreement, we reproduce the estimates generated by different groups using a variety of statistical approaches, standardizing analytical choices to assess how they contribute to the observed disagreement. These analytical choices include the data source, data pre-processing, assumed generation time distribution, statistical tuning parameters, and various delay distributions. We find that in practice, these auxiliary choices in the estimation of Rt may affect results at least as strongly as the selection of the statistical approach. They should thus be communicated transparently along with the estimates.
- 27 November 2023
- Published by Public Library of Science (PLoS) in PLOS Computational Biology
- Vol. 19 (11) , e1011653
Open AccessWhy are different estimates of the effective reproductive number so different? A case study on COVID-19 in Germany
The effective reproductive number Rt has taken a central role in the scientific, political, and public discussion during the COVID-19 pandemic, with numerous real-time estimates of this quantity routinely published. Disagreement between estimates can be substantial and may lead to confusion among decision-makers and the general public. In this work, we compare different estimates of the national-level effective reproductive number of COVID-19 in Germany in 2020 and 2021. We consider the agreement between estimates from the same method but published at different time points (within-method agreement) as well as retrospective agreement across eight different approaches (between-method agreement). Concerning the former, estimates from some methods are very stable over time and hardly subject to revisions, while others display considerable fluctuations. To evaluate between-method agreement, we reproduce the estimates generated by different groups using a variety of statistical approaches, standardizing analytical choices to assess how they contribute to the observed disagreement. These analytical choices include the data source, data pre-processing, assumed generation time distribution, statistical tuning parameters, and various delay distributions. We find that in practice, these auxiliary choices in the estimation of Rt may affect results at least as strongly as the selection of the statistical approach. They should thus be communicated transparently along with the estimates.
- 4 October 2023
- Published by Springer Nature
- p. 51-66
Measures of COVID-19 Spread
- Open Access
Why are different estimates of the effective reproductive number so different? A case study on COVID-19 in Germany
The effective reproductive number R t has taken a central role in the scientific, political, and public discussion during the COVID-19 pandemic, with numerous real-time estimates of this quantity routinely published. Disagreement between estimates can be substantial and may lead to confusion among decision-makers and the general public. In this work, we compare different estimates of the national-level effective reproductive number of COVID-19 in Germany in 2020 and 2021. We consider the agreement between estimates from the same method but published at different time points (within-method agreement) as well as retrospective agreement across different approaches (between-method agreement). Concerning the former, estimates from some methods are very stable over time and hardly subject to revisions, while others display considerable fluctuations. To evaluate between-method agreement, we reproduce the estimates generated by different groups using a variety of statistical approaches, standardizing analytical choices to assess how they contribute to the observed disagreement. These analytical choices include the data source, data pre-processing, assumed generation time distribution, statistical tuning parameters, and various delay distributions. We find that in practice, these auxiliary choices in the estimation of R t may affect results at least as strongly as the selection of the statistical approach. They should thus be communicated transparently along with the estimates.
Open AccessWhy are different estimates of the effective reproductive number so different? A case study on COVID-19 in Germany
The effective reproductive number R t has taken a central role in the scientific, political, and public discussion during the COVID-19 pandemic, with numerous real-time estimates of this quantity routinely published. Disagreement between estimates can be substantial and may lead to confusion among decision-makers and the general public. In this work, we compare different estimates of the national-level effective reproductive number of COVID-19 in Germany in 2020 and 2021. We consider the agreement between estimates from the same method but published at different time points (within-method agreement) as well as retrospective agreement across different approaches (between-method agreement). Concerning the former, estimates from some methods are very stable over time and hardly subject to revisions, while others display considerable fluctuations. To evaluate between-method agreement, we reproduce the estimates generated by different groups using a variety of statistical approaches, standardizing analytical choices to assess how they contribute to the observed disagreement. These analytical choices include the data source, data pre-processing, assumed generation time distribution, statistical tuning parameters, and various delay distributions. We find that in practice, these auxiliary choices in the estimation of R t may affect results at least as strongly as the selection of the statistical approach. They should thus be communicated transparently along with the estimates.
- Open Access
Collaborative nowcasting of COVID-19 hospitalization incidences in Germany
Real-time surveillance is a crucial element in the response to infectious disease outbreaks. However, the interpretation of incidence data is often hampered by delays occurring at various stages of data gathering and reporting. As a result, recent values are biased downward, which obscures current trends. Statistical nowcasting techniques can be employed to correct these biases, allowing for accurate characterization of recent developments and thus enhancing situational awareness. In this paper, we present a preregistered real-time assessment of eight nowcasting approaches, applied by independent research teams to German 7-day hospitalization incidences. This indicator played an important role in the management of the pandemic in Germany and was linked to levels of non-pharmaceutical interventions via certain thresholds. Due to its definition, in which hospitalization counts are aggregated by the date of case report rather than admission, German hospitalization incidences are particularly affected by delays and can take several weeks or months to fully stabilize. For this study, all methods were applied from 22 November 2021 to 29 April 2022, with probabilistic nowcasts produced each day for the current and 28 preceding days. Nowcasts at the national, state, and age-group levels were collected in the form of quantiles in a public repository and displayed in a dashboard. Moreover, a mean and a median ensemble nowcast were generated. We find that overall, the compared methods were able to remove a large part of the biases introduced by delays. Most participating teams underestimated the importance of very long delays, though, resulting in nowcasts with a slight downward bias. The accompanying uncertainty intervals were also too narrow for almost all methods. Averaged over all nowcast horizons, the best performance was achieved by a model using case incidences as a covariate and taking into account longer delays than the other approaches. For the most recent days, which are often considered the most relevant in practice, a mean ensemble of the submitted nowcasts performed best. We conclude by providing some lessons learned on the definition of nowcasting targets and practical challenges.
Open AccessCollaborative nowcasting of COVID-19 hospitalization incidences in Germany
Real-time surveillance is a crucial element in the response to infectious disease outbreaks. However, the interpretation of incidence data is often hampered by delays occurring at various stages of data gathering and reporting. As a result, recent values are biased downward, which obscures current trends. Statistical nowcasting techniques can be employed to correct these biases, allowing for accurate characterization of recent developments and thus enhancing situational awareness. In this paper, we present a preregistered real-time assessment of eight nowcasting approaches, applied by independent research teams to German 7-day hospitalization incidences. This indicator played an important role in the management of the pandemic in Germany and was linked to levels of non-pharmaceutical interventions via certain thresholds. Due to its definition, in which hospitalization counts are aggregated by the date of case report rather than admission, German hospitalization incidences are particularly affected by delays and can take several weeks or months to fully stabilize. For this study, all methods were applied from 22 November 2021 to 29 April 2022, with probabilistic nowcasts produced each day for the current and 28 preceding days. Nowcasts at the national, state, and age-group levels were collected in the form of quantiles in a public repository and displayed in a dashboard. Moreover, a mean and a median ensemble nowcast were generated. We find that overall, the compared methods were able to remove a large part of the biases introduced by delays. Most participating teams underestimated the importance of very long delays, though, resulting in nowcasts with a slight downward bias. The accompanying uncertainty intervals were also too narrow for almost all methods. Averaged over all nowcast horizons, the best performance was achieved by a model using case incidences as a covariate and taking into account longer delays than the other approaches. For the most recent days, which are often considered the most relevant in practice, a mean ensemble of the submitted nowcasts performed best. We conclude by providing some lessons learned on the definition of nowcasting targets and practical challenges.
- 10 January 2023
- Published by Wiley in Physica Status Solidi (b)
- Vol. 260 (1)
Generalized Modeling of Photoluminescence Transients
- 10 January 2023
- Published by Wiley in Physica Status Solidi (b)
- Vol. 260 (1)
Generalized Modeling of Photoluminescence Transients
- Open Access
- 22 November 2022
- Published by MDPI AG in Environments
- Vol. 9 (12) , 147
Microfluidically-Assisted Isolation and Characterization of Achromobacter spanius from Soils for Microbial Degradation of Synthetic Polymers and Organic Solvents
A micro segmented-flow approach was utilized for the isolation soil bacteria that can degrade synthetic polymers as polyethylene glycols (PEG) and polyacrylamide (PAM). We had been able to obtain many strains; among them, five Achromobacter spanius strains from soil samples of specific sampling sites that were connected with ancient human impacts. In addition to the characterization of community responses and isolating single strains, this microfluidic approach allowed for investigation of the susceptibility of Achromobacter spanius strains against three synthetic polymers, including PEG, PAM, and Polyvinylpyrrolidone (PVP) and two organic solvents known as 1,4-dioxane and diglyme. The small stepwise variation of effector concentrations in 500 nL droplets provides a detailed reflection of the concentration-dependent response of bacterial growth and endogenous autofluorescence activity. As a result, all five strains can use PEG600 as carbon source. Furthermore, all strains showed similar dose-response characteristics in 1,4-dioxane and diglyme. However, significantly different PAM- and PVP-tolerances were found for these strains. Samples from the surface soil of prehistorical rampart areas supplied a strain capable of degradation of PEG, PVP, and PAM. This study demonstrates on the one hand, the potential of microsegment flow for miniaturized dose-response screening studies and its ability to detect novel strains, and on the other hand, two of five isolated Achromobacter spanius strains may be useful in providing optimal growth conditions in bioremediation and biodegradation processes.
- 22 November 2022
- Published by MDPI AG in Environments
- Vol. 9 (12) , 147
Open AccessMicrofluidically-Assisted Isolation and Characterization of Achromobacter spanius from Soils for Microbial Degradation of Synthetic Polymers and Organic Solvents
A micro segmented-flow approach was utilized for the isolation soil bacteria that can degrade synthetic polymers as polyethylene glycols (PEG) and polyacrylamide (PAM). We had been able to obtain many strains; among them, five Achromobacter spanius strains from soil samples of specific sampling sites that were connected with ancient human impacts. In addition to the characterization of community responses and isolating single strains, this microfluidic approach allowed for investigation of the susceptibility of Achromobacter spanius strains against three synthetic polymers, including PEG, PAM, and Polyvinylpyrrolidone (PVP) and two organic solvents known as 1,4-dioxane and diglyme. The small stepwise variation of effector concentrations in 500 nL droplets provides a detailed reflection of the concentration-dependent response of bacterial growth and endogenous autofluorescence activity. As a result, all five strains can use PEG600 as carbon source. Furthermore, all strains showed similar dose-response characteristics in 1,4-dioxane and diglyme. However, significantly different PAM- and PVP-tolerances were found for these strains. Samples from the surface soil of prehistorical rampart areas supplied a strain capable of degradation of PEG, PVP, and PAM. This study demonstrates on the one hand, the potential of microsegment flow for miniaturized dose-response screening studies and its ability to detect novel strains, and on the other hand, two of five isolated Achromobacter spanius strains may be useful in providing optimal growth conditions in bioremediation and biodegradation processes.
- Open Access
- 13 November 2022
- Published by Wiley in Physica Status Solidi (b)
- Vol. 260 (1)
Generalized Modeling of Photoluminescence Transients
Time‐resolved photoluminescence (TRPL) measurements and the extraction of meaningful parameters involve four key ingredients: a suitable sample such as a semiconductor double heterostructure, a state‐of‐the‐art measurement setup, a kinetic model appropriate for the description of the sample behavior, and a general analysis method to extract the model parameters of interest from the measured TRPL transients. Until now, the last ingredient is limited to single curve fits, which are mostly based on simple models and least‐squares fits. These are often insufficient for the parameter extraction in real‐world applications. The goal of this article is to give the community a universal method for the analysis of TRPL measurements, which accounts for the Poisson distribution of photon counting events. The method can be used to fit multiple TRPL transients simultaneously using general kinematic models, but should also be used for single transient fits. To demonstrate this approach, multiple TRPL transients of a GaAs/AlGaAs heterostructure are fitted simultaneously using coupled rate equations. It is shown that the simultaneous fits of several TRPL traces supplemented by systematic error estimations allow for a more meaningful and more robust parameter determination. The statistical methods also quantify the quality of the description by the underlying physical model.
- 13 November 2022
- Published by Wiley in Physica Status Solidi (b)
- Vol. 260 (1)
Open AccessGeneralized Modeling of Photoluminescence Transients
Time‐resolved photoluminescence (TRPL) measurements and the extraction of meaningful parameters involve four key ingredients: a suitable sample such as a semiconductor double heterostructure, a state‐of‐the‐art measurement setup, a kinetic model appropriate for the description of the sample behavior, and a general analysis method to extract the model parameters of interest from the measured TRPL transients. Until now, the last ingredient is limited to single curve fits, which are mostly based on simple models and least‐squares fits. These are often insufficient for the parameter extraction in real‐world applications. The goal of this article is to give the community a universal method for the analysis of TRPL measurements, which accounts for the Poisson distribution of photon counting events. The method can be used to fit multiple TRPL transients simultaneously using general kinematic models, but should also be used for single transient fits. To demonstrate this approach, multiple TRPL transients of a GaAs/AlGaAs heterostructure are fitted simultaneously using coupled rate equations. It is shown that the simultaneous fits of several TRPL traces supplemented by systematic error estimations allow for a more meaningful and more robust parameter determination. The statistical methods also quantify the quality of the description by the underlying physical model.
- Open Access
- 31 October 2022
- Published by Springer Nature in Communications Medicine
- Vol. 2 (1) , 1-17
National and subnational short-term forecasting of COVID-19 in Germany and Poland during early 2021
Background: During the COVID-19 pandemic there has been a strong interest in forecasts of the short-term development of epidemiological indicators to inform decision makers. In this study we evaluate probabilistic real-time predictions of confirmed cases and deaths from COVID-19 in Germany and Poland for the period from January through April 2021. Methods: We evaluate probabilistic real-time predictions of confirmed cases and deaths from COVID-19 in Germany and Poland. These were issued by 15 different forecasting models, run by independent research teams. Moreover, we study the performance of combined ensemble forecasts. Evaluation of probabilistic forecasts is based on proper scoring rules, along with interval coverage proportions to assess calibration. The presented work is part of a pre-registered evaluation study. Results: We find that many, though not all, models outperform a simple baseline model up to four weeks ahead for the considered targets. Ensemble methods show very good relative performance. The addressed time period is characterized by rather stable non-pharmaceutical interventions in both countries, making short-term predictions more straightforward than in previous periods. However, major trend changes in reported cases, like the rebound in cases due to the rise of the B.1.1.7 (Alpha) variant in March 2021, prove challenging to predict. Conclusions: Multi-model approaches can help to improve the performance of epidemiological forecasts. However, while death numbers can be predicted with some success based on current case and hospitalization data, predictability of case numbers remains low beyond quite short time horizons. Additional data sources including sequencing and mobility data, which were not extensively used in the present study, may help to improve performance.
- 31 October 2022
- Published by Springer Nature in Communications Medicine
- Vol. 2 (1) , 1-17
Open AccessNational and subnational short-term forecasting of COVID-19 in Germany and Poland during early 2021
Background: During the COVID-19 pandemic there has been a strong interest in forecasts of the short-term development of epidemiological indicators to inform decision makers. In this study we evaluate probabilistic real-time predictions of confirmed cases and deaths from COVID-19 in Germany and Poland for the period from January through April 2021. Methods: We evaluate probabilistic real-time predictions of confirmed cases and deaths from COVID-19 in Germany and Poland. These were issued by 15 different forecasting models, run by independent research teams. Moreover, we study the performance of combined ensemble forecasts. Evaluation of probabilistic forecasts is based on proper scoring rules, along with interval coverage proportions to assess calibration. The presented work is part of a pre-registered evaluation study. Results: We find that many, though not all, models outperform a simple baseline model up to four weeks ahead for the considered targets. Ensemble methods show very good relative performance. The addressed time period is characterized by rather stable non-pharmaceutical interventions in both countries, making short-term predictions more straightforward than in previous periods. However, major trend changes in reported cases, like the rebound in cases due to the rise of the B.1.1.7 (Alpha) variant in March 2021, prove challenging to predict. Conclusions: Multi-model approaches can help to improve the performance of epidemiological forecasts. However, while death numbers can be predicted with some success based on current case and hospitalization data, predictability of case numbers remains low beyond quite short time horizons. Additional data sources including sequencing and mobility data, which were not extensively used in the present study, may help to improve performance.
- 11 July 2022
- Published by Springer Nature
- p. 163-171
Regional Estimates of Reproduction Numbers with Application to COVID-19
- 11 July 2022
- Published by Springer Nature
- p. 163-171
Regional Estimates of Reproduction Numbers with Application to COVID-19
- Open Access
Predictive performance of multi-model ensemble forecasts of COVID-19 across European nations
Background Short-term forecasts of infectious disease burden can contribute to situational awareness and aid capacity planning. Based on best practice in other fields and recent insights in infectious disease epidemiology, one can maximise the predictive performance of such forecasts if multiple models are combined into an ensemble. Here we report on the performance of ensembles in predicting COVID-19 cases and deaths across Europe between 08 March 2021 and 07 March 2022. Methods We used open-source tools to develop a public European COVID-19 Forecast Hub. We invited groups globally to contribute weekly forecasts for COVID-19 cases and deaths reported from a standardised source over the next one to four weeks. Teams submitted forecasts from March 2021 using standardised quantiles of the predictive distribution. Each week we created an ensemble forecast, where each predictive quantile was calculated as the equally-weighted average (initially the mean and then from 26th July the median) of all individual models’ predictive quantiles. We measured the performance of each model using the relative Weighted Interval Score (WIS), comparing models’ forecast accuracy relative to all other models. We retrospectively explored alternative methods for ensemble forecasts, including weighted averages based on models’ past predictive performance. Results Over 52 weeks we collected and combined up to 28 forecast models for 32 countries. We found a weekly ensemble had a consistently strong performance across countries over time. Across all horizons and locations, the ensemble performed better on relative WIS than 84% of participating models’ forecasts of incident cases (with a total N=862), and 92% of participating models’ forecasts of deaths (N=746). Across a one to four week time horizon, ensemble performance declined with longer forecast periods when forecasting cases, but remained stable over four weeks for incident death forecasts. In every forecast across 32 countries, the ensemble outperformed most contributing models when forecasting either cases or deaths, frequently outperforming all of its individual component models. Among several choices of ensemble methods we found that the most influential and best choice was to use a median average of models instead of using the mean, regardless of methods of weighting component forecast models. Conclusions Our results support the use of combining forecasts from individual models into an ensemble in order to improve predictive performance across epidemiological targets and populations during infectious disease epidemics. Our findings further suggest that median ensemble methods yield better predictive performance more than ones based on means. Our findings also highlight that forecast consumers should place more weight on incident death forecasts than incident case forecasts at forecast horizons greater than two weeks. Code and data availability All data and code are publicly available on Github: covid19-forecast-hub-europe/euro-hub-ensemble.
Open AccessPredictive performance of multi-model ensemble forecasts of COVID-19 across European nations
Background Short-term forecasts of infectious disease burden can contribute to situational awareness and aid capacity planning. Based on best practice in other fields and recent insights in infectious disease epidemiology, one can maximise the predictive performance of such forecasts if multiple models are combined into an ensemble. Here we report on the performance of ensembles in predicting COVID-19 cases and deaths across Europe between 08 March 2021 and 07 March 2022. Methods We used open-source tools to develop a public European COVID-19 Forecast Hub. We invited groups globally to contribute weekly forecasts for COVID-19 cases and deaths reported from a standardised source over the next one to four weeks. Teams submitted forecasts from March 2021 using standardised quantiles of the predictive distribution. Each week we created an ensemble forecast, where each predictive quantile was calculated as the equally-weighted average (initially the mean and then from 26th July the median) of all individual models’ predictive quantiles. We measured the performance of each model using the relative Weighted Interval Score (WIS), comparing models’ forecast accuracy relative to all other models. We retrospectively explored alternative methods for ensemble forecasts, including weighted averages based on models’ past predictive performance. Results Over 52 weeks we collected and combined up to 28 forecast models for 32 countries. We found a weekly ensemble had a consistently strong performance across countries over time. Across all horizons and locations, the ensemble performed better on relative WIS than 84% of participating models’ forecasts of incident cases (with a total N=862), and 92% of participating models’ forecasts of deaths (N=746). Across a one to four week time horizon, ensemble performance declined with longer forecast periods when forecasting cases, but remained stable over four weeks for incident death forecasts. In every forecast across 32 countries, the ensemble outperformed most contributing models when forecasting either cases or deaths, frequently outperforming all of its individual component models. Among several choices of ensemble methods we found that the most influential and best choice was to use a median average of models instead of using the mean, regardless of methods of weighting component forecast models. Conclusions Our results support the use of combining forecasts from individual models into an ensemble in order to improve predictive performance across epidemiological targets and populations during infectious disease epidemics. Our findings further suggest that median ensemble methods yield better predictive performance more than ones based on means. Our findings also highlight that forecast consumers should place more weight on incident death forecasts than incident case forecasts at forecast horizons greater than two weeks. Code and data availability All data and code are publicly available on Github: covid19-forecast-hub-europe/euro-hub-ensemble.