Reza Nasirigerdeh
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Reza Nasirigerdeh has a total of 76 co-authors. Here are the top co-authors by number of shared publications:
- Jan Baumbach
Institute for Computational Systems Biomedicine, University of Hamburg , Hamburg 22761
4 shared publications - Nina Kerstin Wenke
Institute for Computational Systems Biomedicine, University of Hamburg, Albert-Einstein-Ring 8-10, Hamburg, 22761, Germany
4 shared publications - Tim Kacprowski
Institute of Data Science in Biomedicine, Technische Universität Braunschweig, Braunschweig, Germany
4 shared publications - David Benjamin Blumenthal
Biomedical Network Science Lab, Department Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
3 shared publications - Julian Matschinske
Institute for Computational Systems Biology, University of Hamburg , Hamburg, Germany
3 shared publications - Julian Späth
Institute for Computational Systems Biology University of Hamburg Hamburg Germany
3 shared publications
Latest Publications
- Open Access
- 26 November 2023
- Published by Association for Computing Machinery (ACM)
- p. 55-65
Utility-preserving Federated Learning
We investigate the concept of utility-preserving federated learning (UPFL) in the context of deep neural networks. We theoretically prove and experimentally validate that UPFL achieves the same accuracy as centralized training independent of the data distribution across the clients. We demonstrate that UPFL can fully take advantage of the momentum and weight decay techniques compared to centralized training, but it incurs substantial communication overhead. Ordinary federated learning, on the other hand, provides much higher communication efficiency, but it can partially benefit from the aforementioned techniques to improve utility. Given that, we propose a method called weighted gradient accumulation to gain more benefit from the momentum and weight decay akin to UPFL, while providing practical communication efficiency similar to ordinary federated learning.
- 26 November 2023
- Published by Association for Computing Machinery (ACM)
- p. 55-65
Open AccessUtility-preserving Federated Learning
We investigate the concept of utility-preserving federated learning (UPFL) in the context of deep neural networks. We theoretically prove and experimentally validate that UPFL achieves the same accuracy as centralized training independent of the data distribution across the clients. We demonstrate that UPFL can fully take advantage of the momentum and weight decay techniques compared to centralized training, but it incurs substantial communication overhead. Ordinary federated learning, on the other hand, provides much higher communication efficiency, but it can partially benefit from the aforementioned techniques to improve utility. Given that, we propose a method called weighted gradient accumulation to gain more benefit from the momentum and weight decay akin to UPFL, while providing practical communication efficiency similar to ordinary federated learning.
- Open Access
- 12 September 2022
- Published by JMIR Publications Inc. in JMIR Preprints
The FeatureCloud Platform for Federated Learning in Biomedicine: Unified Approach (Preprint)
BACKGROUND Machine learning and artificial intelligence have shown promising results in many areas and are driven by the increasing amount of available data. However, these data are often distributed across different institutions and cannot be easily shared owing to strict privacy regulations. Federated learning (FL) allows the training of distributed machine learning models without sharing sensitive data. In addition, the implementation is time-consuming and requires advanced programming skills and complex technical infrastructures. OBJECTIVE Various tools and frameworks have been developed to simplify the development of FL algorithms and provide the necessary technical infrastructure. Although there are many high-quality frameworks, most focus only on a single application case or method. To our knowledge, there are no generic frameworks, meaning that the existing solutions are restricted to a particular type of algorithm or application field. Furthermore, most of these frameworks provide an application programming interface that needs programming knowledge. There is no collection of ready-to-use FL algorithms that are extendable and allow users (eg, researchers) without programming knowledge to apply FL. A central FL platform for both FL algorithm developers and users does not exist. This study aimed to address this gap and make FL available to everyone by developing FeatureCloud, an all-in-one platform for FL in biomedicine and beyond. METHODS The FeatureCloud platform consists of 3 main components: a global frontend, a global backend, and a local controller. Our platform uses a Docker to separate the local acting components of the platform from the sensitive data systems. We evaluated our platform using 4 different algorithms on 5 data sets for both accuracy and runtime. RESULTS FeatureCloud removes the complexity of distributed systems for developers and end users by providing a comprehensive platform for executing multi-institutional FL analyses and implementing FL algorithms. Through its integrated artificial intelligence store, federated algorithms can easily be published and reused by the community. To secure sensitive raw data, FeatureCloud supports privacy-enhancing technologies to secure the shared local models and assures high standards in data privacy to comply with the strict General Data Protection Regulation. Our evaluation shows that applications developed in FeatureCloud can produce highly similar results compared with centralized approaches and scale well for an increasing number of participating sites. CONCLUSIONS FeatureCloud provides a ready-to-use platform that integrates the development and execution of FL algorithms while reducing the complexity to a minimum and removing the hurdles of federated infrastructure. Thus, we believe that it has the potential to greatly increase the accessibility of privacy-preserving and distributed data analyses in biomedicine and beyond.
- 12 September 2022
- Published by JMIR Publications Inc. in JMIR Preprints
Open AccessThe FeatureCloud Platform for Federated Learning in Biomedicine: Unified Approach (Preprint)
BACKGROUND Machine learning and artificial intelligence have shown promising results in many areas and are driven by the increasing amount of available data. However, these data are often distributed across different institutions and cannot be easily shared owing to strict privacy regulations. Federated learning (FL) allows the training of distributed machine learning models without sharing sensitive data. In addition, the implementation is time-consuming and requires advanced programming skills and complex technical infrastructures. OBJECTIVE Various tools and frameworks have been developed to simplify the development of FL algorithms and provide the necessary technical infrastructure. Although there are many high-quality frameworks, most focus only on a single application case or method. To our knowledge, there are no generic frameworks, meaning that the existing solutions are restricted to a particular type of algorithm or application field. Furthermore, most of these frameworks provide an application programming interface that needs programming knowledge. There is no collection of ready-to-use FL algorithms that are extendable and allow users (eg, researchers) without programming knowledge to apply FL. A central FL platform for both FL algorithm developers and users does not exist. This study aimed to address this gap and make FL available to everyone by developing FeatureCloud, an all-in-one platform for FL in biomedicine and beyond. METHODS The FeatureCloud platform consists of 3 main components: a global frontend, a global backend, and a local controller. Our platform uses a Docker to separate the local acting components of the platform from the sensitive data systems. We evaluated our platform using 4 different algorithms on 5 data sets for both accuracy and runtime. RESULTS FeatureCloud removes the complexity of distributed systems for developers and end users by providing a comprehensive platform for executing multi-institutional FL analyses and implementing FL algorithms. Through its integrated artificial intelligence store, federated algorithms can easily be published and reused by the community. To secure sensitive raw data, FeatureCloud supports privacy-enhancing technologies to secure the shared local models and assures high standards in data privacy to comply with the strict General Data Protection Regulation. Our evaluation shows that applications developed in FeatureCloud can produce highly similar results compared with centralized approaches and scale well for an increasing number of participating sites. CONCLUSIONS FeatureCloud provides a ready-to-use platform that integrates the development and execution of FL algorithms while reducing the complexity to a minimum and removing the hurdles of federated infrastructure. Thus, we believe that it has the potential to greatly increase the accessibility of privacy-preserving and distributed data analyses in biomedicine and beyond.
- Open Access
- 26 August 2022
- Published by ScienceOpen
Targeting infectious diseases: The CoVex example
In a pandemic, such as the one caused by the coronavirus in 2020, fast action is required to provide insights into the disease mechanisms and to find potential drug targets to slow the progress of the disease and lower mortality. We developed CoVex, an interactive online platform for the exploration of the SARS-CoV-2 host interactome and the identification of drug candidates. CoVex integrates the virus-human protein interactions, human protein-protein interactions, and drug-target interactions, and allows for visual exploration of the data. The exploration is guided by network-based systems medicine algorithms that enable the assembly of ranked lists of candidates for already approved drugs. Unlike novel drugs, approved drugs have the advantage that most of their side effects and contraindications are known. Additionally, they are already available and can be distributed quickly, which makes them promising candidates to stop the uncontrolled spread of the disease early. CoVex is an example of how this could be achieved in future pandemics and provides valuable lessons on what is required in such a situation to maximize the potential of computational approaches that can significantly speed up drug discovery.
- 26 August 2022
- Published by ScienceOpen
Open AccessTargeting infectious diseases: The CoVex example
In a pandemic, such as the one caused by the coronavirus in 2020, fast action is required to provide insights into the disease mechanisms and to find potential drug targets to slow the progress of the disease and lower mortality. We developed CoVex, an interactive online platform for the exploration of the SARS-CoV-2 host interactome and the identification of drug candidates. CoVex integrates the virus-human protein interactions, human protein-protein interactions, and drug-target interactions, and allows for visual exploration of the data. The exploration is guided by network-based systems medicine algorithms that enable the assembly of ranked lists of candidates for already approved drugs. Unlike novel drugs, approved drugs have the advantage that most of their side effects and contraindications are known. Additionally, they are already available and can be distributed quickly, which makes them promising candidates to stop the uncontrolled spread of the disease early. CoVex is an example of how this could be achieved in future pandemics and provides valuable lessons on what is required in such a situation to maximize the potential of computational approaches that can significantly speed up drug discovery.
- Open Access
- 3 August 2022
- Published by ScienceOpen
Medical data safety via federated machine learning
In recent years, high-throughput technologies have produced enormous amounts of biomedical data. However, biomedical data tend to be “wide” rather than “big”, i.e., they typically contain a huge number of features for relatively few samples. To increase robustness and predictive power of machine learning models trained on biomedical data, it is hence desirable to increase sample sizes by jointly analyzing data sets available at several sites (e.g., hospitals). However, biomedical data is often extremely sensitive and so pooling it raises important privacy concerns. Consequently, federated learning (FL) has emerged as a privacy-aware alternative to centralized analyses on pooled data. In FL, sensitive data remain at the local sites and only model parameters are shared with a global aggregator. In my talk, I will introduce the promises and challenges of using FL for biomedical applications, using genome-wide association studies (GWAS) as an example. On the one hand, I will present recently developed tools that enable privacy-aware, federated GWAS in a user-friendly fashion while reaching high accuracies and practical runtimes. On the other hand, I will use the GWAS example to draw attention to a limitation of FL: Although, if detected, remaining privacy risks in FL can often be mitigated via algorithmic or cryptographic techniques, there are no mathematical frameworks which allow to oversee all possible sources of data leakage at the time of deployment. This suggests that it is unlikely that the conflict between privacy preservation and gained utility of pooled analyses of biomedical data will be fully resolvable via purely technological means in the foreseeable future. Instead, it might be necessary to develop risk-aware patient consent models, where the remaining risks of state-of-the-art privacy-aware machine learning technologies are made transparent and privacy preservation is no longer treated as a sine qua non condition but rather as an important good to be weighed against others.
- 3 August 2022
- Published by ScienceOpen
Open AccessMedical data safety via federated machine learning
In recent years, high-throughput technologies have produced enormous amounts of biomedical data. However, biomedical data tend to be “wide” rather than “big”, i.e., they typically contain a huge number of features for relatively few samples. To increase robustness and predictive power of machine learning models trained on biomedical data, it is hence desirable to increase sample sizes by jointly analyzing data sets available at several sites (e.g., hospitals). However, biomedical data is often extremely sensitive and so pooling it raises important privacy concerns. Consequently, federated learning (FL) has emerged as a privacy-aware alternative to centralized analyses on pooled data. In FL, sensitive data remain at the local sites and only model parameters are shared with a global aggregator. In my talk, I will introduce the promises and challenges of using FL for biomedical applications, using genome-wide association studies (GWAS) as an example. On the one hand, I will present recently developed tools that enable privacy-aware, federated GWAS in a user-friendly fashion while reaching high accuracies and practical runtimes. On the other hand, I will use the GWAS example to draw attention to a limitation of FL: Although, if detected, remaining privacy risks in FL can often be mitigated via algorithmic or cryptographic techniques, there are no mathematical frameworks which allow to oversee all possible sources of data leakage at the time of deployment. This suggests that it is unlikely that the conflict between privacy preservation and gained utility of pooled analyses of biomedical data will be fully resolvable via purely technological means in the foreseeable future. Instead, it might be necessary to develop risk-aware patient consent models, where the remaining risks of state-of-the-art privacy-aware machine learning technologies are made transparent and privacy preservation is no longer treated as a sine qua non condition but rather as an important good to be weighed against others.
- Open Access
- 24 January 2022
- Published by Springer Nature in Genome Biology
- Vol. 23 (1) , 1-24
sPLINK: a hybrid federated tool as a robust alternative to meta-analysis in genome-wide association studies
Meta-analysis has been established as an effective approach to combining summary statistics of several genome-wide association studies (GWAS). However, the accuracy of meta-analysis can be attenuated in the presence of cross-study heterogeneity. We present sPLINK, a hybrid federated and user-friendly tool, which performs privacy-aware GWAS on distributed datasets while preserving the accuracy of the results. sPLINK is robust against heterogeneous distributions of data across cohorts while meta-analysis considerably loses accuracy in such scenarios. sPLINK achieves practical runtime and acceptable network usage for chi-square and linear/logistic regression tests. sPLINK is available at https://exbio.wzw.tum.de/splink.
- 24 January 2022
- Published by Springer Nature in Genome Biology
- Vol. 23 (1) , 1-24
Open AccesssPLINK: a hybrid federated tool as a robust alternative to meta-analysis in genome-wide association studies
Meta-analysis has been established as an effective approach to combining summary statistics of several genome-wide association studies (GWAS). However, the accuracy of meta-analysis can be attenuated in the presence of cross-study heterogeneity. We present sPLINK, a hybrid federated and user-friendly tool, which performs privacy-aware GWAS on distributed datasets while preserving the accuracy of the results. sPLINK is robust against heterogeneous distributions of data across cohorts while meta-analysis considerably loses accuracy in such scenarios. sPLINK achieves practical runtime and acceptable network usage for chi-square and linear/logistic regression tests. sPLINK is available at https://exbio.wzw.tum.de/splink.
- Open Access
Federated Multi-Mini-Batch: An Efficient Training Approach to Federated Learning in Non-IID Environments
Federated learning has faced performance and network communication challenges, especially in the environments where the data is not independent and identically distributed (IID) across the clients. To address the former challenge, we introduce the federated-centralized concordance property and show that the federated single-mini-batch training approach can achieve comparable performance as the corresponding centralized training in the Non-IID environments. To deal with the latter, we present the federated multi-mini-batch approach and illustrate that it can establish a trade-off between the performance and communication efficiency and outperforms federated averaging in the Non-IID settings.
Open AccessFederated Multi-Mini-Batch: An Efficient Training Approach to Federated Learning in Non-IID Environments
Federated learning has faced performance and network communication challenges, especially in the environments where the data is not independent and identically distributed (IID) across the clients. To address the former challenge, we introduce the federated-centralized concordance property and show that the federated single-mini-batch training approach can achieve comparable performance as the corresponding centralized training in the Non-IID environments. To deal with the latter, we present the federated multi-mini-batch approach and illustrate that it can establish a trade-off between the performance and communication efficiency and outperforms federated averaging in the Non-IID settings.
- Open Access
sPLINK: A Federated, Privacy-Preserving Tool as a Robust Alternative to Meta-Analysis in Genome-Wide Association Studies
Genome-wide association studies (GWAS) have been widely used to unravel connections between genetic variants and diseases. Larger sample sizes in GWAS can lead to discovering more associations and more accurate genetic predictors. However, sharing and combining distributed genomic data to increase the sample size is often challenging or even impossible due to privacy concerns and privacy protection laws such as the GDPR. While meta-analysis has been established as an effective approach to combine summary statistics of several GWAS, its accuracy can be attenuated in the presence of cross-study heterogeneity. Here, we present sPLINK ( safe PLINK ), a user-friendly tool, which performs federated GWAS on distributed datasets while preserving the privacy of data and the accuracy of the results. sPLINK neither exchanges raw data nor does it rely on summary statistics. Instead, it performs model training in a federated manner, communicating only model parameters between cohorts and a central server. We verify that the federated results from sPLINK are the same as those from aggregated analyses conducted with PLINK . We demonstrate that sPLINK is robust against heterogeneous data (phenotype and confounding factors) distributions across cohorts while existing meta-analysis tools considerably lose accuracy in such scenarios. We also show that sPLINK achieves practical runtime, in order of minutes or hours, and acceptable network bandwidth consumption for chi-square and linear/logistic regression tests. Federated analysis with sPLINK , thus, has the potential to replace meta-analysis as the gold standard for collaborative GWAS. The user-friendly, readily usable sPLINK tool is available at https://exbio.wzw.tum.de/splink .
Open AccesssPLINK: A Federated, Privacy-Preserving Tool as a Robust Alternative to Meta-Analysis in Genome-Wide Association Studies
Genome-wide association studies (GWAS) have been widely used to unravel connections between genetic variants and diseases. Larger sample sizes in GWAS can lead to discovering more associations and more accurate genetic predictors. However, sharing and combining distributed genomic data to increase the sample size is often challenging or even impossible due to privacy concerns and privacy protection laws such as the GDPR. While meta-analysis has been established as an effective approach to combine summary statistics of several GWAS, its accuracy can be attenuated in the presence of cross-study heterogeneity. Here, we present sPLINK ( safe PLINK ), a user-friendly tool, which performs federated GWAS on distributed datasets while preserving the privacy of data and the accuracy of the results. sPLINK neither exchanges raw data nor does it rely on summary statistics. Instead, it performs model training in a federated manner, communicating only model parameters between cohorts and a central server. We verify that the federated results from sPLINK are the same as those from aggregated analyses conducted with PLINK . We demonstrate that sPLINK is robust against heterogeneous data (phenotype and confounding factors) distributions across cohorts while existing meta-analysis tools considerably lose accuracy in such scenarios. We also show that sPLINK achieves practical runtime, in order of minutes or hours, and acceptable network bandwidth consumption for chi-square and linear/logistic regression tests. Federated analysis with sPLINK , thus, has the potential to replace meta-analysis as the gold standard for collaborative GWAS. The user-friendly, readily usable sPLINK tool is available at https://exbio.wzw.tum.de/splink .
- 1 May 2018
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 203-212
Programmable Caches with a Data Management Language and Policy Engine
Our analysis of the key-value activity generated by the ParSplice molecular dynamics simulation demonstrates the need for more complex cache management strategies. Baseline measurements show clear key access patterns and hot spots that offer significant opportunity for optimization. We use the data management language and policy engine from the Mantle system to dynamically explore a variety of techniques, ranging from basic algorithms and heuristics to statistical models, calculus, and machine learning. While Mantle was originally designed for distributed file systems, we show how the collection of abstractions effectively decomposes the problem into manageable policies for a different application and storage system. Our exploration of this space results in a dynamically sized cache policy that does not sacrifice any performance while using 32-66% less memory than the default ParSplice configuration.
- 1 May 2018
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 203-212
Programmable Caches with a Data Management Language and Policy Engine
Our analysis of the key-value activity generated by the ParSplice molecular dynamics simulation demonstrates the need for more complex cache management strategies. Baseline measurements show clear key access patterns and hot spots that offer significant opportunity for optimization. We use the data management language and policy engine from the Mantle system to dynamically explore a variety of techniques, ranging from basic algorithms and heuristics to statistical models, calculus, and machine learning. While Mantle was originally designed for distributed file systems, we show how the collection of abstractions effectively decomposes the problem into manageable policies for a different application and storage system. Our exploration of this space results in a dynamically sized cache policy that does not sacrifice any performance while using 32-66% less memory than the default ParSplice configuration.