Marcel P. Schilling
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Marcel P. Schilling has a total of 33 co-authors. Here are the top co-authors by number of shared publications:
- Markus Reischl
Institute for Automation and Applied Informatics (IAI), Karlsruhe Institute of Technology (KIT), Eggenstein-Leopoldshafen, Germany
4 shared publications - Ralf Mikut
Institute for Automation and Applied Informatics (IAI), Karlsruhe Institute of Technology (KIT), Karlsruhe, Germany
4 shared publications Markus Reischl
Institute for Automation and Applied Informatics, Karlsruhe Institute of Technology, Eggenstein-Leopoldshafen, Germany
3 shared publications- Oliver Neumann
AI & Analytics, Netze BW GmbH, Stuttgart, Germany
3 shared publications - Tim Scherr
Institute for Automation and Applied Informatics, Karlsruhe Institute of Technology, Eggenstein-Leopoldshafen, Germany
3 shared publications Anna A. Popova
Institute of Biological and Chemical Systems - Functional Molecular Systems, Karlsruhe Institute of Technology, Eggenstein-Leopoldshafen, Germany
2 shared publications
Latest Publications
- Open Access
- 26 March 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 13, 54794-54807
ASAP: Automated Style-Aware Similarity Measurement for Selection of Annotated Pre-Training Datasets in 2D Biomedical Imaging
Medical imaging scenarios are characterized by varying image modalities, several organs/cell shapes, and little annotated data because of the expertise required for labeling. The successful use of state-of-the-art deep-learning approaches requires a large amount of annotated data or a pre-trained model. Despite the constant publication of new annotated datasets and pre-trained models, a vast subset of them remains untapped, owing to the challenges in effectively applying transfer learning or domain adaptation across varying scenarios. In this paper, we propose an automated style-aware framework for predicting the similarity value of a new biomedical dataset with respect to the state-of-the-art annotated datasets, selecting the most suitable annotated dataset for transfer learning or domain adaptation. Our pipeline, consisting of an autoencoder trained with self-supervised learning through a comprehensive loss function that considers the image reconstruction, style features, and dataset membership, does not need any kind of labels in training and test stages. The resulting 2D latent space represents a similarity measurement, which is demonstrated to correlate with the pre-training results in a task of binary semantic segmentation, and can provide the dataset that offers the optimal results for pre-labeling or pre-training a new biomedical task. Our results demonstrate the superior performance of this measurement with respect to manual selection and the state-of-the-art approaches. Therefore, ASAP can speed up the deployment processes of new biomedical applications. Our code is publicly available at https://github.com/miguel55/ASAP.
- 26 March 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 13, 54794-54807
Open AccessASAP: Automated Style-Aware Similarity Measurement for Selection of Annotated Pre-Training Datasets in 2D Biomedical Imaging
Medical imaging scenarios are characterized by varying image modalities, several organs/cell shapes, and little annotated data because of the expertise required for labeling. The successful use of state-of-the-art deep-learning approaches requires a large amount of annotated data or a pre-trained model. Despite the constant publication of new annotated datasets and pre-trained models, a vast subset of them remains untapped, owing to the challenges in effectively applying transfer learning or domain adaptation across varying scenarios. In this paper, we propose an automated style-aware framework for predicting the similarity value of a new biomedical dataset with respect to the state-of-the-art annotated datasets, selecting the most suitable annotated dataset for transfer learning or domain adaptation. Our pipeline, consisting of an autoencoder trained with self-supervised learning through a comprehensive loss function that considers the image reconstruction, style features, and dataset membership, does not need any kind of labels in training and test stages. The resulting 2D latent space represents a similarity measurement, which is demonstrated to correlate with the pre-training results in a task of binary semantic segmentation, and can provide the dataset that offers the optimal results for pre-labeling or pre-training a new biomedical task. Our results demonstrate the superior performance of this measurement with respect to manual selection and the state-of-the-art approaches. Therefore, ASAP can speed up the deployment processes of new biomedical applications. Our code is publicly available at https://github.com/miguel55/ASAP.
- Open Access
- 29 March 2023
- Published by Springer Nature in Scientific Reports
- Vol. 13 (1) , 1-14
Automated high-throughput image processing as part of the screening platform for personalized oncology
Cancer is a devastating disease and the second leading cause of death worldwide. However, the development of resistance to current therapies is making cancer treatment more difficult. Combining the multi-omics data of individual tumors with information on their in-vitro Drug Sensitivity and Resistance Test (DSRT) can help to determine the appropriate therapy for each patient. Miniaturized high-throughput technologies, such as the droplet microarray, enable personalized oncology. We are developing a platform that incorporates DSRT profiling workflows from minute amounts of cellular material and reagents. Experimental results often rely on image-based readout techniques, where images are often constructed in grid-like structures with heterogeneous image processing targets. However, manual image analysis is time-consuming, not reproducible, and impossible for high-throughput experiments due to the amount of data generated. Therefore, automated image processing solutions are an essential component of a screening platform for personalized oncology. We present our comprehensive concept that considers assisted image annotation, algorithms for image processing of grid-like high-throughput experiments, and enhanced learning processes. In addition, the concept includes the deployment of processing pipelines. Details of the computation and implementation are presented. In particular, we outline solutions for linking automated image processing for personalized oncology with high-performance computing. Finally, we demonstrate the advantages of our proposal, using image data from heterogeneous practical experiments and challenges.
- 29 March 2023
- Published by Springer Nature in Scientific Reports
- Vol. 13 (1) , 1-14
Open AccessAutomated high-throughput image processing as part of the screening platform for personalized oncology
Cancer is a devastating disease and the second leading cause of death worldwide. However, the development of resistance to current therapies is making cancer treatment more difficult. Combining the multi-omics data of individual tumors with information on their in-vitro Drug Sensitivity and Resistance Test (DSRT) can help to determine the appropriate therapy for each patient. Miniaturized high-throughput technologies, such as the droplet microarray, enable personalized oncology. We are developing a platform that incorporates DSRT profiling workflows from minute amounts of cellular material and reagents. Experimental results often rely on image-based readout techniques, where images are often constructed in grid-like structures with heterogeneous image processing targets. However, manual image analysis is time-consuming, not reproducible, and impossible for high-throughput experiments due to the amount of data generated. Therefore, automated image processing solutions are an essential component of a screening platform for personalized oncology. We present our comprehensive concept that considers assisted image annotation, algorithms for image processing of grid-like high-throughput experiments, and enhanced learning processes. In addition, the concept includes the deployment of processing pipelines. Details of the computation and implementation are presented. In particular, we outline solutions for linking automated image processing for personalized oncology with high-performance computing. Finally, we demonstrate the advantages of our proposal, using image data from heterogeneous practical experiments and challenges.
- Open Access
- 6 March 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Biomedical Engineering
- Vol. 70 (9) , 2519-2528
Self-Supervised Learning for Annotation Efficient Biomedical Image Segmentation
Objective : The scarcity of high-quality annotated data is omnipresent in machine learning. Especially in biomedical segmentation applications, experts need to spend a lot of their time into annotating due to the complexity. Hence, methods to reduce such efforts are desired. Methods : Self-Supervised Learning (SSL) is an emerging field that increases performance when unannotated data is present. However, profound studies regarding segmentation tasks and small datasets are still absent. A comprehensive qualitative and quantitative evaluation is conducted, examining SSL's applicability with a focus on biomedical imaging. We consider various metrics and introduce multiple novel application-specific measures. All metrics and state-of-the-art methods are provided in a directly applicable software package ( https://osf.io/gu2t8/ ). Results : We show that SSL can lead to performance improvements of up to 10%, which is especially notable for methods designed for segmentation tasks. Conclusion : SSL is a sensible approach to data-efficient learning, especially for biomedical applications, where generating annotations requires much effort. Additionally, our extensive evaluation pipeline is vital since there are significant differences between the various approaches. Significance : We provide biomedical practitioners with an overview of innovative data-efficient solutions and a novel toolbox for their own application of new approaches. Our pipeline for analyzing SSL methods is provided as a ready-to-use software package.
- 6 March 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Biomedical Engineering
- Vol. 70 (9) , 2519-2528
Open AccessSelf-Supervised Learning for Annotation Efficient Biomedical Image Segmentation
Objective : The scarcity of high-quality annotated data is omnipresent in machine learning. Especially in biomedical segmentation applications, experts need to spend a lot of their time into annotating due to the complexity. Hence, methods to reduce such efforts are desired. Methods : Self-Supervised Learning (SSL) is an emerging field that increases performance when unannotated data is present. However, profound studies regarding segmentation tasks and small datasets are still absent. A comprehensive qualitative and quantitative evaluation is conducted, examining SSL's applicability with a focus on biomedical imaging. We consider various metrics and introduce multiple novel application-specific measures. All metrics and state-of-the-art methods are provided in a directly applicable software package ( https://osf.io/gu2t8/ ). Results : We show that SSL can lead to performance improvements of up to 10%, which is especially notable for methods designed for segmentation tasks. Conclusion : SSL is a sensible approach to data-efficient learning, especially for biomedical applications, where generating annotations requires much effort. Additionally, our extensive evaluation pipeline is vital since there are significant differences between the various approaches. Significance : We provide biomedical practitioners with an overview of innovative data-efficient solutions and a novel toolbox for their own application of new approaches. Our pipeline for analyzing SSL methods is provided as a ready-to-use software package.
- Open Access
- 29 November 2022
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 17 (11) , e0277601
microbeSEG: A deep learning software tool with OMERO data management for efficient and accurate cell segmentation
In biotechnology, cell growth is one of the most important properties for the characterization and optimization of microbial cultures. Novel live-cell imaging methods are leading to an ever better understanding of cell cultures and their development. The key to analyzing acquired data is accurate and automated cell segmentation at the single-cell level. Therefore, we present microbeSEG, a user-friendly Python-based cell segmentation tool with a graphical user interface and OMERO data management. microbeSEG utilizes a state-of-the-art deep learning-based segmentation method and can be used for instance segmentation of a wide range of cell morphologies and imaging techniques, e.g., phase contrast or fluorescence microscopy. The main focus of microbeSEG is a comprehensible, easy, efficient, and complete workflow from the creation of training data to the final application of the trained segmentation model. We demonstrate that accurate cell segmentation results can be obtained within 45 minutes of user time. Utilizing public segmentation datasets or pre-labeling further accelerates the microbeSEG workflow. This opens the door for accurate and efficient data analysis of microbial cultures.
- 29 November 2022
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 17 (11) , e0277601
Open AccessmicrobeSEG: A deep learning software tool with OMERO data management for efficient and accurate cell segmentation
In biotechnology, cell growth is one of the most important properties for the characterization and optimization of microbial cultures. Novel live-cell imaging methods are leading to an ever better understanding of cell cultures and their development. The key to analyzing acquired data is accurate and automated cell segmentation at the single-cell level. Therefore, we present microbeSEG, a user-friendly Python-based cell segmentation tool with a graphical user interface and OMERO data management. microbeSEG utilizes a state-of-the-art deep learning-based segmentation method and can be used for instance segmentation of a wide range of cell morphologies and imaging techniques, e.g., phase contrast or fluorescence microscopy. The main focus of microbeSEG is a comprehensible, easy, efficient, and complete workflow from the creation of training data to the final application of the trained segmentation model. We demonstrate that accurate cell segmentation results can be obtained within 45 minutes of user time. Utilizing public segmentation datasets or pre-labeling further accelerates the microbeSEG workflow. This opens the door for accurate and efficient data analysis of microbial cultures.
- Open Access
- 26 August 2022
- Published by Walter de Gruyter GmbH in Journal of Integrative Bioinformatics
- Vol. 19 (4)
KaIDA: a modular tool for assisting image annotation in deep learning
Deep learning models achieve high-quality results in image processing. However, to robustly optimize parameters of deep neural networks, large annotated datasets are needed. Image annotation is often performed manually by experts without a comprehensive tool for assistance which is time- consuming, burdensome, and not intuitive. Using the here presented modular Karlsruhe Image Data Annotation (KaIDA) tool, for the first time assisted annotation in various image processing tasks is possible to support users during this process. It aims to simplify annotation, increase user efficiency, enhance annotation quality, and provide additional useful annotation-related functionalities. KaIDA is available open-source athttps://git.scc.kit.edu/sc1357/kaida.
- 26 August 2022
- Published by Walter de Gruyter GmbH in Journal of Integrative Bioinformatics
- Vol. 19 (4)
Open AccessKaIDA: a modular tool for assisting image annotation in deep learning
Deep learning models achieve high-quality results in image processing. However, to robustly optimize parameters of deep neural networks, large annotated datasets are needed. Image annotation is often performed manually by experts without a comprehensive tool for assistance which is time- consuming, burdensome, and not intuitive. Using the here presented modular Karlsruhe Image Data Annotation (KaIDA) tool, for the first time assisted annotation in various image processing tasks is possible to support users during this process. It aims to simplify annotation, increase user efficiency, enhance annotation quality, and provide additional useful annotation-related functionalities. KaIDA is available open-source athttps://git.scc.kit.edu/sc1357/kaida.
- Open Access
- 1 August 2022
- Published by Walter de Gruyter GmbH in Current Directions in Biomedical Engineering
- Vol. 8 (2) , 197-200
Impact of Annotation Noise on Histopathology Nucleus Segmentation
Deep learning is often used for automated diagnosis support in biomedical image processing scenarios. Annotated datasets are essential for the supervised training of deep neural networks. The problem of consistent and noise-free annotation remains for experts such as pathologists. The variability within an annotator (intra) and the variability between annotators (inter) are current challenges. In clinical practice or biology, instance segmentation is a common task, but a comprehensive and quantitative study regarding the impact of noisy annotations lacks. In this paper, we present a concept to categorize and simulate various types of annotation noise as well as an evaluation of the impact on deep learning pipelines. Thereby, we use the multi-organ histology image dataset MoNuSeg to discuss the influence of annotator variability. We provide annotation recommendations for clinicians to achieve high-quality automated diagnostic algorithms.
- 1 August 2022
- Published by Walter de Gruyter GmbH in Current Directions in Biomedical Engineering
- Vol. 8 (2) , 197-200
Open AccessImpact of Annotation Noise on Histopathology Nucleus Segmentation
Deep learning is often used for automated diagnosis support in biomedical image processing scenarios. Annotated datasets are essential for the supervised training of deep neural networks. The problem of consistent and noise-free annotation remains for experts such as pathologists. The variability within an annotator (intra) and the variability between annotators (inter) are current challenges. In clinical practice or biology, instance segmentation is a common task, but a comprehensive and quantitative study regarding the impact of noisy annotations lacks. In this paper, we present a concept to categorize and simulate various types of annotation noise as well as an evaluation of the impact on deep learning pipelines. Thereby, we use the multi-organ histology image dataset MoNuSeg to discuss the influence of annotator variability. We provide annotation recommendations for clinicians to achieve high-quality automated diagnostic algorithms.
- Open Access
microbeSEG: A deep learning software tool with OMERO data management for efficient and accurate cell segmentation
In biotechnology, cell growth is one of the most important properties for the characterization and optimization of microbial cultures. Novel live-cell imaging methods are leading to an ever better understanding of cell cultures and their development. The key to analyzing acquired data is accurate and automated cell segmentation at the single-cell level. Therefore, we present microbeSEG, a user-friendly Python-based cell segmentation tool with a graphical user interface and OMERO data management. microbeSEG utilizes a state-of-the-art deep learning-based segmentation method and can be used for instance segmentation of a wide range of cell morphologies and imaging techniques, e.g., phase contrast or fluorescence microscopy. The main focus of microbeSEG is a comprehensible, easy, efficient, and complete workflow from the creation of training data to the final application of the trained segmentation model. We demonstrate that accurate cell segmentation results can be obtained within 45 minutes of user time. Utilizing public segmentation datasets or pre-labeling further accelerates the microbeSEG workflow. This opens the door for accurate and efficient data analysis of microbial cultures.
Open AccessmicrobeSEG: A deep learning software tool with OMERO data management for efficient and accurate cell segmentation
In biotechnology, cell growth is one of the most important properties for the characterization and optimization of microbial cultures. Novel live-cell imaging methods are leading to an ever better understanding of cell cultures and their development. The key to analyzing acquired data is accurate and automated cell segmentation at the single-cell level. Therefore, we present microbeSEG, a user-friendly Python-based cell segmentation tool with a graphical user interface and OMERO data management. microbeSEG utilizes a state-of-the-art deep learning-based segmentation method and can be used for instance segmentation of a wide range of cell morphologies and imaging techniques, e.g., phase contrast or fluorescence microscopy. The main focus of microbeSEG is a comprehensible, easy, efficient, and complete workflow from the creation of training data to the final application of the trained segmentation model. We demonstrate that accurate cell segmentation results can be obtained within 45 minutes of user time. Utilizing public segmentation datasets or pre-labeling further accelerates the microbeSEG workflow. This opens the door for accurate and efficient data analysis of microbial cultures.
- Open Access
- 4 January 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 10, 2753-2765
Automated Annotator Variability Inspection for Biomedical Image Segmentation
Supervised deep learning approaches for automated diagnosis support require datasets annotated by experts. Intra-annotator variability of a single annotator and inter-annotator variability between annotators can affect the quality of the diagnosis support. As medical experts will always differ in annotation details, quantitative studies concerning the annotation quality are of particular interest. A consistent and noise-free annotation of large-scale datasets by, for example, dermatologists or pathologists is a current challenge. Hence, methods are needed to automatically inspect annotations in datasets. In this paper, we categorize annotation noise in image segmentation tasks, present methods to simulate annotation noise, and examine the impact on the segmentation quality. Two novel automated methods to identify intra-annotator and inter-annotator inconsistencies based on uncertainty-aware deep neural networks are proposed. We demonstrate the benefits of our automated inspection methods such as focused re-inspection of noisy annotations or the detection of generally different annotation styles using the biomedical ISIC 2017 Melanoma image segmentation dataset.
- 4 January 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 10, 2753-2765
Open AccessAutomated Annotator Variability Inspection for Biomedical Image Segmentation
Supervised deep learning approaches for automated diagnosis support require datasets annotated by experts. Intra-annotator variability of a single annotator and inter-annotator variability between annotators can affect the quality of the diagnosis support. As medical experts will always differ in annotation details, quantitative studies concerning the annotation quality are of particular interest. A consistent and noise-free annotation of large-scale datasets by, for example, dermatologists or pathologists is a current challenge. Hence, methods are needed to automatically inspect annotations in datasets. In this paper, we categorize annotation noise in image segmentation tasks, present methods to simulate annotation noise, and examine the impact on the segmentation quality. Two novel automated methods to identify intra-annotator and inter-annotator inconsistencies based on uncertainty-aware deep neural networks are proposed. We demonstrate the benefits of our automated inspection methods such as focused re-inspection of noisy annotations or the detection of generally different annotation styles using the biomedical ISIC 2017 Melanoma image segmentation dataset.
- Open Access
- 14 December 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 9, 166027-166038
Grid Screener: A Tool for Automated High-Throughput Screening on Biochemical and Biological Analysis Platforms
Grid structures are common in high-throughput assays to parallelize experiments in biochemical or biological experiments. Manual analysis of grid images is laborious, time-consuming, expensive, and critical in terms of reproducibility. However, it is still common to do such analysis manually, as there is no standardized software for automated analysis. In this paper, we introduce a generic method to automatically detect grid structures in images and to perform flexible spot-wise analysis after successful grid detection. The deep learning-based approach of the grid structure detection allows being flexible concerning different grid types. The combination with a robust parameter estimation algorithm lowers the requirements of the detection quality and thus enhances robustness. Further, the method conducts semi-automated grid detection if a fully automated processing fails. An open-source software tool Grid Screener that implements the proposed methods is provided as a ready-for-use tool for researchers. The usability is demonstrated by taking different criteria into account, which are important for a successful application. We present the benefits of our proposed tool Grid Screener utilizing three different grid types in the context of high-throughput screening to show our contribution towards further lab automation. Our tool performs much faster than manual analysis, while maintaining or even enhancing accuracy.
- 14 December 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 9, 166027-166038
Open AccessGrid Screener: A Tool for Automated High-Throughput Screening on Biochemical and Biological Analysis Platforms
Grid structures are common in high-throughput assays to parallelize experiments in biochemical or biological experiments. Manual analysis of grid images is laborious, time-consuming, expensive, and critical in terms of reproducibility. However, it is still common to do such analysis manually, as there is no standardized software for automated analysis. In this paper, we introduce a generic method to automatically detect grid structures in images and to perform flexible spot-wise analysis after successful grid detection. The deep learning-based approach of the grid structure detection allows being flexible concerning different grid types. The combination with a robust parameter estimation algorithm lowers the requirements of the detection quality and thus enhances robustness. Further, the method conducts semi-automated grid detection if a fully automated processing fails. An open-source software tool Grid Screener that implements the proposed methods is provided as a ready-for-use tool for researchers. The usability is demonstrated by taking different criteria into account, which are important for a successful application. We present the benefits of our proposed tool Grid Screener utilizing three different grid types in the context of high-throughput screening to show our contribution towards further lab automation. Our tool performs much faster than manual analysis, while maintaining or even enhancing accuracy.