Luca Rettenberger
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Luca Rettenberger has a total of 32 co-authors. Here are the top co-authors by number of shared publications:
- Markus Reischl
Institute for Automation and Applied Informatics (IAI), Karlsruhe Institute of Technology (KIT), Eggenstein-Leopoldshafen, Germany
6 shared publications Markus Reischl
Institute for Automation and Applied Informatics, Karlsruhe Institute of Technology, Karlsruhe , Germany
4 shared publications- Mark Schutera
Institute for Automation and Applied Informatics, Karlsruhe Institute of Technology, Eggenstein-Leopoldshafen, Germany
2 shared publications Andrea Giunto
Division of Materials Science, Lawrence Berkeley National Laboratory, Berkeley, USA
1 shared publicationAnubhav Jain
Energy Technologies Area, Lawrence Berkeley National Laboratory, Berkeley, USA
1 shared publicationChristian Pylatiuk
Affiliation Institute for Automation and Applied Informatics, Karlsruhe Institute of Technology, Karlsruhe, Baden-Württemberg, Germany
1 shared publication
Latest Publications
- Open Access
- 21 April 2026
- Published by Wiley in Advanced Intelligent Discovery
LLM‐Based Scientific Assistants for Knowledge Extraction: Which Design Choices Matter?
Large Language Model chatbots have gained significant popularity, offering knowledge to support specialists in diverse fields. However, adapting models to specific use cases and specialized domains presents considerable challenges. Hence, we introduce the LLM Playground, a comprehensive approach to optimizing LLMs for specialist applications with respect to their accuracy in answering domain‐specific questions, addressing the limitations of unmodified models. The utilized optimization techniques begin with Prompt Engineering, advance to the integration of external knowledge, and culminate in complex reasoning strategies or self‐feedback loops. This paper introduces various architectures for scientific assistants, comprising individual enhancement techniques, both in isolation and in combination with others, designed to facilitate comparisons. To demonstrate the efficacy of the LLM Playground, a chemical chatbot is set up as a case study, and the optimization techniques are compared using ChemBench, an independent question–answer benchmark for the chemical domain, to measure its performance. By providing tested, ready‐to‐deploy architectures and clear use‐case guidance, this work helps researchers and practitioners leverage LLMs in domain‐specific applications. The insights and methodologies presented in this paper contribute to the growing body of knowledge on tailoring LLMs to meet the unique demands of specialized fields.
- 21 April 2026
- Published by Wiley in Advanced Intelligent Discovery
Open AccessLLM‐Based Scientific Assistants for Knowledge Extraction: Which Design Choices Matter?
Large Language Model chatbots have gained significant popularity, offering knowledge to support specialists in diverse fields. However, adapting models to specific use cases and specialized domains presents considerable challenges. Hence, we introduce the LLM Playground, a comprehensive approach to optimizing LLMs for specialist applications with respect to their accuracy in answering domain‐specific questions, addressing the limitations of unmodified models. The utilized optimization techniques begin with Prompt Engineering, advance to the integration of external knowledge, and culminate in complex reasoning strategies or self‐feedback loops. This paper introduces various architectures for scientific assistants, comprising individual enhancement techniques, both in isolation and in combination with others, designed to facilitate comparisons. To demonstrate the efficacy of the LLM Playground, a chemical chatbot is set up as a case study, and the optimization techniques are compared using ChemBench, an independent question–answer benchmark for the chemical domain, to measure its performance. By providing tested, ready‐to‐deploy architectures and clear use‐case guidance, this work helps researchers and practitioners leverage LLMs in domain‐specific applications. The insights and methodologies presented in this paper contribute to the growing body of knowledge on tailoring LLMs to meet the unique demands of specialized fields.
- Open Access
- 22 September 2025
- Published by Springer Nature in npj Computational Materials
- Vol. 11 (1) , 1-12
Leveraging unlabeled SEM datasets with self-supervised learning for enhanced particle segmentation
Scanning Electron Microscopes (SEMs) are widely used in experimental science laboratories, often requiring cumbersome and repetitive user analysis. Automating SEM image analysis processes is highly desirable to address this challenge. In particle sample analysis, Machine Learning (ML) has emerged as the most effective approach for particle segmentation. However, the time-intensive process of manually annotating thousands of SEM images limits the applicability of supervised learning approaches. Self-Supervised Learning (SSL) offers a promising alternative by enabling knowledge extraction from raw, unlabeled data. This study presents a framework for evaluating SSL techniques in SEM image analysis, focusing on novel methods leveraging the ConvNeXtV2 architecture for particle detection. A dataset comprising 25,000 SEM images is curated to benchmark these proposed SSL methods. The results demonstrate that ConvNeXtV2 models, with varying parameter counts, consistently outperform other techniques in particle detection across different length scales, achieving up to a 34% reduction in relative error compared to established SSL methods. Furthermore, an ablation study explores the relationship between dataset size and SSL performance, providing actionable insights for practitioners regarding model selection and resource efficiency. This research advances the integration of SSL into autonomous analysis pipelines and supports its application in accelerating materials science discovery.
- 22 September 2025
- Published by Springer Nature in npj Computational Materials
- Vol. 11 (1) , 1-12
Open AccessLeveraging unlabeled SEM datasets with self-supervised learning for enhanced particle segmentation
Scanning Electron Microscopes (SEMs) are widely used in experimental science laboratories, often requiring cumbersome and repetitive user analysis. Automating SEM image analysis processes is highly desirable to address this challenge. In particle sample analysis, Machine Learning (ML) has emerged as the most effective approach for particle segmentation. However, the time-intensive process of manually annotating thousands of SEM images limits the applicability of supervised learning approaches. Self-Supervised Learning (SSL) offers a promising alternative by enabling knowledge extraction from raw, unlabeled data. This study presents a framework for evaluating SSL techniques in SEM image analysis, focusing on novel methods leveraging the ConvNeXtV2 architecture for particle detection. A dataset comprising 25,000 SEM images is curated to benchmark these proposed SSL methods. The results demonstrate that ConvNeXtV2 models, with varying parameter counts, consistently outperform other techniques in particle detection across different length scales, achieving up to a 34% reduction in relative error compared to established SSL methods. Furthermore, an ablation study explores the relationship between dataset size and SSL performance, providing actionable insights for practitioners regarding model selection and resource efficiency. This research advances the integration of SSL into autonomous analysis pipelines and supports its application in accelerating materials science discovery.
- Top Cited PapersOpen Access
- 28 February 2025
- Published by Springer Nature in Journal of Computational Social Science
- Vol. 8 (2) , 1-17
Assessing political bias in large language models
Evaluating bias in Large Language Models (LLMs) has become a pivotal issue in current Artificial Intelligence (AI) research due to their significant impact on societal dynamics. Recognizing political bias in LLMs is particularly important as they approach performative prediction, influencing societal behavior and political events, such as the upcoming European Parliament elections. From a German voter’s perspective, we evaluate the political bias of the currently most popular open-source LLMs concerning political issues within the European Union. To do so, we use the "Wahl-O-Mat," a voting advice application used in Germany. We show that larger models, such as Llama3-70B, tend to align more closely with left-leaning political parties, while smaller models often remain neutral, particularly when prompted in English. The central finding is that LLMs are similarly biased, with low variances in the alignment concerning a specific party. Our findings offer crucial insights for developers and policymakers to understand and mitigate LLM biases, emphasizing the need for rigorous bias assessment to ensure the integrity and trustworthiness of AI applications.
- 28 February 2025
- Published by Springer Nature in Journal of Computational Social Science
- Vol. 8 (2) , 1-17
Top Cited PapersOpen AccessAssessing political bias in large language models
Evaluating bias in Large Language Models (LLMs) has become a pivotal issue in current Artificial Intelligence (AI) research due to their significant impact on societal dynamics. Recognizing political bias in LLMs is particularly important as they approach performative prediction, influencing societal behavior and political events, such as the upcoming European Parliament elections. From a German voter’s perspective, we evaluate the political bias of the currently most popular open-source LLMs concerning political issues within the European Union. To do so, we use the "Wahl-O-Mat," a voting advice application used in Germany. We show that larger models, such as Llama3-70B, tend to align more closely with left-leaning political parties, while smaller models often remain neutral, particularly when prompted in English. The central finding is that LLMs are similarly biased, with low variances in the alignment concerning a specific party. Our findings offer crucial insights for developers and policymakers to understand and mitigate LLM biases, emphasizing the need for rigorous bias assessment to ensure the integrity and trustworthiness of AI applications.
- Open Access
- 1 December 2024
- Published by Walter de Gruyter GmbH in Current Directions in Biomedical Engineering
- Vol. 10 (4) , 526-529
Using Large Language Models for Extracting Structured Information From Scientific Texts
Extracting structured information from scientific works is challenging as sought parameters or properties are often scattered across lengthy texts. We introduce a novel iterative approach using Large Language Models (LLMs) to automate this process. Our method first condenses scientific literature, preserving essential information in a dense format, then retrieves predefined attributes. As a biomedical application example, our concept is employed to extract experimental parameters for preparing Metal-Organic Frameworks (MOFs) from scientific work to enable complex and information-rich applications in the biotechnology-oriented life sciences. Our open-source method automates extracting information from verbose texts, converting them into structured and easily navigable data. This considerably improves scientific literature research by utilizing the power of LLMs and paves the way for enhanced and faster information extraction from extensive scientific texts.
- 1 December 2024
- Published by Walter de Gruyter GmbH in Current Directions in Biomedical Engineering
- Vol. 10 (4) , 526-529
Open AccessUsing Large Language Models for Extracting Structured Information From Scientific Texts
Extracting structured information from scientific works is challenging as sought parameters or properties are often scattered across lengthy texts. We introduce a novel iterative approach using Large Language Models (LLMs) to automate this process. Our method first condenses scientific literature, preserving essential information in a dense format, then retrieves predefined attributes. As a biomedical application example, our concept is employed to extract experimental parameters for preparing Metal-Organic Frameworks (MOFs) from scientific work to enable complex and information-rich applications in the biotechnology-oriented life sciences. Our open-source method automates extracting information from verbose texts, converting them into structured and easily navigable data. This considerably improves scientific literature research by utilizing the power of LLMs and paves the way for enhanced and faster information extraction from extensive scientific texts.
- Open Access
- 12 June 2024
- Published by Springer Nature in npj Computational Materials
- Vol. 10 (1) , 1-9
Uncertainty-aware particle segmentation for electron microscopy at varied length scales
Electron microscopy is indispensable for examining the morphology and composition of solid materials at the sub-micron scale. To study the powder samples that are widely used in materials development, scanning electron microscopes (SEMs) are increasingly used at the laboratory scale to generate large datasets with hundreds of images. Parsing these images to identify distinct particles and determine their morphology requires careful analysis, and automating this process remains challenging. In this work, we enhance the Mask R-CNN architecture to develop a method for automated segmentation of particles in SEM images. We address several challenges inherent to measurements, such as image blur and particle agglomeration. Moreover, our method accounts for prediction uncertainty when such issues prevent accurate segmentation of a particle. Recognizing that disparate length scales are often present in large datasets, we use this framework to create two models that are separately trained to handle images obtained at low or high magnification. By testing these models on a variety of inorganic samples, our approach to particle segmentation surpasses an established automated segmentation method and yields comparable results to the predictions of three domain experts, revealing comparable accuracy while requiring a fraction of the time. These findings highlight the potential of deep learning in advancing autonomous workflows for materials characterization.
- 12 June 2024
- Published by Springer Nature in npj Computational Materials
- Vol. 10 (1) , 1-9
Open AccessUncertainty-aware particle segmentation for electron microscopy at varied length scales
Electron microscopy is indispensable for examining the morphology and composition of solid materials at the sub-micron scale. To study the powder samples that are widely used in materials development, scanning electron microscopes (SEMs) are increasingly used at the laboratory scale to generate large datasets with hundreds of images. Parsing these images to identify distinct particles and determine their morphology requires careful analysis, and automating this process remains challenging. In this work, we enhance the Mask R-CNN architecture to develop a method for automated segmentation of particles in SEM images. We address several challenges inherent to measurements, such as image blur and particle agglomeration. Moreover, our method accounts for prediction uncertainty when such issues prevent accurate segmentation of a particle. Recognizing that disparate length scales are often present in large datasets, we use this framework to create two models that are separately trained to handle images obtained at low or high magnification. By testing these models on a variety of inorganic samples, our approach to particle segmentation surpasses an established automated segmentation method and yields comparable results to the predictions of three domain experts, revealing comparable accuracy while requiring a fraction of the time. These findings highlight the potential of deep learning in advancing autonomous workflows for materials characterization.
- Open Access
- 1 September 2023
- Published by Walter de Gruyter GmbH in Current Directions in Biomedical Engineering
- Vol. 9 (1) , 335-338
Mask R-CNN Outperforms U-Net in Instance Segmentation for Overlapping Cells
U-Net is the go-to approach for biomedical segmentation applications. However, it is not designed to segment overlapping objects, a challenge Mask R-CNN has shown to have great potential in. Yet, Mask R-CNN receives little attention in biomedicine. Hence, we evaluate both approaches on a publicly available biomedical dataset. We find that Mask RCNN outperforms U-Net in segmenting overlapping cells and achieves comparable performance if they do not intersect. Our study provides valuable decision support to practitioners in selecting an appropriate method when solving instance segmentation tasks using deep learning, as well as important insights into enhancing the accuracy of such approaches in biomedical image analysis.
- 1 September 2023
- Published by Walter de Gruyter GmbH in Current Directions in Biomedical Engineering
- Vol. 9 (1) , 335-338
Open AccessMask R-CNN Outperforms U-Net in Instance Segmentation for Overlapping Cells
U-Net is the go-to approach for biomedical segmentation applications. However, it is not designed to segment overlapping objects, a challenge Mask R-CNN has shown to have great potential in. Yet, Mask R-CNN receives little attention in biomedicine. Hence, we evaluate both approaches on a publicly available biomedical dataset. We find that Mask RCNN outperforms U-Net in segmenting overlapping cells and achieves comparable performance if they do not intersect. Our study provides valuable decision support to practitioners in selecting an appropriate method when solving instance segmentation tasks using deep learning, as well as important insights into enhancing the accuracy of such approaches in biomedical image analysis.
- Open Access
- 6 March 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Biomedical Engineering
- Vol. 70 (9) , 2519-2528
Self-Supervised Learning for Annotation Efficient Biomedical Image Segmentation
Objective : The scarcity of high-quality annotated data is omnipresent in machine learning. Especially in biomedical segmentation applications, experts need to spend a lot of their time into annotating due to the complexity. Hence, methods to reduce such efforts are desired. Methods : Self-Supervised Learning (SSL) is an emerging field that increases performance when unannotated data is present. However, profound studies regarding segmentation tasks and small datasets are still absent. A comprehensive qualitative and quantitative evaluation is conducted, examining SSL's applicability with a focus on biomedical imaging. We consider various metrics and introduce multiple novel application-specific measures. All metrics and state-of-the-art methods are provided in a directly applicable software package ( https://osf.io/gu2t8/ ). Results : We show that SSL can lead to performance improvements of up to 10%, which is especially notable for methods designed for segmentation tasks. Conclusion : SSL is a sensible approach to data-efficient learning, especially for biomedical applications, where generating annotations requires much effort. Additionally, our extensive evaluation pipeline is vital since there are significant differences between the various approaches. Significance : We provide biomedical practitioners with an overview of innovative data-efficient solutions and a novel toolbox for their own application of new approaches. Our pipeline for analyzing SSL methods is provided as a ready-to-use software package.
- 6 March 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Biomedical Engineering
- Vol. 70 (9) , 2519-2528
Open AccessSelf-Supervised Learning for Annotation Efficient Biomedical Image Segmentation
Objective : The scarcity of high-quality annotated data is omnipresent in machine learning. Especially in biomedical segmentation applications, experts need to spend a lot of their time into annotating due to the complexity. Hence, methods to reduce such efforts are desired. Methods : Self-Supervised Learning (SSL) is an emerging field that increases performance when unannotated data is present. However, profound studies regarding segmentation tasks and small datasets are still absent. A comprehensive qualitative and quantitative evaluation is conducted, examining SSL's applicability with a focus on biomedical imaging. We consider various metrics and introduce multiple novel application-specific measures. All metrics and state-of-the-art methods are provided in a directly applicable software package ( https://osf.io/gu2t8/ ). Results : We show that SSL can lead to performance improvements of up to 10%, which is especially notable for methods designed for segmentation tasks. Conclusion : SSL is a sensible approach to data-efficient learning, especially for biomedical applications, where generating annotations requires much effort. Additionally, our extensive evaluation pipeline is vital since there are significant differences between the various approaches. Significance : We provide biomedical practitioners with an overview of innovative data-efficient solutions and a novel toolbox for their own application of new approaches. Our pipeline for analyzing SSL methods is provided as a ready-to-use software package.
- 1 December 2022
- Published by SAGE Publications in Zebrafish
- Vol. 19 (6) , 213-217
Automated Zebrafish Phenotype Pattern Recognition: 6 Years Ago, and Now
The article assesses the developments in automated phenotype pattern recognition: Potential spikes in classification performance, even when facing the common small-scale biomedical data set, and as a reader, you will find out about changes in the development effort and complexity for researchers and practitioners. After reading, you will be aware of the benefits and unreasonable effectiveness and ease of use of an automated end-to-end deep learning pipeline for classification tasks of biomedical perception systems.
- 1 December 2022
- Published by SAGE Publications in Zebrafish
- Vol. 19 (6) , 213-217
Automated Zebrafish Phenotype Pattern Recognition: 6 Years Ago, and Now
The article assesses the developments in automated phenotype pattern recognition: Potential spikes in classification performance, even when facing the common small-scale biomedical data set, and as a reader, you will find out about changes in the development effort and complexity for researchers and practitioners. After reading, you will be aware of the benefits and unreasonable effectiveness and ease of use of an automated end-to-end deep learning pipeline for classification tasks of biomedical perception systems.
- Open Access
- 1 August 2022
- Published by Walter de Gruyter GmbH in Current Directions in Biomedical Engineering
- Vol. 8 (2) , 329-332
Annotation Efforts in Image Segmentation can be Reduced by Neural Network Bootstrapping
Modern medical technology offers potential for the automatic generation of datasets that can be fed into deep learning systems. However, even though raw data for supporting diagnostics can be obtained with manageable effort, generating annotations is burdensome and time-consuming. Since annotating images for semantic segmentation is particularly exhausting, methods to reduce the human effort are especially valuable. We propose a combined framework that utilizes unsupervised machine learning to automatically generate segmentation masks. Experiments on two biomedical datasets show that our approach generates noticeably better annotations than Otsu thresholding and k-means clustering without needing any additional manual effort. Using our framework, unannotated datasets can be amended with pre-annotations fully unsupervised thus reducing the human effort to a minimum.
- 1 August 2022
- Published by Walter de Gruyter GmbH in Current Directions in Biomedical Engineering
- Vol. 8 (2) , 329-332
Open AccessAnnotation Efforts in Image Segmentation can be Reduced by Neural Network Bootstrapping
Modern medical technology offers potential for the automatic generation of datasets that can be fed into deep learning systems. However, even though raw data for supporting diagnostics can be obtained with manageable effort, generating annotations is burdensome and time-consuming. Since annotating images for semantic segmentation is particularly exhausting, methods to reduce the human effort are especially valuable. We propose a combined framework that utilizes unsupervised machine learning to automatically generate segmentation masks. Experiments on two biomedical datasets show that our approach generates noticeably better annotations than Otsu thresholding and k-means clustering without needing any additional manual effort. Using our framework, unannotated datasets can be amended with pre-annotations fully unsupervised thus reducing the human effort to a minimum.
- Open Access
- 8 February 2022
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 17 (2) , e0263656
Methods for the frugal labeler: Multi-class semantic segmentation on heterogeneous labels
Deep learning increasingly accelerates biomedical research, deploying neural networks for multiple tasks, such as image classification, object detection, and semantic segmentation. However, neural networks are commonly trained supervised on large-scale, labeled datasets. These prerequisites raise issues in biomedical image recognition, as datasets are generally small-scale, challenging to obtain, expensive to label, and frequently heterogeneously labeled. Furthermore, heterogeneous labels are a challenge for supervised methods. If not all classes are labeled for an individual sample, supervised deep learning approaches can only learn on a subset of the dataset with common labels for each individual sample; consequently, biomedical image recognition engineers need to be frugal concerning their label and ground truth requirements. This paper discusses the effects of frugal labeling and proposes to train neural networks for multi-class semantic segmentation on heterogeneously labeled data based on a novel objective function. The objective function combines a class asymmetric loss with the Dice loss. The approach is demonstrated for training on the sparse ground truth of a heterogeneous labeled dataset, training within a transfer learning setting, and the use-case of merging multiple heterogeneously labeled datasets. For this purpose, a biomedical small-scale, multi-class semantic segmentation dataset is utilized. The heartSeg dataset is based on the medaka fish’s position as a cardiac model system. Automating image recognition and semantic segmentation enables high-throughput experiments and is essential for biomedical research. Our approach and analysis show competitive results in supervised training regimes and encourage frugal labeling within biomedical image recognition.
- 8 February 2022
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 17 (2) , e0263656
Open AccessMethods for the frugal labeler: Multi-class semantic segmentation on heterogeneous labels
Deep learning increasingly accelerates biomedical research, deploying neural networks for multiple tasks, such as image classification, object detection, and semantic segmentation. However, neural networks are commonly trained supervised on large-scale, labeled datasets. These prerequisites raise issues in biomedical image recognition, as datasets are generally small-scale, challenging to obtain, expensive to label, and frequently heterogeneously labeled. Furthermore, heterogeneous labels are a challenge for supervised methods. If not all classes are labeled for an individual sample, supervised deep learning approaches can only learn on a subset of the dataset with common labels for each individual sample; consequently, biomedical image recognition engineers need to be frugal concerning their label and ground truth requirements. This paper discusses the effects of frugal labeling and proposes to train neural networks for multi-class semantic segmentation on heterogeneously labeled data based on a novel objective function. The objective function combines a class asymmetric loss with the Dice loss. The approach is demonstrated for training on the sparse ground truth of a heterogeneous labeled dataset, training within a transfer learning setting, and the use-case of merging multiple heterogeneously labeled datasets. For this purpose, a biomedical small-scale, multi-class semantic segmentation dataset is utilized. The heartSeg dataset is based on the medaka fish’s position as a cardiac model system. Automating image recognition and semantic segmentation enables high-throughput experiments and is essential for biomedical research. Our approach and analysis show competitive results in supervised training regimes and encourage frugal labeling within biomedical image recognition.