LRLuca Rettenberger

Luca Rettenberger

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Luca Rettenberger has a total of 32 co-authors. Here are the top co-authors by number of shared publications:

  • Markus Reischl

    Institute for Automation and Applied Informatics (IAI), Karlsruhe Institute of Technology (KIT), Eggenstein-Leopoldshafen, Germany

    6 shared publications
  • Markus Reischl

    Institute for Automation and Applied Informatics, Karlsruhe Institute of Technology, Karlsruhe , Germany

    4 shared publications
  • Mark Schutera

    Institute for Automation and Applied Informatics, Karlsruhe Institute of Technology, Eggenstein-Leopoldshafen, Germany

    2 shared publications
  • Andrea Giunto

    Division of Materials Science, Lawrence Berkeley National Laboratory, Berkeley, USA

    1 shared publication
  • Anubhav Jain

    Energy Technologies Area, Lawrence Berkeley National Laboratory, Berkeley, USA

    1 shared publication
  • Christian Pylatiuk

    Affiliation Institute for Automation and Applied Informatics, Karlsruhe Institute of Technology, Karlsruhe, Baden-Württemberg, Germany

    1 shared publication

Latest Publications

  • Open Access

    LLM‐Based Scientific Assistants for Knowledge Extraction: Which Design Choices Matter?

    by David Exler, Manuel Raimann, Marc Münker, Maxim Rosin, Joaquin E. Urrutia Gómez, Christof M. Niemeyer, Markus Reischl, Luca Rettenberger

    Large Language Model chatbots have gained significant popularity, offering knowledge to support specialists in diverse fields. However, adapting models to specific use cases and specialized domains presents considerable challenges. Hence, we introduce the LLM Playground, a comprehensive approach to optimizing LLMs for specialist applications with respect to their accuracy in answering domain‐specific questions, addressing the limitations of unmodified models. The utilized optimization techniques begin with Prompt Engineering, advance to the integration of external knowledge, and culminate in complex reasoning strategies or self‐feedback loops. This paper introduces various architectures for scientific assistants, comprising individual enhancement techniques, both in isolation and in combination with others, designed to facilitate comparisons. To demonstrate the efficacy of the LLM Playground, a chemical chatbot is set up as a case study, and the optimization techniques are compared using ChemBench, an independent question–answer benchmark for the chemical domain, to measure its performance. By providing tested, ready‐to‐deploy architectures and clear use‐case guidance, this work helps researchers and practitioners leverage LLMs in domain‐specific applications. The insights and methodologies presented in this paper contribute to the growing body of knowledge on tailoring LLMs to meet the unique demands of specialized fields.

  • Open Access

    Leveraging unlabeled SEM datasets with self-supervised learning for enhanced particle segmentation

    by Luca Rettenberger, Nathan J. Szymanski, Andrea Giunto, Olympia Dartsi, Anubhav Jain, Gerbrand Ceder, Veit Hagenmeyer, Markus Reischl

    Scanning Electron Microscopes (SEMs) are widely used in experimental science laboratories, often requiring cumbersome and repetitive user analysis. Automating SEM image analysis processes is highly desirable to address this challenge. In particle sample analysis, Machine Learning (ML) has emerged as the most effective approach for particle segmentation. However, the time-intensive process of manually annotating thousands of SEM images limits the applicability of supervised learning approaches. Self-Supervised Learning (SSL) offers a promising alternative by enabling knowledge extraction from raw, unlabeled data. This study presents a framework for evaluating SSL techniques in SEM image analysis, focusing on novel methods leveraging the ConvNeXtV2 architecture for particle detection. A dataset comprising 25,000 SEM images is curated to benchmark these proposed SSL methods. The results demonstrate that ConvNeXtV2 models, with varying parameter counts, consistently outperform other techniques in particle detection across different length scales, achieving up to a 34% reduction in relative error compared to established SSL methods. Furthermore, an ablation study explores the relationship between dataset size and SSL performance, providing actionable insights for practitioners regarding model selection and resource efficiency. This research advances the integration of SSL into autonomous analysis pipelines and supports its application in accelerating materials science discovery.


  • Top Cited Papers
    Open Access

    Assessing political bias in large language models

    by Luca Rettenberger, Markus Reischl, Mark Schutera

    Evaluating bias in Large Language Models (LLMs) has become a pivotal issue in current Artificial Intelligence (AI) research due to their significant impact on societal dynamics. Recognizing political bias in LLMs is particularly important as they approach performative prediction, influencing societal behavior and political events, such as the upcoming European Parliament elections. From a German voter’s perspective, we evaluate the political bias of the currently most popular open-source LLMs concerning political issues within the European Union. To do so, we use the "Wahl-O-Mat," a voting advice application used in Germany. We show that larger models, such as Llama3-70B, tend to align more closely with left-leaning political parties, while smaller models often remain neutral, particularly when prompted in English. The central finding is that LLMs are similarly biased, with low variances in the alignment concerning a specific party. Our findings offer crucial insights for developers and policymakers to understand and mitigate LLM biases, emphasizing the need for rigorous bias assessment to ensure the integrity and trustworthiness of AI applications.


  • Open Access

    Using Large Language Models for Extracting Structured Information From Scientific Texts

    by Luca Rettenberger, Marc F. Münker, Mark Schutera, Christof M. Niemeyer, Kersten S. Rabe, Markus Reischl

    Extracting structured information from scientific works is challenging as sought parameters or properties are often scattered across lengthy texts. We introduce a novel iterative approach using Large Language Models (LLMs) to automate this process. Our method first condenses scientific literature, preserving essential information in a dense format, then retrieves predefined attributes. As a biomedical application example, our concept is employed to extract experimental parameters for preparing Metal-Organic Frameworks (MOFs) from scientific work to enable complex and information-rich applications in the biotechnology-oriented life sciences. Our open-source method automates extracting information from verbose texts, converting them into structured and easily navigable data. This considerably improves scientific literature research by utilizing the power of LLMs and paves the way for enhanced and faster information extraction from extensive scientific texts.


  • Open Access

    Uncertainty-aware particle segmentation for electron microscopy at varied length scales

    by Luca Rettenberger, Nathan J. Szymanski, Yan Zeng, Jan Schuetzke, Shilong Wang, Gerbrand Ceder, Markus Reischl

    Electron microscopy is indispensable for examining the morphology and composition of solid materials at the sub-micron scale. To study the powder samples that are widely used in materials development, scanning electron microscopes (SEMs) are increasingly used at the laboratory scale to generate large datasets with hundreds of images. Parsing these images to identify distinct particles and determine their morphology requires careful analysis, and automating this process remains challenging. In this work, we enhance the Mask R-CNN architecture to develop a method for automated segmentation of particles in SEM images. We address several challenges inherent to measurements, such as image blur and particle agglomeration. Moreover, our method accounts for prediction uncertainty when such issues prevent accurate segmentation of a particle. Recognizing that disparate length scales are often present in large datasets, we use this framework to create two models that are separately trained to handle images obtained at low or high magnification. By testing these models on a variety of inorganic samples, our approach to particle segmentation surpasses an established automated segmentation method and yields comparable results to the predictions of three domain experts, revealing comparable accuracy while requiring a fraction of the time. These findings highlight the potential of deep learning in advancing autonomous workflows for materials characterization.


  • Open Access

    Mask R-CNN Outperforms U-Net in Instance Segmentation for Overlapping Cells

    by Luca Rettenberger, Friedrich Rieken Münke, Roman Bruch, Markus Reischl

    U-Net is the go-to approach for biomedical segmentation applications. However, it is not designed to segment overlapping objects, a challenge Mask R-CNN has shown to have great potential in. Yet, Mask R-CNN receives little attention in biomedicine. Hence, we evaluate both approaches on a publicly available biomedical dataset. We find that Mask RCNN outperforms U-Net in segmenting overlapping cells and achieves comparable performance if they do not intersect. Our study provides valuable decision support to practitioners in selecting an appropriate method when solving instance segmentation tasks using deep learning, as well as important insights into enhancing the accuracy of such approaches in biomedical image analysis.


  • Open Access

    Self-Supervised Learning for Annotation Efficient Biomedical Image Segmentation

    by Luca Rettenberger, Marcel Schilling, Stefan Elser, Moritz Böhland, Markus Reischl

    Objective : The scarcity of high-quality annotated data is omnipresent in machine learning. Especially in biomedical segmentation applications, experts need to spend a lot of their time into annotating due to the complexity. Hence, methods to reduce such efforts are desired. Methods : Self-Supervised Learning (SSL) is an emerging field that increases performance when unannotated data is present. However, profound studies regarding segmentation tasks and small datasets are still absent. A comprehensive qualitative and quantitative evaluation is conducted, examining SSL's applicability with a focus on biomedical imaging. We consider various metrics and introduce multiple novel application-specific measures. All metrics and state-of-the-art methods are provided in a directly applicable software package ( https://osf.io/gu2t8/ ). Results : We show that SSL can lead to performance improvements of up to 10%, which is especially notable for methods designed for segmentation tasks. Conclusion : SSL is a sensible approach to data-efficient learning, especially for biomedical applications, where generating annotations requires much effort. Additionally, our extensive evaluation pipeline is vital since there are significant differences between the various approaches. Significance : We provide biomedical practitioners with an overview of innovative data-efficient solutions and a novel toolbox for their own application of new approaches. Our pipeline for analyzing SSL methods is provided as a ready-to-use software package.


  • Automated Zebrafish Phenotype Pattern Recognition: 6 Years Ago, and Now

    by Mark Schutera, Luca Rettenberger, Markus Reischl

    The article assesses the developments in automated phenotype pattern recognition: Potential spikes in classification performance, even when facing the common small-scale biomedical data set, and as a reader, you will find out about changes in the development effort and complexity for researchers and practitioners. After reading, you will be aware of the benefits and unreasonable effectiveness and ease of use of an automated end-to-end deep learning pipeline for classification tasks of biomedical perception systems.

  • Open Access

    Annotation Efforts in Image Segmentation can be Reduced by Neural Network Bootstrapping

    by Luca Rettenberger, Marcel Schilling, Markus Reischl

    Modern medical technology offers potential for the automatic generation of datasets that can be fed into deep learning systems. However, even though raw data for supporting diagnostics can be obtained with manageable effort, generating annotations is burdensome and time-consuming. Since annotating images for semantic segmentation is particularly exhausting, methods to reduce the human effort are especially valuable. We propose a combined framework that utilizes unsupervised machine learning to automatically generate segmentation masks. Experiments on two biomedical datasets show that our approach generates noticeably better annotations than Otsu thresholding and k-means clustering without needing any additional manual effort. Using our framework, unannotated datasets can be amended with pre-annotations fully unsupervised thus reducing the human effort to a minimum.


  • Open Access

    Methods for the frugal labeler: Multi-class semantic segmentation on heterogeneous labels

    by Mark Schutera, Luca Rettenberger, Christian Pylatiuk, Markus Reischl

    Deep learning increasingly accelerates biomedical research, deploying neural networks for multiple tasks, such as image classification, object detection, and semantic segmentation. However, neural networks are commonly trained supervised on large-scale, labeled datasets. These prerequisites raise issues in biomedical image recognition, as datasets are generally small-scale, challenging to obtain, expensive to label, and frequently heterogeneously labeled. Furthermore, heterogeneous labels are a challenge for supervised methods. If not all classes are labeled for an individual sample, supervised deep learning approaches can only learn on a subset of the dataset with common labels for each individual sample; consequently, biomedical image recognition engineers need to be frugal concerning their label and ground truth requirements. This paper discusses the effects of frugal labeling and proposes to train neural networks for multi-class semantic segmentation on heterogeneously labeled data based on a novel objective function. The objective function combines a class asymmetric loss with the Dice loss. The approach is demonstrated for training on the sparse ground truth of a heterogeneous labeled dataset, training within a transfer learning setting, and the use-case of merging multiple heterogeneously labeled datasets. For this purpose, a biomedical small-scale, multi-class semantic segmentation dataset is utilized. The heartSeg dataset is based on the medaka fish’s position as a cardiac model system. Automating image recognition and semantic segmentation enables high-throughput experiments and is essential for biomedical research. Our approach and analysis show competitive results in supervised training regimes and encourage frugal labeling within biomedical image recognition.