PLPhilipp Lottes

Philipp Lottes

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Philipp Lottes has a total of 37 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Unsupervised Generation of Labeled Training Images for Crop-Weed Segmentation in New Fields and on Different Robotic Platforms

    by Yue Linn Chong, Jan Weyler, Philipp Lottes, Jens Behley, Cyrill Stachniss

    Agricultural robots have the potential to improve the efficiency and sustainability of existing agricultural practices. Most autonomous agricultural robots rely on machine vision systems. Such systems, however, often perform worse in new fields or when the robotic platforms change. While we can alleviate the performance degradation by manually labeling more data obtained in the new setup, this procedure is labor and cost-intensive. Therefore, we propose an approach to improve the performance of machine vision systems for new fields and different robotic platforms without additional manual labeling. In an unsupervised manner, our approach can generate images and corresponding labels to train machine vision systems. We use StyleGAN2 to generate images that appear like they are from desired new field or robotic platform. Additionally, we propose a label refinement method to generate labels corresponding to the generated images. We show that our approach can improve the performance of the crop-weed segmentation task in new fields and on different robotic platforms without additional manual labeling.


  • Joint Plant and Leaf Instance Segmentation on Field-Scale UAV Imagery

    by Jan Weyler, Jan Quakernack, Philipp Lottes, Jens Behley, Cyrill Stachniss

    Monitoring of fields and breeding plots is critical for farmers, plant scientists, and breeders. In this process, a key objective is to assess and monitor the growth stages together with the number of individual plants on the field. Traditionally, this in-field assessment is performed manually and thus is limited in temporal and spatial throughput. In contrast, vision-based systems offer the potential to assess these traits frequently in an automated fashion on a large scale. The primary target of these systems is to detect and segment each plant and its leaves since this information directly correlates to the growth stage and allows for detailed monitoring. In this letter, we address the problem of automated, instance-level plant monitoring in agricultural fields and breeding plots. We propose a vision-based approach to perform a joint instance segmentation of crop plants and leaves in breeding plots. We develop a convolutional neural network to determine the position of specific plant keypoints and group pixels to detect individual leaf and plant instances. Finally, we provide a pixel-wise instance segmentation of each crop and its associated leaves based on orthorectified RGB images captured by UAVs. The experimental evaluation shows that our method outperforms state-of-the-art instance segmentation approaches such as Mask-RCNN on this task.


  • Building an Aerial–Ground Robotics System for Precision Farming: An Adaptable Solution

    by Alberto Pretto, Stephanie Aravecchia, Wolfram Burgard, Nived Chebrolu, Christian Dornhege, Tillmann Falck, Freya Veronika Fleckenstein, Alessandra Fontenla, Marco Imperoli, Raghav Khanna, et al.


  • Top Cited Papers

    Robotic weed control using automated weed and crop classification

    by Xiaolong Wu, Stéphanie Aravecchia, Philipp Lottes, Cyrill Stachniss, Cédric Pradalier

    Autonomous robotic weeding systems in precision farming have demonstrated their full potential to alleviate the current dependency on agrochemicals such as herbicides and pesticides, thus reducing environmental pollution and improving sustainability. However, most previous works require fast and constant‐time weed detection systems to achieve real‐time treatment, which forecloses the implementation of more capable but time‐consuming algorithms, for example, learning‐based methods. In this paper, a nonoverlapping multicamera system is applied to provide flexibility for the weed control system in dealing with the indeterminate classification delays. The design, implementation, and testing of our proposed modular weed control unit with mechanical and chemical weeding tools are presented. A framework that performs naive Bayes filtering, 3D direct intra‐ and inter‐camera visual tracking, and predictive control, while integrating state‐of‐the‐art crop/weed detection algorithms, is developed to guide the tools to achieve high‐precision weed removal. The experimental results show that our proposed fully operational weed control system is capable of performing selective mechanical as well as chemical in‐row weeding with indeterminate detection delays in different terrain conditions and crop growth stages.


  • Robust joint stem detection and crop‐weed classification using image sequences for plant‐specific treatment in precision farming

    by Philipp Lottes, Jens Behley, Nived Chebrolu, Andres Milioto, Cyrill Stachniss

    Conventional farming still relies on large quantities of agrochemicals for weed management which have several negative side‐effects on the environment. Autonomous robots offer the potential to reduce the amount of chemicals applied, as robots can monitor and treat each plant in the field individually and thereby circumventing the uniform chemical treatment of the whole field. Such agricultural robots need the ability to identify individual crops and weeds in the field using sensor data and must additionally select effective treatment methods based on the type of weed. For example, certain types of weeds can only be effectively treated mechanically due to their resistance to herbicides, whereas other types can be treated trough selective spraying. In this article, we present a novel system that provides the necessary information for effective plant‐specific treatment. It estimates the stem location for weeds, which enables the robots to perform precise mechanical treatment, and at the same time provides the pixel‐accurate area covered by weeds for treatment through selective spraying. The major challenge in developing such a system is the large variability in the visual appearance that occurs in different fields. Thus, an effective classification system has to robustly handle substantial environmental changes including varying weed pressure, various weed types, different growth stages, changing visual appearance of the plants and the soil. Our approach uses an end‐to‐end trainable fully convolutional network that simultaneously estimates plant stem positions as well as the spatial extent of crop plants and weeds. It jointly learns how to detect the stems and the pixel‐wise semantic segmentation and incorporates spatial information by considering image sequences of local field strips. The jointly learned feature representation for both tasks furthermore exploits the crop arrangement information that is often present in crop fields. This information is considered even if it is only observable from the image sequences and not a single image. Such image sequences, as typically provided by robots navigating over the field along crop rows, enable our approach to robustly estimate the semantic segmentation and stem positions despite the large variations encountered in different fields. We implemented and thoroughly tested our approach on images from multiple farms in different countries. The experiments show that our system generalizes well to previously unseen fields under varying environmental conditions—a key capability to deploy such systems in the real world. Compared to state‐of‐the‐art approaches, our approach generalizes well to unseen fields and not only substantially improves the stem detection accuracy, that is, distinguishing crop and weed stems, but also improves the semantic segmentation performance.


  • Top Cited Papers

    Fully Convolutional Networks With Sequential Information for Robust Crop and Weed Detection in Precision Farming

    by Philipp Lottes, Jens Behley, Andres Milioto, Cyrill Stachniss

    Reducing the use of agrochemicals is an important component towards sustainable agriculture. Robots that can perform targeted weed control offer the potential to contribute to this goal, for example, through specialized weeding actions such as selective spraying or mechanical weed removal. A prerequisite of such systems is a reliable and robust plant classification system that is able to distinguish crop and weed in the field. A major challenge in this context is the fact that different fields show a large variability. Thus, classification systems have to robustly cope with substantial environmental changes with respect to weed pressure and weed types, growth stages of the crop, visual appearance, and soil conditions. In this paper, we propose a novel crop-weed classification system that relies on a fully convolutional network with an encoder-decoder structure and incorporates spatial information by considering image sequences. Exploiting the crop arrangement information that is observable from the image sequences enables our system to robustly estimate a pixel-wise labeling of the images into crop and weed, i.e., a semantic segmentation. We provide a thorough experimental evaluation, which shows that our system generalizes well to previously unseen fields under varying environmental conditions -- a key capability to actually use such systems in precision framing. We provide comparisons to other state-of-the-art approaches and show that our system substantially improves the accuracy of crop-weed classification without requiring a retraining of the model.


  • Open Access

    REAL-TIME BLOB-WISE SUGAR BEETS VS WEEDS CLASSIFICATION FOR MONITORING FIELDS USING CONVOLUTIONAL NEURAL NETWORKS

    by A. Milioto, P. Lottes, C. Stachniss

    UAVs are becoming an important tool for field monitoring and precision farming. A prerequisite for observing and analyzing fields is the ability to identify crops and weeds from image data. In this paper, we address the problem of detecting the sugar beet plants and weeds in the field based solely on image data. We propose a system that combines vegetation detection and deep learning to obtain a high-quality classification of the vegetation in the field into value crops and weeds. We implemented and thoroughly evaluated our system on image data collected from different sugar beet fields and illustrate that our approach allows for accurately identifying the weeds on the field.


  • Effective Vision‐based Classification for Separating Sugar Beets and Weeds for Precision Farming

    by Philipp Lottes, Markus Hörferlin, Slawomir Sander, Cyrill Stachniss

    The use of robots in precision farming has the potential to reduce the reliance on herbicides and pesticides through selectively spraying individual plants or through manual weed removal. A prerequisite for that is the ability of the robot to separate and identify the value crops and the weeds in the field. Based on the output of the robot's perception system, it can trigger the actuators for spraying or removal. In this paper, we address the problem of detecting sugar beet plants as well as weeds using a camera installed on a mobile field robot. We propose a system that performs vegetation detection, local as well as object‐based feature extraction, random forest classification, and smoothing through a Markov random field to obtain an accurate estimate of crops and weeds. We implemented and thoroughly evaluated our system using a real farm robot in different sugar beet fields, and we illustrate that our approach allows for accurately identifying weeds in a field.