Karel Zimmermann
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Karel Zimmermann has a total of 44 co-authors. Here are the top co-authors by number of shared publications:
- Tomas Svoboda
Department of Cybernetics, Faculty of Electrical Engineering, Czech Technical University in Prague, Prague, Czech Republic
9 shared publications - Teymur Azayev
Czech Technical University in Prague
4 shared publications - Tomas Petricek
Department of Cybernetics, Faculty of Electrical Engineering, Czech Technical University in Prague, Prague, Czech Republic
4 shared publications - Patrik Vacek
Department of Cybernetics, Faculty of Electrical Engineering, Czech Technical University in Prague, Prague, Czech Republic
3 shared publications - Awet Haileslassie Gebrehiwot
Dept of Cybernetics Czech Technical University in Prague FEE
2 shared publications David Hurych
Valeo.ai, Paris, France
2 shared publications
Latest Publications
- 1 January 2027
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 12 (1) , 49-56
Ostrich: Taking Large Strides Through Stiff Contact in Differentiable Dynamics
- 1 January 2027
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 12 (1) , 49-56
Ostrich: Taking Large Strides Through Stiff Contact in Differentiable Dynamics
- Open Access
- 19 August 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Vehicles
- Vol. 10 (3) , 2094-2102
Let It Flow: Simultaneous Optimization of 3D Flow and Object Clustering
We study the problem of self-supervised 3D scene flow estimation from real large-scale raw point cloud sequences. The problem is crucial to various automotive tasks like trajectory prediction, object detection, and scene reconstruction. In the absence of ground truth scene flow labels, contemporary approaches concentrate on deducing and optimizing flow across sequential pairs of point clouds by incorporating structure-based regularization on flow and object rigidity. The rigid objects are estimated by a variety of 3D spatial clustering methods. While state-of-the-art methods successfully capture overall scene motion using the Neural Prior structure, they encounter challenges in discerning multi-object motions. We identified the structural constraints and the use of large and strict rigid clusters as the main pitfall of the current approaches, and we propose a novel clustering approach that allows for a combination of overlapping soft clusters and non-overlapping rigid clusters. Flow is then jointly estimated with progressively growing non-overlapping rigid clusters together with fixed-size overlapping soft clusters. We evaluate our method on multiple datasets with LiDAR point clouds, demonstrating superior performance over the self-supervised baselines and reaching new state-of-the-art results. Our method excels in resolving flow in complicated dynamic scenes with multiple independently moving objects close to each other, including pedestrians, cyclists, and other vulnerable road users. Our codes are publicly available on https://github.com/ctu-vras/let-it-flow .
- 19 August 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Intelligent Vehicles
- Vol. 10 (3) , 2094-2102
Open AccessLet It Flow: Simultaneous Optimization of 3D Flow and Object Clustering
We study the problem of self-supervised 3D scene flow estimation from real large-scale raw point cloud sequences. The problem is crucial to various automotive tasks like trajectory prediction, object detection, and scene reconstruction. In the absence of ground truth scene flow labels, contemporary approaches concentrate on deducing and optimizing flow across sequential pairs of point clouds by incorporating structure-based regularization on flow and object rigidity. The rigid objects are estimated by a variety of 3D spatial clustering methods. While state-of-the-art methods successfully capture overall scene motion using the Neural Prior structure, they encounter challenges in discerning multi-object motions. We identified the structural constraints and the use of large and strict rigid clusters as the main pitfall of the current approaches, and we propose a novel clustering approach that allows for a combination of overlapping soft clusters and non-overlapping rigid clusters. Flow is then jointly estimated with progressively growing non-overlapping rigid clusters together with fixed-size overlapping soft clusters. We evaluate our method on multiple datasets with LiDAR point clouds, demonstrating superior performance over the self-supervised baselines and reaching new state-of-the-art results. Our method excels in resolving flow in complicated dynamic scenes with multiple independently moving objects close to each other, including pedestrians, cyclists, and other vulnerable road users. Our codes are publicly available on https://github.com/ctu-vras/let-it-flow .
- Open Access
- 17 September 2023
- Published by Institute of Information Theory and Automation in Kybernetika
- Vol. 59 (4) , 527-536
Combination of t-norms and their conorms
- 17 September 2023
- Published by Institute of Information Theory and Automation in Kybernetika
- Vol. 59 (4) , 527-536
Open AccessCombination of t-norms and their conorms
- Open Access
Teachers in concordance for pseudo-labeling of 3D sequential data
Automatic pseudo-labeling is a powerful tool to tap into large amounts of sequential unlabeled data. It is specially appealing in safety-critical applications of autonomous driving, where performance requirements are extreme, datasets are large, and manual labeling is very challenging. We propose to leverage sequences of point clouds to boost the pseudolabeling technique in a teacher-student setup via training multiple teachers, each with access to different temporal information. This set of teachers, dubbed Concordance, provides higher quality pseudo-labels for student training than standard methods. The output of multiple teachers is combined via a novel pseudo label confidence-guided criterion. Our experimental evaluation focuses on the 3D point cloud domain and urban driving scenarios. We show the performance of our method applied to 3D semantic segmentation and 3D object detection on three benchmark datasets. Our approach, which uses only 20% manual labels, outperforms some fully supervised methods. A notable performance boost is achieved for classes rarely appearing in training data.
Open AccessTeachers in concordance for pseudo-labeling of 3D sequential data
Automatic pseudo-labeling is a powerful tool to tap into large amounts of sequential unlabeled data. It is specially appealing in safety-critical applications of autonomous driving, where performance requirements are extreme, datasets are large, and manual labeling is very challenging. We propose to leverage sequences of point clouds to boost the pseudolabeling technique in a teacher-student setup via training multiple teachers, each with access to different temporal information. This set of teachers, dubbed Concordance, provides higher quality pseudo-labels for student training than standard methods. The output of multiple teachers is combined via a novel pseudo label confidence-guided criterion. Our experimental evaluation focuses on the 3D point cloud domain and urban driving scenarios. We show the performance of our method applied to 3D semantic segmentation and 3D object detection on three benchmark datasets. Our approach, which uses only 20% manual labels, outperforms some fully supervised methods. A notable performance boost is achieved for classes rarely appearing in training data.
- 20 June 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 8 (8) , 4681-4688
Self-Supervised Depth Correction of Lidar Measurements From Map Consistency Loss
Depth perception is considered an invaluable source of information in the context of 3D mapping and various robotics applications. However, point cloud maps acquired using consumer-level light detection and ranging sensors (lidars) still suffer from bias related to local surface properties such as measuring beam-to-surface incidence angle. This fact has recently motivated researchers to exploit traditional filters, as well as the deep learning paradigm, in order to suppress the aforementioned depth sensors error while preserving geometric and map consistency details. Despite the effort, depth correction of lidar measurements is still an open challenge mainly due to the lack of clean 3D data that could be used as ground truth. In this letter, we introduce two novel point cloud map consistency losses, which facilitate self-supervised learning on real data of lidar depth correction models. Specifically, the models exploit multiple point cloud measurements of the same scene from different view-points in order to learn to reduce the bias based on the constructed map consistency signal. Complementary to the removal of the bias from the measurements, we demonstrate that the depth correction models help to reduce localization drift.
- 20 June 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 8 (8) , 4681-4688
Self-Supervised Depth Correction of Lidar Measurements From Map Consistency Loss
Depth perception is considered an invaluable source of information in the context of 3D mapping and various robotics applications. However, point cloud maps acquired using consumer-level light detection and ranging sensors (lidars) still suffer from bias related to local surface properties such as measuring beam-to-surface incidence angle. This fact has recently motivated researchers to exploit traditional filters, as well as the deep learning paradigm, in order to suppress the aforementioned depth sensors error while preserving geometric and map consistency details. Despite the effort, depth correction of lidar measurements is still an open challenge mainly due to the lack of clean 3D data that could be used as ground truth. In this letter, we introduce two novel point cloud map consistency losses, which facilitate self-supervised learning on real data of lidar depth correction models. Specifically, the models exploit multiple point cloud measurements of the same scene from different view-points in order to learn to reduce the bias based on the constructed map consistency signal. Complementary to the removal of the bias from the measurements, we demonstrate that the depth correction models help to reduce localization drift.
- 1 May 2023
- Published by Springer Nature
- p. 131-144
Improving Procedural Hexapod Locomotion Generation with Neural Network Decision Modules
- 1 May 2023
- Published by Springer Nature
- p. 131-144
Improving Procedural Hexapod Locomotion Generation with Neural Network Decision Modules
- 1 December 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 8 (2) , 536-543
Teachers in Concordance for Pseudo-Labeling of 3D Sequential Data
Automatic pseudo-labeling is a powerful tool to tap into large amounts of sequential unlabeled data. It is especially appealing in safety-critical applications of autonomous driving, where performance requirements are extreme, datasets are large, and manual labeling is very challenging. We propose to leverage sequences of point clouds to boost the pseudo-labeling technique in a teacher-student setup via training multiple teachers, each with access to different temporal information. This set of teachers, dubbed Concordance , provides higher quality pseudo-labels for student training than standard methods. The output of multiple teachers is combined via a novel pseudo-label confidence-guided criterion. Our experimental evaluation focuses on the 3D point cloud domain and urban driving scenarios. We show the performance of our method applied to 3D semantic segmentation and 3D object detection on three benchmark datasets. Our approach, which uses only 20% manual labels, outperforms some fully supervised methods. A notable performance boost is achieved for classes rarely appearing in training data. Our codes will be made publicly available.
- 1 December 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 8 (2) , 536-543
Teachers in Concordance for Pseudo-Labeling of 3D Sequential Data
Automatic pseudo-labeling is a powerful tool to tap into large amounts of sequential unlabeled data. It is especially appealing in safety-critical applications of autonomous driving, where performance requirements are extreme, datasets are large, and manual labeling is very challenging. We propose to leverage sequences of point clouds to boost the pseudo-labeling technique in a teacher-student setup via training multiple teachers, each with access to different temporal information. This set of teachers, dubbed Concordance , provides higher quality pseudo-labels for student training than standard methods. The output of multiple teachers is combined via a novel pseudo-label confidence-guided criterion. Our experimental evaluation focuses on the 3D point cloud domain and urban driving scenarios. We show the performance of our method applied to 3D semantic segmentation and 3D object detection on three benchmark datasets. Our approach, which uses only 20% manual labels, outperforms some fully supervised methods. A notable performance boost is achieved for classes rarely appearing in training data. Our codes will be made publicly available.
- Open Access
- 1 August 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in Field Robotics
- Vol. 2, 1779-1818
System for Multi-Robotic Exploration of Underground Environments CTU-CRAS-NORLAB in the DARPA Subterranean Challenge
- 1 August 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in Field Robotics
- Vol. 2, 1779-1818
Open AccessSystem for Multi-Robotic Exploration of Underground Environments CTU-CRAS-NORLAB in the DARPA Subterranean Challenge
- 23 June 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 7 (3) , 7794-7801
Autonomous State-Based Flipper Control for Articulated Tracked Robots in Urban Environments
We demonstrate a hybrid approach to autonomous flipper control, focusing on a fusion of hard-coded and learned knowledge. The result is a sample-efficient and modifiable control structure that can be used in conjunction with a mapping/navigation stack. The backbone of the control policy is formulated as a state machine whose states define various flipper action templates and local control behaviors. It is also used as an interface that facilitates the gathering of demonstrations to train the transitions of the state machine. We propose a soft-differentiable state machine neural network that mitigates the shortcomings of its naively implemented counterpart and improves over a multi-layer perceptron baseline in the task of state-transition classification. We show that by training on several minutes of user-gathered demonstrations in simulation, our approach is capable of a zero-shot domain transfer to a wide range of obstacles on a similar real robotic platform. Our results show a considerable increase in performance over a previous competing approach in several essential criteria. A subset of this work was successfully used in the Defense Advanced Research Projects Agency (DARPA) Subterranean Challenge to alleviate the operator of manual flipper control. We autonomously traversed stairs and other obstacles, improving map coverage.
- 23 June 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 7 (3) , 7794-7801
Autonomous State-Based Flipper Control for Articulated Tracked Robots in Urban Environments
We demonstrate a hybrid approach to autonomous flipper control, focusing on a fusion of hard-coded and learned knowledge. The result is a sample-efficient and modifiable control structure that can be used in conjunction with a mapping/navigation stack. The backbone of the control policy is formulated as a state machine whose states define various flipper action templates and local control behaviors. It is also used as an interface that facilitates the gathering of demonstrations to train the transitions of the state machine. We propose a soft-differentiable state machine neural network that mitigates the shortcomings of its naively implemented counterpart and improves over a multi-layer perceptron baseline in the task of state-transition classification. We show that by training on several minutes of user-gathered demonstrations in simulation, our approach is capable of a zero-shot domain transfer to a wide range of obstacles on a similar real robotic platform. Our results show a considerable increase in performance over a previous competing approach in several essential criteria. A subset of this work was successfully used in the Defense Advanced Research Projects Agency (DARPA) Subterranean Challenge to alleviate the operator of manual flipper control. We autonomously traversed stairs and other obstacles, improving map coverage.
- 1 February 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 7 (2) , 3365-3371
Trajectory Optimization Using Learned Robot-Terrain Interaction Model in Exploration of Large Subterranean Environments
We consider the task of active exploration of large subterranean environments with a ground mobile robot. Our goal is to autonomously explore a large unknown area and to obtain an accurate coverage and localization of objects of interest (artifacts). The exploration is constrained by the restricted operation time in rescue scenarios, as well as a hard rough terrain. To this end, we introduce a novel optimization strategy that respects these constraints by maximizing the environment coverage by onboard sensors while producing feasible trajectories with the help of a learned robot-terrain interaction model. The approach is evaluated in diverse subterranean simulated environments, showing the viability of traversability-aware exploration in challenging scenarios. In addition, we demonstrate that the local trajectory optimization improves global coverage of an environment as well as the overall object detection results.
- 1 February 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 7 (2) , 3365-3371
Trajectory Optimization Using Learned Robot-Terrain Interaction Model in Exploration of Large Subterranean Environments
We consider the task of active exploration of large subterranean environments with a ground mobile robot. Our goal is to autonomously explore a large unknown area and to obtain an accurate coverage and localization of objects of interest (artifacts). The exploration is constrained by the restricted operation time in rescue scenarios, as well as a hard rough terrain. To this end, we introduce a novel optimization strategy that respects these constraints by maximizing the environment coverage by onboard sensors while producing feasible trajectories with the help of a learned robot-terrain interaction model. The approach is evaluated in diverse subterranean simulated environments, showing the viability of traversability-aware exploration in challenging scenarios. In addition, we demonstrate that the local trajectory optimization improves global coverage of an environment as well as the overall object detection results.