SSSimon Schwaiger

Simon Schwaiger

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Simon Schwaiger has a total of 13 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Towards full autonomy in mobile robot navigation and manipulation

    by Simon Schwaiger, Lucas Muster, Alessandro Scherl, Paolo Trivisonne, Wilfried Wöber, Stefan Thalhammer

    Robot autonomy is a key for automatizing industrial production plants, facilitating responsive search and rescue (SAR), and for interacting in urban settings. This work presents mobile systems capable of carrying out these tasks and summarises experience from practical deployments in three different domains for navigation. For industry, a mobile manipulator is presented, which is used for dynamic precise docking and object handling. For SAR, a semi-autonomous system is presented which is used for sampling hazardous materials, manipulating tools, and for localizing nuclear radiation sources. To improve urban logistics, a mobile robot autonomously navigates complex outdoor environments using semantic mapping techniques. Future work will explore further advancements that strive toward increased flexibility, reasoning and universal applicability of mobile robots. The goal is to reduce training, onboarding and tool changing times to reduce manual interfacing times.


  • Open Access

    From Words to Poses: Enhancing Novel Object Pose Estimation with Vision Language Models

    by Tessa Pulli, Stefan Thalhammer, Simon Schwaiger, Markus Vincze

    Robots are increasingly envisioned to interact in real-world scenarios, where they must continuously adapt to new situations. To detect and grasp novel objects, zero-shot pose estimators determine poses without prior knowledge. Recently, vision language models (VLMs) have shown considerable advances in robotics applications by establishing an understanding between language input and image input. In our work, we take advantage of VLMs zero-shot capabilities and translate this ability to 6D object pose estimation. We propose a novel framework for promptable zero-shot 6D object pose estimation using language embeddings. The idea is to derive a coarse location of an object based on the relevancy map of a language-embedded NeRF reconstruction and to compute the pose estimate with a point cloud registration method. Additionally, we provide an analysis of LERF's suitability for open-set object pose estimation. We examine hyperparameters, such as activation thresholds for relevancy maps and investigate the zero-shot capabilities on an instance- and category-level. Furthermore, we plan to conduct robotic grasping experiments in a real-world setting.

  • Evaluierung von Navigationsmethoden für mobile Roboter

    by Wilfried Wöber, Johannes Rauer, Maximilian Papa, Ali Aburaia, Simon Schwaiger, Georg Novotny, Mohamed Aburaia, Wilfried Kubinger