MRMarkus Ryll

Markus Ryll

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Markus Ryll has a total of 45 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • A Universal Formulation for Path-Parametric Planning and Control: A Unified Framework, from Path following to Contouring Control and Progress Maximization

    by Jon Arrizabalaga, Zbyněk Šír, Zachary Manchester, Markus Ryll

    We present a unified framework for path-parametric planning and control. This formulation is universal, as it standardizes the entire spectrum of path-parametric techniques, from traditional path following to more recent contouring or progress-maximizing model predictive control (MPC) and reinforcement learning (RL), under a single framework. The ingredients underlying this universality are twofold. First, we present a compact and efficient technique capable of computing singularity-free, smooth, and differentiable moving frames. Second, we derive a spatial path parameterization of the Cartesian coordinates for any arbitrary curve, without prior assumptions on its parametric speed or moving frame, and that perfectly interplays with the aforementioned path parameterization method. The combination of these two ingredients leads to a planning and control framework that unites existing path-parametric techniques in the literature. Aiming to unify all these approaches, we open source a software library that implements the presented content, thereby providing a self-contained toolkit for the formulation of path-parametric planning and control methods.


  • Matrix-Weighted Coupling-Enhanced Adaptive Tracking Control for a Quadrotor-Slung-Load System

    by Junjie Kang, Yuxia Yuan, Jinjun Shan, Markus Ryll

    This article addresses the adaptive tracking control problem for an underactuated quadrotor-slung-load system subject to parameter uncertainties, a challenging task due to the system’s inherent underactuation and the coupled swinging load dynamics. To improve tracking performance and suppress unactuated swing motions, we propose a novel matrix-weighted coupling-enhanced composite state signal that explicitly integrates both actuated and unactuated state variables into the feedback control. Based on smooth projection operators, an enhanced adaptive tracking controller is developed to guarantee bounded parameter estimates, preventing parameter drift and ensuring smooth control inputs. The closed-loop system is rigorously proven to achieve asymptotic stability and bounded parameter estimation using Lyapunov theory combined with Barbalat’s Lemma. Simulation and experimental results show that the coupling-enhanced structure affects the closed-loop response and helps reduce load swing.


  • Scene-Graph ViT: End-to-End Open-Vocabulary Visual Relationship Detection

    by Tim Salzmann, Markus Ryll, Alex Bewley, Matthias Minderer


  • Open Access

    PHODCOS: Pythagorean Hodograph-based Differentiable Coordinate System

    by Jon Arrizabalaga, Fausto Vega, Zbyněk ŠÍR, Zachary Manchester, Markus Ryll

    This paper presents PHODCOS, an algorithm that assigns a moving coordinate system to a given curve. The parametric functions underlying the coordinate system, i.e., the path function, the moving frame and its angular velocity, are exact -- approximation free -- differentiable, and sufficiently continuous. This allows for computing a coordinate system for highly nonlinear curves, while remaining compliant with autonomous navigation algorithms that require first and second order gradient information. In addition, the coordinate system obtained by PHODCOS is fully defined by a finite number of coefficients, which may then be used to compute additional geometric properties of the curve, such as arc-length, curvature, torsion, etc. Therefore, PHODCOS presents an appealing paradigm to enhance the geometrical awareness of existing guidance and navigation on-orbit spacecraft maneuvers. The PHODCOS algorithm is presented alongside an analysis of its error and approximation order, and thus, it is guaranteed that the obtained coordinate system matches the given curve within a desired tolerance. To demonstrate the applicability of the coordinate system resulting from PHODCOS, we present numerical examples in the Near Rectilinear Halo Orbit (NRHO) for the Lunar Gateway.

  • Open Access

    Dual Quaternion Control of UAVs with Cable-suspended Load

    by Yuxia Yuan, Markus Ryll

    Modeling the kinematics and dynamics of robotics systems with suspended loads using dual quaternions has not been explored so far. This paper introduces a new innovative control strategy using dual quaternions for UAVs with cable-suspended loads, focusing on the sling load lifting and tracking problems. By utilizing the mathematical efficiency and compactness of dual quaternions, a unified representation of the UAV and its suspended load's dynamics and kinematics is achieved, facilitating the realization of load lifting and trajectory tracking. The simulation results have tested the proposed strategy's accuracy, efficiency, and robustness. This study makes a substantial contribution to present this novel control strategy that harnesses the benefits of dual quaternions for cargo UAVs. Our work also holds promise for inspiring future innovations in under-actuated systems control using dual quaternions.

  • Open Access

    Geometric Slosh-Free Tracking for Robotic Manipulators

    by Jon Arrizabalaga, Lukas Pries, Riddhiman Laha, Runkang Li, Sami Haddadin, Markus Ryll

    This work focuses on the agile transportation of liquids with robotic manipulators. In contrast to existing methods that are either computationally heavy, system/container specific or dependant on a singularity-prone pendulum model, we present a real-time slosh-free tracking technique. This method solely requires the reference trajectory and the robot's kinematic constraints to output kinematically feasible joint space commands. The crucial element underlying this approach consists on mimicking the end-effector's motion through a virtual quadrotor, which is inherently slosh-free and differentially flat, thereby allowing us to calculate a slosh-free reference orientation. Through the utilization of a cascaded proportional-derivative (PD) controller, this slosh-free reference is transformed into task space acceleration commands, which, following the resolution of a Quadratic Program (QP) based on Resolved Acceleration Control (RAC), are translated into a feasible joint configuration. The validity of the proposed approach is demonstrated by simulated and real-world experiments on a 7 DoF Franka Emika Panda robot. Code: https://github.com/jonarriza96/gsft Video: https://youtu.be/4kitqYVS9n8

  • Open Access

    Pose-Following with Dual Quaternions

    by Jon Arrizabalaga, Markus Ryll

    This work focuses on pose-following, a variant of path-following in which the goal is to steer the system's position and attitude along a path with a moving frame attached to it. Full body motion control, while accounting for the additional freedom to self-regulate the progress along the path, is an appealing trade-off. Towards this end, we extend the well-established dual quaternion-based pose-tracking method into a pose-following control law. Specifically, we derive the equations of motion for the full pose error between the geometric reference and the rigid body in the form of a dual quaternion and dual twist. Subsequently, we formulate an almost globally asymptotically stable control law. The global attractivity of the presented approach is validated in a spatial example, while its benefits over pose-tracking are showcased through a planar case-study.

  • Open Access

    Learning for CasADi: Data-driven Models in Numerical Optimization

    by Tim Salzmann, Jon Arrizabalaga, Joel Andersson, Marco Pavone, Markus Ryll

    While real-world problems are often challenging to analyze analytically, deep learning excels in modeling complex processes from data. Existing optimization frameworks like CasADi facilitate seamless usage of solvers but face challenges when integrating learned process models into numerical optimizations. To address this gap, we present the Learning for CasADi (L4CasADi) framework, enabling the seamless integration of PyTorch-learned models with CasADi for efficient and potentially hardware-accelerated numerical optimization. The applicability of L4CasADi is demonstrated with two tutorial examples: First, we optimize a fish's trajectory in a turbulent river for energy efficiency where the turbulent flow is represented by a PyTorch model. Second, we demonstrate how an implicit Neural Radiance Field environment representation can be easily leveraged for optimal control with L4CasADi. L4CasADi, along with examples and documentation, is available under MIT license at https://github.com/Tim-Salzmann/l4casadi


  • Robots That Can See: Leveraging Human Pose for Trajectory Prediction

    by Tim Salzmann, Hao-Tien Lewis Chiang, Markus Ryll, Dorsa Sadigh, Carolina Parada, Alex Bewley

    Anticipating the motion of all humans in dynamic environments such as homes and offices is critical to enable safe and effective robot navigation. Such spaces remain challenging as humans do not follow strict rules of motion and there are often multiple occluded entry points such as corners and doors that create opportunities for sudden encounters. In this work, we present a Transformer based architecture to predict human future trajectories in human-centric environments from input features including human positions, head orientations, and 3D skeletal keypoints from onboard in-the-wild sensory information. The resulting model captures the inherent uncertainty for future human trajectory prediction and achieves state-of-the-art performance on common prediction benchmarks and a human tracking dataset captured from a mobile robot adapted for the prediction task. Furthermore, we identify new agents with limited historical data as a major contributor to error and demonstrate the complementary nature of 3D skeletal poses in reducing prediction error in such challenging scenarios. Project page: https://human-scene-transformer.github.io/


  • Open Access

    Real-time Neural-MPC: Deep Learning Model Predictive Control for Quadrotors and Agile Robotic Platforms

    by Tim Salzmann, Elia Kaufmann, Jon Arrizabalaga, Marco Pavone, Davide Scaramuzza, Markus Ryll

    Model Predictive Control (MPC) has become a popular framework in embedded control for high-performance autonomous systems. However, to achieve good control performance using MPC, an accurate dynamics model is key. To maintain real-time operation, the dynamics models used on embedded systems have been limited to simple first-principle models, which substantially limits their representative power. In contrast to such simple models, machine learning approaches, specifically neural networks, have been shown to accurately model even complex dynamic effects, but their large computational complexity hindered combination with fast real-time iteration loops. With this work, we present Real-time Neural MPC, a framework to efficiently integrate large, complex neural network architectures as dynamics models within a model-predictive control pipeline. Our experiments, performed in simulation and the real world onboard a highly agile quadrotor platform, demonstrate the capabilities of the described system to run learned models with, previously infeasible, large modeling capacity using gradient-based online optimization MPC. Compared to prior implementations of neural networks in online optimization MPC we can leverage models of over 4000 times larger parametric capacity in a 50Hz real-time window on an embedded platform. Further, we show the feasibility of our framework on real-world problems by reducing the positional tracking error by up to 82% when compared to state-of-the-art MPC approaches without neural network dynamics.