ALAlberto Dalla Libera

Alberto Dalla Libera

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Alberto Dalla Libera has a total of 68 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Anomaly detection in industrial robotics: A novel dataset and benchmark method

    by Giulio Giacomuzzo, Alberto Dalla Libera, Daichi Arimizu, Yuto Hachiya, Shinya Tsuruta, Koji Wakimoto, Toshiyuki Kuriyama, Diego Romeres

  • Open Access

    Reinforcement Learning for Robust Athletic Intel-ligence: Lessons Learned From the Second AI Olympics With RealAIGym Competition

    by Felix Wiebe, Niccolò Turcato, Alberto Dalla Libera, Jean Seong Bjorn Choe, Bumkyu Choi, Tim Lukas Faust, Habib Maraqten, Erfan Aghadavoodi, Marco Cali, Alberto Sinigaglia, et al.

    In robotics, many different approaches ranging from classical planning over optimal control to reinforcement learning (RL) are developed and borrowed from other fields to achieve reliable control in diverse tasks. To get a clear understanding of their individual strengths and weaknesses and their applicability in real-world robotic scenarios, it is important to benchmark and compare their performances not only in a simulation but also on real hardware. The second AI Olympics with RealAIGym competition was held at the 2024 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2024) to contribute to this cause and evaluate different controllers according to their ability to solve a dynamic control problem on an underactuated double-pendulum system (Figure 1) with chaotic dynamics. This article describes the four different RL methods submitted by the participating teams; presents their performance in the swing-up task on a real double pendulum, measured against various criteria; and discusses their transferability from simulation to real (sim-to-real) hardware and their robustness to external disturbances.


  • Towards Autonomous Reinforcement Learning for Real-World Robotic Manipulation With Large Language Models

    by Niccolò Turcato, Matteo Iovino, Aris Synodinos, Alberto Dalla Libera, Ruggero Carli, Pietro Falco

    Recent advancements in Large Language Models (LLMs) and Visual Language Models (VLMs) have significantly impacted robotics, enabling high-level semantic motion planning applications. Reinforcement Learning (RL), a complementary paradigm, enables agents to autonomously optimize complex behaviors through interaction and reward signals. However, designing effective reward functions for RL remains challenging, especially in real-world tasks where sparse rewards are insufficient and dense rewards require elaborate design. In this work, we propose Autonomous Reinforcement learning for Complex Human-Informed Environments (ARCHIE), an unsupervised pipeline leveraging GPT-4, a pre-trained LLM, to generate reward functions directly from natural language task descriptions. The rewards are used to train RL agents in simulated environments, where we formalize the reward generation process to enhance feasibility. Additionally, GPT-4 automates the coding of task success criteria, creating a fully automated, one-shot procedure for translating human-readable text into deployable robot skills. Our approach is validated through extensive simulated experiments on single-arm and bi-manual manipulation tasks using an ABB YuMi collaborative robot, highlighting its practicality and effectiveness. Tasks are demonstrated on the real robot setup.


  • A Black-Box Physics-Informed Estimator Based on Gaussian Process Regression for Robot Inverse Dynamics Identification

    by Giulio Giacomuzzo, Ruggero Carli, Diego Romeres, Alberto Dalla Libera

    Learning the inverse dynamics of robots directly from data, adopting a black-box approach, is interesting for several real-world scenarios where limited knowledge about the system is available. In this paper, we propose a black-box model based on Gaussian Process (GP) Regression for the identification of the inverse dynamics of robotic manipulators. The proposed model relies on a novel multidimensional kernel, called Lagrangian Inspired Polynomial (LIP) kernel. The LIP kernel is based on two main ideas. First, instead of directly modeling the inverse dynamics components, we model as GPs the kinetic and potential energy of the system. The GP prior on the inverse dynamics components is derived from those on the energies by applying the properties of GPs under linear operators. Second, as regards the energy prior definition, we prove a polynomial structure of the kinetic and potential energy, and we derive a polynomial kernel that encodes this property. As a consequence, the proposed model allows also to estimate the kinetic and potential energy without requiring any label on these quantities. Results on simulation and on two real robotic manipulators, namely a 7 DOF Franka Emika Panda, and a 6 DOF MELFA RV4FL, show that the proposed model outperforms state-of-the-art black-box estimators based both on Gaussian Processes and Neural Networks in terms of accuracy, generality and data efficiency. The experiments on the MELFA robot also demonstrate that our approach achieves performance comparable to fine-tuned model-based estimators, despite requiring less prior information. The code of the proposed model is publicly available.


  • Open Access

    A Learning-Based Nonlinear Model Predictive Controller for a Real Go-Kart Based on Black-Box Dynamics Modeling Through Gaussian Processes

    by Enrico Picotti, Enrico Mion, Alberto Dalla Libera, Josip Pavlovic, Andrea Censi, Emilio Frazzoli, Alessandro Beghi, Mattia Bruschetta

    Lately, nonlinear model predictive control (NMPC) has been successfully applied to (semi-) autonomous driving problems and has proven to be a very promising technique. However, accurate control models for real vehicles could require costly and time-demanding specific measurements. To address this problem, the exploitation of system data to complement or derive the prediction model of the NMPC has been explored, employing learning dynamics approaches within learning-based NMPC (LbNMPC). Its application to the automotive field has focused on discrete gray-box modeling, in which a nominal dynamics model is enhanced by the data-driven component. In this manuscript, we present an LbNMPC controller for a real go-kart based on a continuous black-box model of the accelerations obtained by Gaussian processes (GP). We show the effectiveness of the proposed approach by testing the controller on a real go-kart vehicle, highlighting the approximation steps required to get an exploitable GP model on a real-time application.


  • Open Access

    In silico design and validation of a time-varying PID controller for an artificial pancreas with intraperitoneal insulin delivery and glucose sensing

    by Alberto Dalla Libera, Chiara Toffanin, Martina Drecogna, Alfonso Galderisi, Gianluigi Pillonetto, Claudio Cobelli

    Type 1 diabetes (T1D) is a chronic autoimmune disease featured by the loss of beta cell function and the need for lifetime insulin replacement. Over the recent decade, the use of automated insulin delivery systems (AID) has shifted the paradigm of treatment: the availability of continuous subcutaneous (SC) glucose sensors to guide SC insulin delivery through a control algorithm has allowed, for the first time, to reduce the daily burden of the disease as well as to abate the risk for hypoglycemia. AID use is still limited by individual acceptance, local availability, coverage, and expertise. A major drawback of SC insulin delivery is the need for meal announcement and the peripheral hyperinsulinemia that, over time, contributes to macrovascular complications. Inpatient trials using intraperitoneal (IP) insulin pumps have demonstrated that glycemic control can be improved without meal announcement due to the faster insulin delivery through the peritoneal space. This calls for novel control algorithms able to account for the specificities of IP insulin kinetics. Recently, our group described a two-compartment model of IP insulin kinetics demonstrating that the peritoneal space acts as a virtual compartment and IP insulin delivery is virtually intraportal (intrahepatic), thus closely mimicking the physiology of insulin secretion. The FDA-accepted T1D simulator for SC insulin delivery and sensing has been updated for IP insulin delivery and sensing. Herein, we design and validate—in silico—a time-varying proportional integrative derivative controller to guide IP insulin delivery in a fully closed-loop mode without meal announcement.


  • Open Access

    Learning Control from Raw Position Measurements

    by Fabio Amadio, Alberto Dalla Libera, Daniel Nikovski, Ruggero Carli, Diego Romeres

    We propose a Model-Based Reinforcement Learning (MBRL) algorithm named VF-MC-PILCO, specifically designed for application to mechanical systems where velocities cannot be directly measured. This circumstance, if not adequately considered, can compromise the success of MBRL approaches. To cope with this problem, we define a velocity-free state formulation which consists of the collection of past positions and inputs. Then, VF-MC-PILCO uses Gaussian Process Regression to model the dynamics of the velocity-free state and optimizes the control policy through a particle-based policy gradient approach. We compare VF-MC-PILCO with our previous MBRL algorithm, MC-PILCO4PMS, which handles the lack of direct velocity measurements by modeling the presence of velocity estimators. Results on both simulated (cart-pole and UR5 robot) and real mechanical systems (Furuta pendulum and a ball-and-plate rig) show that the two algorithms achieve similar results. Conveniently, VF-MC-PILCO does not require the design and implementation of state estimators, which can be a challenging and time-consuming activity to be performed by an expert user.

  • Open Access

    Model-Based Policy Search Using Monte Carlo Gradient Estimation with Real Systems Application

    by Fabio Amadio, Alberto Dalla Libera, Riccardo Antonello, Daniel Nikovski, Ruggero Carli, Diego Romeres

    In this paper, we present a Model-Based Reinforcement Learning (MBRL) algorithm named \emph{Monte Carlo Probabilistic Inference for Learning COntrol} (MC-PILCO). The algorithm relies on Gaussian Processes (GPs) to model the system dynamics and on a Monte Carlo approach to estimate the policy gradient. This defines a framework in which we ablate the choice of the following components: (i) the selection of the cost function, (ii) the optimization of policies using dropout, (iii) an improved data efficiency through the use of structured kernels in the GP models. The combination of the aforementioned aspects affects dramatically the performance of MC-PILCO. Numerical comparisons in a simulated cart-pole environment show that MC-PILCO exhibits better data efficiency and control performance w.r.t. state-of-the-art GP-based MBRL algorithms. Finally, we apply MC-PILCO to real systems, considering in particular systems with partially measurable states. We discuss the importance of modeling both the measurement system and the state estimators during policy optimization. The effectiveness of the proposed solutions has been tested in simulation and on two real systems, a Furuta pendulum and a ball-and-plate rig.

  • Model-Based Policy Search Using Monte Carlo Gradient Estimation With Real Systems Application

    by Fabio Amadio, Alberto Dalla Libera, Riccardo Antonello, Daniel Nikovski, Ruggero Carli, Diego Romeres

    In this article, we present a model-based reinforcement learning (MBRL) algorithm named Monte Carlo probabilistic inference for learning control (MC-PILCO). This algorithm relies on Gaussian processes (GPs) to model the system dynamics and on a Monte Carlo approach to estimate the policy gradient. This defines a framework in which we ablate the choice of the components, which are the selection of the cost function, the optimization of policies using dropout, and an improved data efficiency through the use of structured kernels in the GP models. The combination of the aforementioned aspects affects dramatically the performance of MC-PILCO. Numerical comparisons in a simulated cart–pole environment show that MC-PILCO exhibits better data efficiency and control performance w.r.t. state-of-the-art GP-based MBRL algorithms. Finally, we apply MC-PILCO to real systems, considering, in particular, systems with partially measurable states. We discuss the importance of modeling both the measurement system and the state estimators during policy optimization. The effectiveness of the proposed solutions has been tested in simulation and on two real systems, which are the Furuta pendulum and the ball-and-plate rig.


  • Advantages of a physics-embedding kernel for robot inverse dynamics identification

    by Giulio Giacomuzzo, Niccolo' Turcato, Alberto Dalla Libera, Ruggero Carli

    The Geometrically Inspired Polynomial Kernel (GIP) [1] has been recently proposed in the context of black box inverse dynamics estimation based on Gaussian Processes, driven by the fact that the inverse dynamics map derived from the Lagrangian equations is a polynomial function in a suitable feature space. In this paper, we further investigate the advantages of the GIP kernel comparing it with the state of the art Radial Basis Function Kernel (RBF). In particular, we extend the analysis of the generalization properties, by comparing estimation accuracy and reliability of the confidence intervals returned. Moreover, we evaluate the structural properties induced by the two kernels considering their ability to estimate inertial, Coriolis and gravitational components of the inverse dynamics map. Numerical experiments confirm that the GIP kernel has better generalization properties and returns more reliable estimates of the prediction variance. Moreover, its superior ability to estimate inertial, Coriolis and gravitational torques components, suggests that it better encodes the underlying structural properties of the unknown inverse dynamics map.