Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Giacomo Palmieri has a total of 69 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    D-RMGPT: Robot-assisted collaborative tasks driven by large multimodal models

    by Matteo Forlini, Mihail Babcinschi, Giacomo Palmieri, Pedro Neto


  • Experimental Evaluation of a Human-Mobile Robot Interaction Algorithm Using Radar and LiDAR

    by Federico Neri, Giacomo Palmieri, Praanesh Sambath, Hubert Zangl

  • Open Access

    Action Recognition in Human-robot Teaming for Assembly Tasks

    by Federico Neri, Alessandro Frezza, Giacomo Palmieri, Luca Carbonari, Massimo Callegari

    This paper presents a study on Human-Robot Teaming (HRT), focusing on state-of-the-art methodologies and real-world implementation of a collaborative system for industrial assembly tasks. The study explores the integration of real-time human action recognition using deep learning, specifically LSTM (Long Short-Term Memory) networks fed by upper-body skeletal data (limbs and torso) extracted via MediaPipe, in combination with object detection using the YOLO (You Only Look Once) method. The system allows a UR5e collaborative robot to dynamically adjust its assistance in response to the operator’s actions, specifically anticipating the tool needed based on the context rather than a fixed schedule. Unlike traditional automation, which relies on rigid, pre-programmed sequences, the proposed approach is sequence-independent. This flexibility allows the robot to support variable assembly workflows, with the potential to mitigate operator cognitive workload. The system enables the robot to autonomously select and offer the required tool to the operator at the right moment, further enhancing collaboration.

  • Open Access

    A Collaborative Robotic System for Autonomous Object Handling with Natural User Interaction

    by Federico Neri, Gaetano Lettera, Giacomo Palmieri, Massimo Callegari

    In Industry 5.0, the transition from fixed traditional automation to flexible human–robot collaboration (HRC) needs interfaces that are both intuitive and efficient. This paper introduces a novel, multimodal control system for autonomous object handling, specifically designed to enhance natural user interaction in dynamic work environments. The system integrates a 6-Degrees of Freedom (DoF) collaborative robot (UR5e) with a hand-eye RGB-D vision system to achieve robust autonomy. The core technical contribution lies in a vision pipeline utilizing deep learning for object detection and point cloud processing for accurate 6D pose estimation, enabling advanced tasks such as human-aware object handover directly onto the operator’s hand. Crucially, an Automatic Speech Recognition (ASR) is incorporated, providing a Natural Language Understanding (NLU) layer that allows operators to issue real-time commands for task modification, error correction and object selection. Experimental results demonstrate that this multimodal approach offers a streamlined workflow aiming to improve operational flexibility compared to traditional HMIs, while enhancing the perceived naturalness of the collaborative task. The system establishes a framework for highly responsive and intuitive human–robot workspaces, advancing the state of the art in natural interaction for collaborative object manipulation.


  • Open Access

    Non-Holonomic Mobile Manipulator Obstacle Avoidance with Adaptive Prioritization

    by Federico Neri, Giacomo Palmieri, Massimo Callegari

    This paper presents an obstacle avoidance strategy for mobile manipulators consisting of a robotic arm and a base with a non-holonomic differential wheel system. The algorithm makes it possible to avoid obstacles in a dynamic environment, without planning the path a priori. A series of examples are proposed in simulation using Matlab and analyzed to show how the algorithm works if the obstacle interferes with the manipulator or the base. In addition, the possibility of prioritizing the movement of certain parts of the system using the weighted pseudo-inverse matrix is introduced. In this way, it is possible to give movement priority to the base if it is necessary to move the robot over long distances while keeping the manipulator as still as possible. The use of null space to keep the end-effector stationary while it avoids obstacles is also explored, exploiting the system’s redundancy and allowing the rest of the kinematic chain and the mobile base to move accordingly. Finally, current standards are analyzed and a solution is shown that allows the robot to vary its behavior to avoid obstacles depending on the distance to the target point.


  • Open Access

    D-RMGPT: Robot-assisted collaborative tasks driven by large multimodal models

    by M. Forlini, M. Babcinschi, G. Palmieri, P. Neto

    Collaborative robots are increasingly popular for assisting humans at work and daily tasks. However, designing and setting up interfaces for human-robot collaboration is challenging, requiring the integration of multiple components, from perception and robot task control to the hardware itself. Frequently, this leads to highly customized solutions that rely on large amounts of costly training data, diverging from the ideal of flexible and general interfaces that empower robots to perceive and adapt to unstructured environments where they can naturally collaborate with humans. To overcome these challenges, this paper presents the Detection-Robot Management GPT (D-RMGPT), a robot-assisted assembly planner based on Large Multimodal Models (LMM). This system can assist inexperienced operators in assembly tasks without requiring any markers or previous training. D-RMGPT is composed of DetGPT-V and R-ManGPT. DetGPT-V, based on GPT-4V(vision), perceives the surrounding environment through one-shot analysis of prompted images of the current assembly stage and the list of components to be assembled. It identifies which components have already been assembled by analysing their features and assembly requirements. R-ManGPT, based on GPT-4, plans the next component to be assembled and generates the robot's discrete actions to deliver it to the human co-worker. Experimental tests on assembling a toy aircraft demonstrated that D-RMGPT is flexible and intuitive to use, achieving an assembly success rate of 83% while reducing the assembly time for inexperienced operators by 33% compared to the manual process. http://robotics-and-ai.github.io/LMMmodels/


  • Open Access

    Design and Prototyping of a Collaborative Station for Machine Parts Assembly

    by Federico Emiliani, Albin Bajrami, Daniele Costa, Giacomo Palmieri, Daniele Polucci, Chiara Leoni, Massimo Callegari

    Collaboration between humans and machines is the core of the Industry 5.0 paradigm, and collaborative robotics is one the most impactful enabling technologies for small and medium Enterprises (SMEs). In fact, small batch production and high levels of product customization make parts assembly one of the most challenging operations to be automated, and it often still depends on the versatility of human labor. Collaborative robots, for their part, can be easily integrated in this productive paradigm, as they have been specifically developed for coexistence with human beings. This work investigates the performance of collaborative robots in machine parts assembly. Design and research activities were carried out as a case study of industrial relevance at the i-Labs industry laboratory, a pole of innovation that is briefly introduced at the beginning of the paper. A fully-functional prototype of the cobotized station was realized at the end of the project, and several experimental tests were performed to validate the robustness of the assembly process as well as the collaborative nature of the application.


  • Dynamic Obstacle Avoidance for Non-holonomic Mobile Robots with Differential Wheels

    by Federico Neri, Giacomo Palmieri, Daniele Costa, Massimo Callegari


  • Open Access

    Experimental Assessment of a Vision-Based Obstacle Avoidance Strategy for Robot Manipulators: Off-line Trajectory Planning and On-line Motion Control

    by Cecilia Scoccia, Barnaba Ubezio, Giacomo Palmieri, Michael Rathmair, Michael Hofbaur

    Human-Robot Interaction is an increasingly important topic in both research and industry fields. Since human safety must be always guaranteed and accidental contact with the operator avoided, it is necessary to investigate real-time obstacle avoidance strategies. The transfer from simulation environments, where algorithms are tested, to the real world is challenging from different points of view, e.g., the continuous tracking of the obstacle and the configuration of different manipulators. In this paper, the authors describe the implementation of a collision avoidance strategy based on the potential field method for off-line trajectory planning and on-line motion control, paired with the Motion Capture system Optitrack PrimeX 22 for obstacle tracking. Several experiments show the performance of the proposed strategy in the case of a fixed and dynamic obstacle, disturbing the robot’s trajectory from multiple directions. Two different avoidance modalities are adapted and tested for both standard and redundant robot manipulators. The results show the possibility of safely implementing the proposed avoidance strategy on real systems.