Marcelo Roberto Petry

Matrix manufacturing requires close coordination between collaborative workcells, mobile robots, and battery management resources to support the execution of heterogeneous human-robot operations in reconfigurable production environments. This paper presents a cyber-physical robotic coordination framework for human-robot teams deployed in an industrial matrix manufacturing system, integrating a collaborative workstation, a fleet of mobile programmable cobots, and an automatic battery changer through ROS/OPC UA communication. The framework coordinates task execution, intra-logistics, and energy management through a decision layer that assigns operations to human and robotic agents, relocates idle mobile robots, and triggers battery swaps. Three coordination modules—a Battery Management Module, a Task Allocation Module, and a Robot Relocation Module—implement this pipeline by computing feasible execution plans at each scheduling cycle, accounting for human and robot capabilities, workstation availability, transport times, and battery state. The approach is validated on a deployed industrial matrix manufacturing platform through a disassembly task comprising human-only, robot-only, and human–robot collaborative operations, demonstrating the feasibility of coordinating heterogeneous robotic and human resources in a physical reconfigurable manufacturing environment.

Small to medium-sized shipyards play a crucial role in the European naval industry. However, the globalization of technology has increased competition, posing significant challenges to shipyards, particularly in domestic markets for short sea, work, and inland vessels. Many shipyard operations still rely on manual, labor-intensive tasks performed by highly skilled operators. In response, the adoption of new tools is essential to enhance efficiency and competitiveness. This paper presents a methodology for developing a human-centric portfolio of advanced technologies tailored for shipyard environments, covering processes such as shipbuilding, retrofitting, outfitting, and maintenance. The proposed technological solutions, which have achieved high technology readiness levels, include 3D modeling and digitalization, robotics, augmented and virtual reality, and occupational exoskeletons. Key findings from real-scale demonstrations are discussed, along with major development and implementation challenges. Finally, best practices and recommendations are provided to support both technology developers seeking fully tested tools and end users aiming for seamless adoption.

Fiducial markers play a fundamental role in various fields in which precise localization and tracking are paramount. In Augmented Reality, they provide a known reference point in the physical world so that AR systems can accurately identify, track, and overlay virtual objects. This accuracy is essential for creating a seamless and immersive AR experience, particularly when prompted to cope with the sub-millimeter requirements of medical and industrial applications. This research article presents a comparative analysis of four fiducial marker tracking algorithms, aiming to assess and benchmark their accuracy and precision. The proposed methodology compares the pose estimated by four algorithms running on Hololens 2 with those provided by a highly accurate ground truth system. Each fiducial marker was positioned in 25 sampling points with different distances and orientations. The proposed evaluation method is not influenced by human error, relying only on a high-frequency and accurate motion tracking system as ground truth. This research shows that it is possible to track the fiducial markers with translation and rotation errors as low as 1.36 mm and 0.015 degrees using ArUco and Vuforia, respectively.

Machine vision systems are widely used in assembly lines for providing sensing abilities to robots to allow them to handle dynamic environments. This paper presents a comparison of 3D sensors for evaluating which one is best suited for usage in a machine vision system for robotic fastening operations within an automotive assembly line. The perception system is necessary for taking into account the position uncertainty that arises from the vehicles being transported in an aerial conveyor. Three sensors with different working principles were compared, namely laser triangulation (SICK TriSpector1030), structured light with sequential stripe patterns (Photoneo PhoXi S) and structured light with infrared speckle pattern (Asus Xtion Pro Live). The accuracy of the sensors was measured by computing the root mean square error (RMSE) of the point cloud registrations between their scans and two types of reference point clouds, namely, CAD files and 3D sensor scans. Overall, the RMSE was lower when using sensor scans, with the SICK TriSpector1030 achieving the best results (0.25 mm ± 0.03 mm), the Photoneo PhoXi S having the intermediate performance (0.49 mm ± 0.14 mm) and the Asus Xtion Pro Live obtaining the higher RMSE (1.01 mm ± 0.11 mm). Considering the use case requirements, the final machine vision system relied on the SICK TriSpector1030 sensor and was integrated with a collaborative robot, which was successfully deployed in an vehicle assembly line, achieving 94% success in 53,400 screwing operations.

Odometry calibration adjusts the kinematic parameters or directly the robot’s model to improve the wheeled odometry accuracy. The existent literature considers in the calibration procedure only one steering geometry (differential drive, Ackerman/tricycle, or omnidirectional). Our method, the OptiOdom calibration algorithm, generalizes the odometry calibration problem. It is developed an optimization-based approach that uses the improved Resilient Propagation without weight-backtracking (iRprop-) for estimating the kinematic parameters using only the position data of the robot. Even though a calibration path is suggested to be used in the calibration procedure, the OptiOdom method is not path-specific. In the experiments performed, the OptiOdom was tested using four different robots on a square, arbitrary, and suggested calibration paths. The OptiTrack motion capture system was used as a ground-truth. Overall, the use of OptiOdom led to improvements in the odometry accuracy (in terms of maximum distance and absolute orientation errors over the path) over the existent literature while being a generalized approach to the odometry calibration problem. The OptiOdom and the methods from the literature implemented in the article are available in GitHub as an open-source repository.

With the continuously growing usage of collaborative robots in industry, the need for achieving a seamless human–robot interaction has also increased, considering that it is a key factor towards reaching a more flexible, effective, and efficient production line. As a prominent and prospective tool to support the human operator to understand and interact with robots, Augmented Reality (AR) has been employed in numerous human–robot collaborative and cooperative industrial applications. Therefore, this systematic literature review critically appraises 32 papers’ published between 2016 and 2021 to identify the main employed AR technologies, outline the current state of the art of augmented reality for human–robot collaboration and cooperation, and point out future developments for this research field. Results suggest that this is still an expanding research field, especially with the advent of recent advancements regarding head-mounted displays (HMDs). Moreover, projector-based and HMDs developed approaches are showing promising positive influences over operator-related aspects such as performance, task awareness, and safety feeling, even though HMDs need further maturation in ergonomic aspects. Further research should focus on large-scale assessment of the proposed solutions in industrial environments, involving the solution’s target audience, and on establishing standards and guidelines for developing AR assistance systems.

The Agri-Food production requirements needs a more efficient and autonomous processes, and robotics will play a significant role in this process. Deploying agricultural robots on the farm is still a challenging task. Particularly in slope terrains, where it is crucial to avoid obstacles and dangerous steep slope zones. Path planning solutions may fail under several circumstances, as the appearance of a new obstacle. This work proposes a novel open-source solution called AgRobPP-CA to autonomously perform obstacle avoidance during robot navigation. AgRobPP-CA works in real-time for local obstacle avoidance, allowing small deviations, avoiding unexpected obstacles or dangerous steep slope zones, which could impose a fall of the robot. Our results demonstrated that AgRobPP-CA is capable of avoiding obstacles and high slopes in different vineyard scenarios, with low computation requirements. For example, in the last trial, AgRobPP-CA avoided a steep ramp that could impose a fall to the robot.