Carlos Calleja
Carlos Calleja has a total of 33 co-authors. Here are the top co-authors by number of shared publications:
- Gorka Sorrosal
Ikerlan Technology Research Centre, Basque Research and Technology Alliance (BRTA), 20500 Arrasate, Spain
3 shared publications - Iker Elorza
IKERLAN, Pº. J. Mª. Arizmendiarrieta, 2, 20500 Arrasate-Mondragón, Gipuzkoa, Spain
3 shared publications A. Lopez-De-Heredia
IK4-Ikerlan, P°. J. M. Arizmendiarrieta, 2 - 20500, Arrasate-Mondragón, Spain
2 shared publications- Aitziber Mancisidor
UPV/EHU
2 shared publications Aron Pujana
Ikerlan Technology Research Centre, Arrasate-Mondragón, Spain
2 shared publications- Aron Pujana-Arrese
IKERLAN
2 shared publications
Latest Publications
- Open Access
- 28 March 2025
- Published by MDPI AG in Mathematics
- Vol. 13 (7) , 1120
Reinforcement Learning-Based Control for Robotic Flexible Element Disassembly
Disassembly plays a vital role in sustainable manufacturing and recycling processes, facilitating the recovery and reuse of valuable components. However, automating disassembly, especially for flexible elements such as cables and rubber seals, poses significant challenges due to their nonlinear behavior and dynamic properties. Traditional control systems struggle to handle these tasks efficiently, requiring adaptable solutions that can operate in unstructured environments that provide online adaptation. This paper presents a reinforcement learning (RL)-based control strategy for the robotic disassembly of flexible elements. The proposed method focuses on low-level control, in which the precise manipulation of the robot is essential to minimize force and avoid damage during extraction. An adaptive reward function is tailored to account for varying material properties, ensuring robust performance across different operational scenarios. The RL-based approach is evaluated in a simulation using soft actor–critic (SAC), deep deterministic policy gradient (DDPG), and proximal policy optimization (PPO) algorithms, benchmarking their effectiveness in dynamic environments. The experimental results indicate the satisfactory performance of the robot under operational conditions, achieving an adequate success rate and force minimization. Notably, there is at least a 20% reduction in force compared to traditional planning methods. The adaptive reward function further enhances the ability of the robotic system to generalize across a range of flexible element disassembly tasks, making it a promising solution for real-world applications.
- 28 March 2025
- Published by MDPI AG in Mathematics
- Vol. 13 (7) , 1120
Open AccessReinforcement Learning-Based Control for Robotic Flexible Element Disassembly
Disassembly plays a vital role in sustainable manufacturing and recycling processes, facilitating the recovery and reuse of valuable components. However, automating disassembly, especially for flexible elements such as cables and rubber seals, poses significant challenges due to their nonlinear behavior and dynamic properties. Traditional control systems struggle to handle these tasks efficiently, requiring adaptable solutions that can operate in unstructured environments that provide online adaptation. This paper presents a reinforcement learning (RL)-based control strategy for the robotic disassembly of flexible elements. The proposed method focuses on low-level control, in which the precise manipulation of the robot is essential to minimize force and avoid damage during extraction. An adaptive reward function is tailored to account for varying material properties, ensuring robust performance across different operational scenarios. The RL-based approach is evaluated in a simulation using soft actor–critic (SAC), deep deterministic policy gradient (DDPG), and proximal policy optimization (PPO) algorithms, benchmarking their effectiveness in dynamic environments. The experimental results indicate the satisfactory performance of the robot under operational conditions, achieving an adequate success rate and force minimization. Notably, there is at least a 20% reduction in force compared to traditional planning methods. The adaptive reward function further enhances the ability of the robotic system to generalize across a range of flexible element disassembly tasks, making it a promising solution for real-world applications.
- Open Access
- 26 June 2023
- Published by ASME International in Journal of Mechanisms and Robotics
- Vol. 16 (5) , 1-13
Singularity Parametrization With a Novel Kinematic Decoupled Model for Non-Spherical Wrist Robots
Most of the current commercial collaborative robots present a non-spherical wrist, so they cannot utilize singularity handling techniques efficiently to avoid excessive safety stops while dynamically avoiding collisions. These robots usually require heavier algorithms due to their kinematics or online methods that shift the original singularities. Therefore, to enable more efficient computations on singularity handling and collision avoidance controllers, this paper proposes a novel method to characterize singular configurations of non-spherical wrist collaborative robots (6 and 7 degrees-of-freedom). This method is based on a new decoupled kinematic model that allows lighter kinematic computations and enables the joint-dependant characterization of the robot singularities to avoid shifting the singular configurations. Finally, the proposed kinematic model is particularized for a UR10e, where its kinematic behavior has been tested against two different literature models in simulation. In this manner, a novel singularity category (belonging to the internal singularities) is proposed, and a new closed set of characterized singular solutions is obtained.
- 26 June 2023
- Published by ASME International in Journal of Mechanisms and Robotics
- Vol. 16 (5) , 1-13
Open AccessSingularity Parametrization With a Novel Kinematic Decoupled Model for Non-Spherical Wrist Robots
Most of the current commercial collaborative robots present a non-spherical wrist, so they cannot utilize singularity handling techniques efficiently to avoid excessive safety stops while dynamically avoiding collisions. These robots usually require heavier algorithms due to their kinematics or online methods that shift the original singularities. Therefore, to enable more efficient computations on singularity handling and collision avoidance controllers, this paper proposes a novel method to characterize singular configurations of non-spherical wrist collaborative robots (6 and 7 degrees-of-freedom). This method is based on a new decoupled kinematic model that allows lighter kinematic computations and enables the joint-dependant characterization of the robot singularities to avoid shifting the singular configurations. Finally, the proposed kinematic model is particularized for a UR10e, where its kinematic behavior has been tested against two different literature models in simulation. In this manner, a novel singularity category (belonging to the internal singularities) is proposed, and a new closed set of characterized singular solutions is obtained.
- Open Access
A Sensor Data Processing Algorithm for Wind Turbine Hydraulic Pitch System Diagnosis
Modern wind turbines depend on their blade pitch systems for start-ups, shutdowns, and power control. Pitch system failures have, therefore, a considerable impact on their operation and integrity. Hydraulic pitch systems are very common, due to their flexibility, maintainability, and cost; hence, the relevance of diagnostic algorithms specifically targeted at them. We propose one such algorithm based on sensor data available to the vast majority of turbine controllers, which we process to fit a model of the hydraulic pitch system to obtain significant indicators of the presence of the critical failure modes. This algorithm differs from state-of-the-art, model-based algorithms in that it does not numerically time-integrate the model equations in parallel with the physical turbine, which is demanding in terms of in situ computation (or, alternatively, data transmission) and is highly susceptible to drift. Our algorithm requires only a modest amount of local sensor data processing, which can be asynchronous and intermittent, to produce negligible quantities of data to be transmitted for remote storage and analysis. In order to validate our algorithm, we use synthetic data generated with state-of-the-art aeroelastic and hydraulic simulation software. The results suggest that a diagnosis of the critical wind turbine hydraulic pitch system failure modes based on our algorithm is viable.
Open AccessA Sensor Data Processing Algorithm for Wind Turbine Hydraulic Pitch System Diagnosis
Modern wind turbines depend on their blade pitch systems for start-ups, shutdowns, and power control. Pitch system failures have, therefore, a considerable impact on their operation and integrity. Hydraulic pitch systems are very common, due to their flexibility, maintainability, and cost; hence, the relevance of diagnostic algorithms specifically targeted at them. We propose one such algorithm based on sensor data available to the vast majority of turbine controllers, which we process to fit a model of the hydraulic pitch system to obtain significant indicators of the presence of the critical failure modes. This algorithm differs from state-of-the-art, model-based algorithms in that it does not numerically time-integrate the model equations in parallel with the physical turbine, which is demanding in terms of in situ computation (or, alternatively, data transmission) and is highly susceptible to drift. Our algorithm requires only a modest amount of local sensor data processing, which can be asynchronous and intermittent, to produce negligible quantities of data to be transmitted for remote storage and analysis. In order to validate our algorithm, we use synthetic data generated with state-of-the-art aeroelastic and hydraulic simulation software. The results suggest that a diagnosis of the critical wind turbine hydraulic pitch system failure modes based on our algorithm is viable.
- Open Access
- 26 July 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 9, 108557-108578
Human-Robot Interaction Review: Challenges and Solutions for Modern Industrial Environments
The demand for collaborative robots is growing in industrial environments due to their versatility and low prices. Thus, more collaborative solutions are emerging for industrial scenarios. However, implementing scenarios where robots work autonomously while synchronizing their operations in a safe industrial environment with shop-floor workers is not easy. To fill the gap existing in the safe implementation of industrial collaborative scenarios, this manuscript presents a review based on five identified challenges that gathers the primary vital aspects to bear in mind while developing applications for them. Thus, a four-level classification is proposed, which collects the identified challenges and the previous developments in the field of human-robot interaction. The five identified challenges pretends to be the missing enabling key for implementing industrial collaborative scenarios in modern industrial plants. Lastly, a discussion and conclusion are exposed to analyze the degree of development in the field and its potential growth.
- 26 July 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 9, 108557-108578
Open AccessHuman-Robot Interaction Review: Challenges and Solutions for Modern Industrial Environments
The demand for collaborative robots is growing in industrial environments due to their versatility and low prices. Thus, more collaborative solutions are emerging for industrial scenarios. However, implementing scenarios where robots work autonomously while synchronizing their operations in a safe industrial environment with shop-floor workers is not easy. To fill the gap existing in the safe implementation of industrial collaborative scenarios, this manuscript presents a review based on five identified challenges that gathers the primary vital aspects to bear in mind while developing applications for them. Thus, a four-level classification is proposed, which collects the identified challenges and the previous developments in the field of human-robot interaction. The five identified challenges pretends to be the missing enabling key for implementing industrial collaborative scenarios in modern industrial plants. Lastly, a discussion and conclusion are exposed to analyze the degree of development in the field and its potential growth.
- Open Access
- 9 August 2019
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 7, 110541-110553
A Methodology for Real-Time HiL Validation of Hydraulic-Press Controllers Based on Novel Modeling Techniques
Industrial machines commissioning consumes a great amount of man-hours, due to control designers lack of knowledge about the final controller gains before they start working with it. Virtual commissioning has been postulated as an optimal solution to deal with this lack of knowledge when the Real-Time simulation of the digital models reproduces an identical behaviour as the industrial machines they represent. Cyber-Physical Systems (CPSs) offer new opportunities in this field, however, in the case of industrial machines, acquiring this level of accuracy requires to slow down the simulation. On this paper, novel modelling techniques for industrial CPSs have been presented. They are introduced to help in the evolution from conventional control design to a virtual commissioning process combining software and hardware capabilities. This methodology has been tested with a hydraulic-press model designed following manufacturer specifications, initially under a Software in the Loop (SiL) validation platform and, afterwards, in a Hardware in the Loop (HiL) validation platform. The control algorithms are designed in laboratory conditions harmless for the machine, embedding them later in the industrial environment without further modifications.
- 9 August 2019
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 7, 110541-110553
Open AccessA Methodology for Real-Time HiL Validation of Hydraulic-Press Controllers Based on Novel Modeling Techniques
Industrial machines commissioning consumes a great amount of man-hours, due to control designers lack of knowledge about the final controller gains before they start working with it. Virtual commissioning has been postulated as an optimal solution to deal with this lack of knowledge when the Real-Time simulation of the digital models reproduces an identical behaviour as the industrial machines they represent. Cyber-Physical Systems (CPSs) offer new opportunities in this field, however, in the case of industrial machines, acquiring this level of accuracy requires to slow down the simulation. On this paper, novel modelling techniques for industrial CPSs have been presented. They are introduced to help in the evolution from conventional control design to a virtual commissioning process combining software and hardware capabilities. This methodology has been tested with a hydraulic-press model designed following manufacturer specifications, initially under a Software in the Loop (SiL) validation platform and, afterwards, in a Hardware in the Loop (HiL) validation platform. The control algorithms are designed in laboratory conditions harmless for the machine, embedding them later in the industrial environment without further modifications.
- Open Access
On Wind Turbine Power Delta Control
One of the major challenges facing wind energy at the moment is its dependence on dispatchable energy sources to match power supply to demand and provide an adequate spinning reserve. There is no fundamental impediment for this to be done with wind energy when wind conditions are such that sufficient wind power is available. It is, in fact, common for wind farms to participate in primary and secondary frequency regulation via droop curves, curtailment, synthetic inertia, proportional de-loading, and delta control. However, although the literature presents several approaches to turbine-level control functions of this sort, it is not trivial to extract from it a readily industrializable set of algorithms. Said extraction, focused on delta control and the addition of our own contributions, is the purpose of this paper, where we propose an extension of popular torque and pitch control algorithms, which allows delta control without the wind speed observers used by other authors.
Open AccessOn Wind Turbine Power Delta Control
One of the major challenges facing wind energy at the moment is its dependence on dispatchable energy sources to match power supply to demand and provide an adequate spinning reserve. There is no fundamental impediment for this to be done with wind energy when wind conditions are such that sufficient wind power is available. It is, in fact, common for wind farms to participate in primary and secondary frequency regulation via droop curves, curtailment, synthetic inertia, proportional de-loading, and delta control. However, although the literature presents several approaches to turbine-level control functions of this sort, it is not trivial to extract from it a readily industrializable set of algorithms. Said extraction, focused on delta control and the addition of our own contributions, is the purpose of this paper, where we propose an extension of popular torque and pitch control algorithms, which allows delta control without the wind speed observers used by other authors.
- Open Access
- 1 May 2019
- Published by IOP Publishing in Journal of Physics: Conference Series
- Vol. 1222 (1) , 012024
On wind turbine control for participation in grid frequency regulation
An energy mix with a large contribution from wind power requires wind farm participation in frequency regulation. To do this effectively, it is necessary for wind turbines to curtail their power production by a certain amount, or ‘delta’, which serves as a reserve. Although it is relatively straightforward to achieve this in certain conditions, doing so consistently normally requires wind speed observers to estimate available power. A delta control method is proposed here, which does not rely on said observers and naturally extends popular torque and pitch control algorithms.
- 1 May 2019
- Published by IOP Publishing in Journal of Physics: Conference Series
- Vol. 1222 (1) , 012024
Open AccessOn wind turbine control for participation in grid frequency regulation
An energy mix with a large contribution from wind power requires wind farm participation in frequency regulation. To do this effectively, it is necessary for wind turbines to curtail their power production by a certain amount, or ‘delta’, which serves as a reserve. Although it is relatively straightforward to achieve this in certain conditions, doing so consistently normally requires wind speed observers to estimate available power. A delta control method is proposed here, which does not rely on said observers and naturally extends popular torque and pitch control algorithms.
- Open Access
- 1 January 2017
- Published by INSTICC
- p. 126-133
Real-time HiL for Hydraulic Press Control Validation
- 1 January 2017
- Published by INSTICC
- p. 126-133
Open AccessReal-time HiL for Hydraulic Press Control Validation
- 24 May 2016
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Industrial Electronics
- Vol. 63 (02780046) , 1
Validation of a modified direct-self control strategy for PMSM in railway-traction applications
This paper proposes and validates a modified direct-self-control (M-DSC) as a new control strategy option for permanent-magnet synchronous machine (PMSM) in railway traction applications. Taking into account all the specific requirements of the application and in order to stand-out its traction application capacity, a detailed analysis of the torque optimization technique (MTPA) and machine start-up capacity with low switching frequency have also been presented. Moreover, in order to achieve a robust control, two online permanent-magnet flux estimation techniques have been implemented. Experimental results, obtained from a 100-kW test bench, have demonstrated that the M-DSC control strategy fulfills all the railway-traction requirements: especially its very good dynamic performance. Therefore, this control can be a feasible alternative in PMSMs for railway traction applications.
- 24 May 2016
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Industrial Electronics
- Vol. 63 (02780046) , 1
Validation of a modified direct-self control strategy for PMSM in railway-traction applications
This paper proposes and validates a modified direct-self-control (M-DSC) as a new control strategy option for permanent-magnet synchronous machine (PMSM) in railway traction applications. Taking into account all the specific requirements of the application and in order to stand-out its traction application capacity, a detailed analysis of the torque optimization technique (MTPA) and machine start-up capacity with low switching frequency have also been presented. Moreover, in order to achieve a robust control, two online permanent-magnet flux estimation techniques have been implemented. Experimental results, obtained from a 100-kW test bench, have demonstrated that the M-DSC control strategy fulfills all the railway-traction requirements: especially its very good dynamic performance. Therefore, this control can be a feasible alternative in PMSMs for railway traction applications.