Masoud Jalayer
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Masoud Jalayer has a total of 28 co-authors. Here are the top co-authors by number of shared publications:
- Homayoun Najjaran
University of Victoria
6 shared publications - Carlotta Orsenigo
Politecnico di Milano
5 shared publications - Reza Jalayer
Department of Management, Economics and Industrial Engineering Politecnico di Milano Via Lambruschini 24/b 20156 Milan Italy
5 shared publications - Ardeshir Shojaeinasab
Department of Electrical and Computer Engineering, University of Victoria, Victoria, BC V8P 5C2, Canada
4 shared publications - Maryam Ahang
Faculty of Engineering and Computer Science University of Victoria Canada
3 shared publications - Todd Charter
Department of Electrical and Computer Engineering University of Victoria V8P 5C2 Victoria BC Canada
3 shared publications
Latest Publications
- Open Access
- 2 September 2025
- Published by Elsevier in Robotics and Computer-Integrated Manufacturing
- Vol. 97
A review on deep learning for vision-based hand detection, hand segmentation and hand gesture recognition in human–robot interaction
- 2 September 2025
- Published by Elsevier in Robotics and Computer-Integrated Manufacturing
- Vol. 97
Open AccessA review on deep learning for vision-based hand detection, hand segmentation and hand gesture recognition in human–robot interaction
- Open Access
- 26 August 2025
- Published by MDPI AG in Applied Sciences
- Vol. 15 (17) , 9354
A Review on Sound Source Localization in Robotics: Focusing on Deep Learning Methods
Sound source localization (SSL) adds a spatial dimension to auditory perception, allowing a system to pinpoint the origin of speech, machinery noise, warning tones, or other acoustic events, capabilities that facilitate robot navigation, human–machine dialogue, and condition monitoring. While existing surveys provide valuable historical context, they typically address general audio applications and do not fully account for robotic constraints or the latest advancements in deep learning. This review addresses these gaps by offering a robotics-focused synthesis, emphasizing recent progress in deep learning methodologies. We start by reviewing classical methods such as time difference of arrival (TDOA), beamforming, steered-response power (SRP), and subspace analysis. Subsequently, we delve into modern machine learning (ML) and deep learning (DL) approaches, discussing traditional ML and neural networks (NNs), convolutional neural networks (CNNs), convolutional recurrent neural networks (CRNNs), and emerging attention-based architectures. The data and training strategy that are the two cornerstones of DL-based SSL are explored. Studies are further categorized by robot types and application domains to facilitate researchers in identifying relevant work for their specific contexts. Finally, we highlight the current challenges in SSL works in general, regarding environmental robustness, sound source multiplicity, and specific implementation constraints in robotics, as well as data and learning strategies in DL-based SSL. Also, we sketch promising directions to offer an actionable roadmap toward robust, adaptable, efficient, and explainable DL-based SSL for next-generation robots.
- 26 August 2025
- Published by MDPI AG in Applied Sciences
- Vol. 15 (17) , 9354
Open AccessA Review on Sound Source Localization in Robotics: Focusing on Deep Learning Methods
Sound source localization (SSL) adds a spatial dimension to auditory perception, allowing a system to pinpoint the origin of speech, machinery noise, warning tones, or other acoustic events, capabilities that facilitate robot navigation, human–machine dialogue, and condition monitoring. While existing surveys provide valuable historical context, they typically address general audio applications and do not fully account for robotic constraints or the latest advancements in deep learning. This review addresses these gaps by offering a robotics-focused synthesis, emphasizing recent progress in deep learning methodologies. We start by reviewing classical methods such as time difference of arrival (TDOA), beamforming, steered-response power (SRP), and subspace analysis. Subsequently, we delve into modern machine learning (ML) and deep learning (DL) approaches, discussing traditional ML and neural networks (NNs), convolutional neural networks (CNNs), convolutional recurrent neural networks (CRNNs), and emerging attention-based architectures. The data and training strategy that are the two cornerstones of DL-based SSL are explored. Studies are further categorized by robot types and application domains to facilitate researchers in identifying relevant work for their specific contexts. Finally, we highlight the current challenges in SSL works in general, regarding environmental robustness, sound source multiplicity, and specific implementation constraints in robotics, as well as data and learning strategies in DL-based SSL. Also, we sketch promising directions to offer an actionable roadmap toward robust, adaptable, efficient, and explainable DL-based SSL for next-generation robots.
- Open Access
- 20 June 2025
- Published by Elsevier in Mechatronics
- Vol. 110
Testing human-hand segmentation on in-distribution and out-of-distribution data in human–robot interactions using a deep ensemble model
- 20 June 2025
- Published by Elsevier in Mechatronics
- Vol. 110
Open AccessTesting human-hand segmentation on in-distribution and out-of-distribution data in human–robot interactions using a deep ensemble model
- Top Cited Papers
- 7 January 2025
- Published by Elsevier in Computers & Industrial Engineering
- Vol. 200
Deep reinforcement learning for machine scheduling: Methodology, the state-of-the-art, and future directions
- 7 January 2025
- Published by Elsevier in Computers & Industrial Engineering
- Vol. 200
Top Cited PapersDeep reinforcement learning for machine scheduling: Methodology, the state-of-the-art, and future directions
- Open Access
Evaluating deep learning models for fault diagnosis of a rotating machinery with epistemic and aleatoric uncertainty
Uncertainty-aware deep learning (DL) models recently gained attention in fault diagnosis as a way to promote the reliable detection of faults when out-of-distribution (OOD) data arise from unseen faults (epistemic uncertainty) or the presence of noise (aleatoric uncertainty). In this paper, we present the first comprehensive comparative study of state-of-the-art uncertainty-aware DL architectures for fault diagnosis in rotating machinery, where different scenarios affected by epistemic uncertainty and different types of aleatoric uncertainty are investigated. The selected architectures include sampling by dropout, Bayesian neural networks, and deep ensembles. Moreover, to distinguish between in-distribution and OOD data in the different scenarios two uncertainty thresholds, one of which is introduced in this paper, are alternatively applied. Our empirical findings offer guidance to practitioners and researchers who have to deploy real-world uncertainty-aware fault diagnosis systems. In particular, they reveal that, in the presence of epistemic uncertainty, all DL models are capable of effectively detecting, on average, a substantial portion of OOD data across all the scenarios. However, deep ensemble models show superior performance, independently of the uncertainty threshold used for discrimination. In the presence of aleatoric uncertainty, the noise level plays an important role. Specifically, low noise levels hinder the models' ability to effectively detect OOD data. Even in this case, however, deep ensemble models exhibit a milder degradation in performance, dominating the others. These achievements, combined with their shorter inference time, make deep ensemble architectures the preferred choice.
Open AccessEvaluating deep learning models for fault diagnosis of a rotating machinery with epistemic and aleatoric uncertainty
Uncertainty-aware deep learning (DL) models recently gained attention in fault diagnosis as a way to promote the reliable detection of faults when out-of-distribution (OOD) data arise from unseen faults (epistemic uncertainty) or the presence of noise (aleatoric uncertainty). In this paper, we present the first comprehensive comparative study of state-of-the-art uncertainty-aware DL architectures for fault diagnosis in rotating machinery, where different scenarios affected by epistemic uncertainty and different types of aleatoric uncertainty are investigated. The selected architectures include sampling by dropout, Bayesian neural networks, and deep ensembles. Moreover, to distinguish between in-distribution and OOD data in the different scenarios two uncertainty thresholds, one of which is introduced in this paper, are alternatively applied. Our empirical findings offer guidance to practitioners and researchers who have to deploy real-world uncertainty-aware fault diagnosis systems. In particular, they reveal that, in the presence of epistemic uncertainty, all DL models are capable of effectively detecting, on average, a substantial portion of OOD data across all the scenarios. However, deep ensemble models show superior performance, independently of the uncertainty threshold used for discrimination. In the presence of aleatoric uncertainty, the noise level plays an important role. Specifically, low noise levels hinder the models' ability to effectively detect OOD data. Even in this case, however, deep ensemble models exhibit a milder degradation in performance, dominating the others. These achievements, combined with their shorter inference time, make deep ensemble architectures the preferred choice.
- Open Access
Unveiling the Black Box: A Unified XAI Framework for Signal-Based Deep Learning Models
Condition monitoring (CM) is essential for maintaining operational reliability and safety in complex machinery, particularly in robotic systems. Despite the potential of deep learning (DL) in CM, its ‘black box’ nature restricts its broader adoption, especially in mission-critical applications. Addressing this challenge, our research introduces a robust, four-phase framework explicitly designed for DL-based CM in robotic systems. (1) Feature extraction utilizes advanced Fourier and wavelet transformations to enhance both the model’s accuracy and explainability. (2) Fault diagnosis employs a specialized Convolutional Long Short-Term Memory (CLSTM) model, trained on the features to classify signals effectively. (3) Model refinement uses SHAP (SHapley Additive exPlanation) values for pruning nonessential features, thereby simplifying the model and reducing data dimensionality. (4) CM interpretation develops a system offering insightful explanations of the model’s decision-making process for operators. This framework is rigorously evaluated against five existing fault diagnosis architectures, utilizing two distinct datasets: one involving torque measurements from a robotic arm for safety assessment and another capturing vibration signals from an electric motor with multiple fault types. The results affirm our framework’s superior optimization, reduced training and inference times, and effectiveness in transparently visualizing fault patterns.
Open AccessUnveiling the Black Box: A Unified XAI Framework for Signal-Based Deep Learning Models
Condition monitoring (CM) is essential for maintaining operational reliability and safety in complex machinery, particularly in robotic systems. Despite the potential of deep learning (DL) in CM, its ‘black box’ nature restricts its broader adoption, especially in mission-critical applications. Addressing this challenge, our research introduces a robust, four-phase framework explicitly designed for DL-based CM in robotic systems. (1) Feature extraction utilizes advanced Fourier and wavelet transformations to enhance both the model’s accuracy and explainability. (2) Fault diagnosis employs a specialized Convolutional Long Short-Term Memory (CLSTM) model, trained on the features to classify signals effectively. (3) Model refinement uses SHAP (SHapley Additive exPlanation) values for pruning nonessential features, thereby simplifying the model and reducing data dimensionality. (4) CM interpretation develops a system offering insightful explanations of the model’s decision-making process for operators. This framework is rigorously evaluated against five existing fault diagnosis architectures, utilizing two distinct datasets: one involving torque measurements from a robotic arm for safety assessment and another capturing vibration signals from an electric motor with multiple fault types. The results affirm our framework’s superior optimization, reduced training and inference times, and effectiveness in transparently visualizing fault patterns.
- Open Access
Deep reinforcement learning for machine scheduling: Methodology, the state-of-the-art, and future directions
Machine scheduling aims to optimize job assignments to machines while adhering to manufacturing rules and job specifications. This optimization leads to reduced operational costs, improved customer demand fulfillment, and enhanced production efficiency. However, machine scheduling remains a challenging combinatorial problem due to its NP-hard nature. Deep Reinforcement Learning (DRL), a key component of artificial general intelligence, has shown promise in various domains like gaming and robotics. Researchers have explored applying DRL to machine scheduling problems since 1995. This paper offers a comprehensive review and comparison of DRL-based approaches, highlighting their methodology, applications, advantages, and limitations. It categorizes these approaches based on computational components: conventional neural networks, encoder-decoder architectures, graph neural networks, and metaheuristic algorithms. Our review concludes that DRL-based methods outperform exact solvers, heuristics, and tabular reinforcement learning algorithms in terms of computation speed and generating near-global optimal solutions. These DRL-based approaches have been successfully applied to static and dynamic scheduling across diverse machine environments and job characteristics. However, DRL-based schedulers face limitations in handling complex operational constraints, configurable multi-objective optimization, generalization, scalability, interpretability, and robustness. Addressing these challenges will be a crucial focus for future research in this field. This paper serves as a valuable resource for researchers to assess the current state of DRL-based machine scheduling and identify research gaps. It also aids experts and practitioners in selecting the appropriate DRL approach for production scheduling.
Open AccessDeep reinforcement learning for machine scheduling: Methodology, the state-of-the-art, and future directions
Machine scheduling aims to optimize job assignments to machines while adhering to manufacturing rules and job specifications. This optimization leads to reduced operational costs, improved customer demand fulfillment, and enhanced production efficiency. However, machine scheduling remains a challenging combinatorial problem due to its NP-hard nature. Deep Reinforcement Learning (DRL), a key component of artificial general intelligence, has shown promise in various domains like gaming and robotics. Researchers have explored applying DRL to machine scheduling problems since 1995. This paper offers a comprehensive review and comparison of DRL-based approaches, highlighting their methodology, applications, advantages, and limitations. It categorizes these approaches based on computational components: conventional neural networks, encoder-decoder architectures, graph neural networks, and metaheuristic algorithms. Our review concludes that DRL-based methods outperform exact solvers, heuristics, and tabular reinforcement learning algorithms in terms of computation speed and generating near-global optimal solutions. These DRL-based approaches have been successfully applied to static and dynamic scheduling across diverse machine environments and job characteristics. However, DRL-based schedulers face limitations in handling complex operational constraints, configurable multi-objective optimization, generalization, scalability, interpretability, and robustness. Addressing these challenges will be a crucial focus for future research in this field. This paper serves as a valuable resource for researchers to assess the current state of DRL-based machine scheduling and identify research gaps. It also aids experts and practitioners in selecting the appropriate DRL approach for production scheduling.
- 25 August 2023
- Published by Springer Nature
- p. 12-19
A Model Identification Forensics Approach for Signal-Based Condition Monitoring
- 25 August 2023
- Published by Springer Nature
- p. 12-19
A Model Identification Forensics Approach for Signal-Based Condition Monitoring
- 24 August 2023
- Published by Springer Nature
- p. 699-707
A Conceptual Framework for Localization of Active Sound Sources in Manufacturing Environment Based on Artificial Intelligence
- 24 August 2023
- Published by Springer Nature
- p. 699-707
A Conceptual Framework for Localization of Active Sound Sources in Manufacturing Environment Based on Artificial Intelligence
- Open Access
Synthesizing Rolling Bearing Fault Samples in New Conditions: A framework based on a modified CGAN
Bearings are one of the vital components of rotating machines that are prone to unexpected faults. Therefore, bearing fault diagnosis and condition monitoring is essential for reducing operational costs and downtime in numerous industries. In various production conditions, bearings can be operated under a range of loads and speeds, which causes different vibration patterns associated with each fault type. Normal data is ample as systems usually work in desired conditions. On the other hand, fault data is rare, and in many conditions, there is no data recorded for the fault classes. Accessing fault data is crucial for developing data-driven fault diagnosis tools that can improve both the performance and safety of operations. To this end, a novel algorithm based on Conditional Generative Adversarial Networks (CGANs) is introduced. Trained on the normal and fault data on any actual fault conditions, this algorithm generates fault data from normal data of target conditions. The proposed method is validated on a real-world bearing dataset, and fault data are generated for different conditions. Several state-of-the-art classifiers and visualization models are implemented to evaluate the quality of the synthesized data. The results demonstrate the efficacy of the proposed algorithm.
Open AccessSynthesizing Rolling Bearing Fault Samples in New Conditions: A framework based on a modified CGAN
Bearings are one of the vital components of rotating machines that are prone to unexpected faults. Therefore, bearing fault diagnosis and condition monitoring is essential for reducing operational costs and downtime in numerous industries. In various production conditions, bearings can be operated under a range of loads and speeds, which causes different vibration patterns associated with each fault type. Normal data is ample as systems usually work in desired conditions. On the other hand, fault data is rare, and in many conditions, there is no data recorded for the fault classes. Accessing fault data is crucial for developing data-driven fault diagnosis tools that can improve both the performance and safety of operations. To this end, a novel algorithm based on Conditional Generative Adversarial Networks (CGANs) is introduced. Trained on the normal and fault data on any actual fault conditions, this algorithm generates fault data from normal data of target conditions. The proposed method is validated on a real-world bearing dataset, and fault data are generated for different conditions. Several state-of-the-art classifiers and visualization models are implemented to evaluate the quality of the synthesized data. The results demonstrate the efficacy of the proposed algorithm.