Martin J. Hayes
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Martin J. Hayes has a total of 91 co-authors. Here are the top co-authors by number of shared publications:
- Michael Walsh
Wireless Sensor Networks Group, University College Cork, Cork, Ireland
12 shared publications R. Burch
CenTACat, Queen's University Belfast, David Keir Building, Stranmillis Road, Belfast BT9 5AG, N. Ireland, UK
6 shared publications- Kritchai Witheephanich
UL, University of Limerick
4 shared publications - Pepijn Van de Ven
Health Research Institute, University of Limerick, Limerick, Ireland
4 shared publications - Reenu Mohandas
Department of Electronic and Computer Engineering, University of Limerick, Limerick, Ireland
4 shared publications S.M. Mahdi Alavi
4 shared publications
Latest Publications
- Open Access
- 4 December 2025
- Published by MDPI AG in Big Data and Cognitive Computing
- Vol. 9 (12) , 312
Subjective Evaluation of Operator Responses for Mobile Defect Identification in Remanufacturing: Application of NLP and Disagreement Tagging
In the context of remanufacturing, particularly mobile device refurbishing, effective operator training is crucial for accurate defect identification and process inspection efficiency. This study examines the application of Natural Language Processing (NLP) techniques to evaluate operator expertise based on subjective textual responses gathered during a defect analysis task. Operators were asked to describe screen defects using open-ended questions, and their responses were compared with expert responses to evaluate their accuracy and consistency. We employed four NLP models, including finetuned Sentence-BERT (SBERT), pre-trained SBERT, Word2Vec, and Dice similarity, to determine their effectiveness in interpreting short, domain-specific text. A novel disagreement tagging framework was introduced to supplement traditional similarity metrics with explainable insights. This framework identifies the root causes of model–human misalignment across four categories: defect type, severity, terminology, and location. Results show that a finetuned SBERT model significantly outperforms other models by achieving Pearsons’s correlation of 0.93 with MAE and RMSE scores of 0.07 and 0.12, respectively, providing more accurate and context-aware evaluations. In contrast, other models exhibit limitations in semantic understanding and consistency. The results highlight the importance of finetuning NLP models for domain-specific applications and demonstrate how qualitative tagging methods can enhance interpretability and model debugging. This combined approach indicates a scalable and transparent methodology for the evaluation of operator responses, supporting the development of more effective training programmes in industrial settings where remanufacturing and sustainability generally are a key performance metric.
- 4 December 2025
- Published by MDPI AG in Big Data and Cognitive Computing
- Vol. 9 (12) , 312
Open AccessSubjective Evaluation of Operator Responses for Mobile Defect Identification in Remanufacturing: Application of NLP and Disagreement Tagging
In the context of remanufacturing, particularly mobile device refurbishing, effective operator training is crucial for accurate defect identification and process inspection efficiency. This study examines the application of Natural Language Processing (NLP) techniques to evaluate operator expertise based on subjective textual responses gathered during a defect analysis task. Operators were asked to describe screen defects using open-ended questions, and their responses were compared with expert responses to evaluate their accuracy and consistency. We employed four NLP models, including finetuned Sentence-BERT (SBERT), pre-trained SBERT, Word2Vec, and Dice similarity, to determine their effectiveness in interpreting short, domain-specific text. A novel disagreement tagging framework was introduced to supplement traditional similarity metrics with explainable insights. This framework identifies the root causes of model–human misalignment across four categories: defect type, severity, terminology, and location. Results show that a finetuned SBERT model significantly outperforms other models by achieving Pearsons’s correlation of 0.93 with MAE and RMSE scores of 0.07 and 0.12, respectively, providing more accurate and context-aware evaluations. In contrast, other models exhibit limitations in semantic understanding and consistency. The results highlight the importance of finetuning NLP models for domain-specific applications and demonstrate how qualitative tagging methods can enhance interpretability and model debugging. This combined approach indicates a scalable and transparent methodology for the evaluation of operator responses, supporting the development of more effective training programmes in industrial settings where remanufacturing and sustainability generally are a key performance metric.
- Open Access
- 1 October 2025
- Published by MDPI AG in Future Internet
- Vol. 17 (10) , 453
Assessing Student Engagement: A Machine Learning Approach to Qualitative Analysis of Institutional Effectiveness
In higher education, institutional quality is traditionally assessed through metrics such as academic programs, research output, educational resources, and community services. However, it is important that their activities align with student expectations, particularly in relation to interactive learning environments, learning management system interaction, curricular and co-curricular activities, accessibility, support services and other learning resources that ensure academic success and, jointly, career readiness. The growing popularity of student engagement metrics as one of the key measures to evaluate institutional efficacy is now a feature across higher education. By monitoring student engagement, institutions assess the impact of existing resources and make necessary improvements or interventions to ensure student success. This study presents a comprehensive analysis of student feedback from the StudentSurvey.ie dataset (2016–2022), which consists of approximately 275,000 student responses, focusing on student self-perception of engagement in the learning process. By using classical topic modelling techniques such as Latent Dirichlet Allocation (LDA) and Bi-term Topic Modelling (BTM), along with the advanced transformer-based BERTopic model, we identify key themes in student responses that can impact institutional strength performance metrics. BTM proved more effective than LDA for short text analysis, whereas BERTopic offered greater semantic coherence and uncovered hidden themes using deep learning embeddings. Moreover, a custom Named Entity Recognition (NER) model successfully extracted entities such as university personnel, digital tools, and educational resources, with improved performance as the training data size increased. To enable students to offer actionable feedback, suggesting areas of improvement, an n-gram and bigram network analysis was used to focus on common modifiers such as “more” and “better” and trends across student groups. This study introduces a fully automated, scalable pipeline that integrates topic modelling, NER, and n-gram analysis to interpret student feedback, offering reportable insights and supporting structured enhancements to the student learning experience.
- 1 October 2025
- Published by MDPI AG in Future Internet
- Vol. 17 (10) , 453
Open AccessAssessing Student Engagement: A Machine Learning Approach to Qualitative Analysis of Institutional Effectiveness
In higher education, institutional quality is traditionally assessed through metrics such as academic programs, research output, educational resources, and community services. However, it is important that their activities align with student expectations, particularly in relation to interactive learning environments, learning management system interaction, curricular and co-curricular activities, accessibility, support services and other learning resources that ensure academic success and, jointly, career readiness. The growing popularity of student engagement metrics as one of the key measures to evaluate institutional efficacy is now a feature across higher education. By monitoring student engagement, institutions assess the impact of existing resources and make necessary improvements or interventions to ensure student success. This study presents a comprehensive analysis of student feedback from the StudentSurvey.ie dataset (2016–2022), which consists of approximately 275,000 student responses, focusing on student self-perception of engagement in the learning process. By using classical topic modelling techniques such as Latent Dirichlet Allocation (LDA) and Bi-term Topic Modelling (BTM), along with the advanced transformer-based BERTopic model, we identify key themes in student responses that can impact institutional strength performance metrics. BTM proved more effective than LDA for short text analysis, whereas BERTopic offered greater semantic coherence and uncovered hidden themes using deep learning embeddings. Moreover, a custom Named Entity Recognition (NER) model successfully extracted entities such as university personnel, digital tools, and educational resources, with improved performance as the training data size increased. To enable students to offer actionable feedback, suggesting areas of improvement, an n-gram and bigram network analysis was used to focus on common modifiers such as “more” and “better” and trends across student groups. This study introduces a fully automated, scalable pipeline that integrates topic modelling, NER, and n-gram analysis to interpret student feedback, offering reportable insights and supporting structured enhancements to the student learning experience.
- Open Access
- 3 February 2025
- Published by Elsevier in Data in Brief
- Vol. 59, 111367
DriVQA: A gaze-based dataset for visual question answering in driving scenarios
- 3 February 2025
- Published by Elsevier in Data in Brief
- Vol. 59, 111367
Open AccessDriVQA: A gaze-based dataset for visual question answering in driving scenarios
- Open Access
- 14 January 2025
- Published by Springer Nature in Journal of Remanufacturing
- Vol. 15 (1) , 65-95
Deep learning enabled computer vision in remanufacturing and refurbishment applications: defect detection and grading for smart phones
This work demonstrates the use of Deep Learning-based Computer Vision for Remanufacturing end-of-life consumer electronics products, considering smartphones as the use-case. We implemented automated detection of screen defects such as scratches and cracks. In turn, this could lead to increased reuse of smartphones in a secondary market alongside new ones to meet consumer demand. The refurbishment of smartphone devices is a growing industry heavily dependent on manual labor, making decisions subjective, especially in grading the severity of damage. A critical analysis of defect detection and smartphone grading from a remanufacturing perspective is conducted. This analysis is significant in a remanufacturing sector that deals with dynamically varying input of cores (used products for remanufacturing), characteristics, timing, and number of returns. The solution we propose here is novel in its own right, requiring data analysis and collection, data curing, defect parameterization, and dataset building to enable model-based training and detection experiments. We collected and annotated a dataset to detect and grade the various defects based on their severity. A range of deep learning models was trained on the dataset to obtain baseline results for the state-of-the-art deep learning detection models, including YOLOv7, YOLOv8, YOLO11 variants, and Mask R-CNN. Our experiments also showed improved precision values when the pre-trained models were pre-fine-tuned using a road crack segmentation dataset before training on our phone defect dataset. The inference time for the YOLOv8x model is 8ms. This reduced inference time with a high precision of 70.4% indicates that a consistent, fast, and accurate grading is achieved here, ensuring a high throughput rate in the remanufacturing process and ensuring sustainability.
- 14 January 2025
- Published by Springer Nature in Journal of Remanufacturing
- Vol. 15 (1) , 65-95
Open AccessDeep learning enabled computer vision in remanufacturing and refurbishment applications: defect detection and grading for smart phones
This work demonstrates the use of Deep Learning-based Computer Vision for Remanufacturing end-of-life consumer electronics products, considering smartphones as the use-case. We implemented automated detection of screen defects such as scratches and cracks. In turn, this could lead to increased reuse of smartphones in a secondary market alongside new ones to meet consumer demand. The refurbishment of smartphone devices is a growing industry heavily dependent on manual labor, making decisions subjective, especially in grading the severity of damage. A critical analysis of defect detection and smartphone grading from a remanufacturing perspective is conducted. This analysis is significant in a remanufacturing sector that deals with dynamically varying input of cores (used products for remanufacturing), characteristics, timing, and number of returns. The solution we propose here is novel in its own right, requiring data analysis and collection, data curing, defect parameterization, and dataset building to enable model-based training and detection experiments. We collected and annotated a dataset to detect and grade the various defects based on their severity. A range of deep learning models was trained on the dataset to obtain baseline results for the state-of-the-art deep learning detection models, including YOLOv7, YOLOv8, YOLO11 variants, and Mask R-CNN. Our experiments also showed improved precision values when the pre-trained models were pre-fine-tuned using a road crack segmentation dataset before training on our phone defect dataset. The inference time for the YOLOv8x model is 8ms. This reduced inference time with a high precision of 70.4% indicates that a consistent, fast, and accurate grading is achieved here, ensuring a high throughput rate in the remanufacturing process and ensuring sustainability.
- Open Access
Ultrasonic Weld Quality Inspection Involving Strength Prediction and Defect Detection in Data-Constrained Training Environments
Welding is an extensively used technique in manufacturing, and as for every other process, there is the potential for defects in the weld joint that could be catastrophic to the manufactured products. Different welding processes use different parameter settings, which greatly impact the quality of the final welded products. The focus of research in weld defect detection is to develop a non-destructive testing method for weld quality assessment based on observing the weld with an RGB camera. Deep learning techniques have been widely used in the domain of weld defect detection in recent times, but the majority of them use, for example, X-ray images. An RGB image-based solution is attractive, as RGB cameras are comparatively inexpensive compared to X-ray image solutions. However, the number of publicly available RGB image datasets for weld defect detection is comparatively lower than that of X-ray image datasets. This work achieves a complete weld quality assessment involving lap shear strength prediction and visual weld defect detection from an extremely limited dataset. First, a multimodal dataset is generated by the fusion of image data features extracted using a convolutional autoencoder (CAE) designed in this experiment and input parameter settings data. The fusion of the dataset reduced lap shear strength (LSS) prediction errors by 34% compared to prediction errors using only input parameter settings data. This is a promising result, considering the extremely small dataset size. This work also achieves visual weld defect detection on the same limited dataset with the help of an ultrasonic weld defect dataset generated using offline and online data augmentation. The weld defect detection achieves an accuracy of 74%, again a promising result that meets standard requirements. The combination of lap shear strength prediction and visual defect detection leads to a complete inspection to avoid premature failure of the ultrasonic weld joints. The weld defect detection was compared against the publicly available image dataset for surface defect detection.
Open AccessUltrasonic Weld Quality Inspection Involving Strength Prediction and Defect Detection in Data-Constrained Training Environments
Welding is an extensively used technique in manufacturing, and as for every other process, there is the potential for defects in the weld joint that could be catastrophic to the manufactured products. Different welding processes use different parameter settings, which greatly impact the quality of the final welded products. The focus of research in weld defect detection is to develop a non-destructive testing method for weld quality assessment based on observing the weld with an RGB camera. Deep learning techniques have been widely used in the domain of weld defect detection in recent times, but the majority of them use, for example, X-ray images. An RGB image-based solution is attractive, as RGB cameras are comparatively inexpensive compared to X-ray image solutions. However, the number of publicly available RGB image datasets for weld defect detection is comparatively lower than that of X-ray image datasets. This work achieves a complete weld quality assessment involving lap shear strength prediction and visual weld defect detection from an extremely limited dataset. First, a multimodal dataset is generated by the fusion of image data features extracted using a convolutional autoencoder (CAE) designed in this experiment and input parameter settings data. The fusion of the dataset reduced lap shear strength (LSS) prediction errors by 34% compared to prediction errors using only input parameter settings data. This is a promising result, considering the extremely small dataset size. This work also achieves visual weld defect detection on the same limited dataset with the help of an ultrasonic weld defect dataset generated using offline and online data augmentation. The weld defect detection achieves an accuracy of 74%, again a promising result that meets standard requirements. The combination of lap shear strength prediction and visual defect detection leads to a complete inspection to avoid premature failure of the ultrasonic weld joints. The weld defect detection was compared against the publicly available image dataset for surface defect detection.
- Open Access
- 5 January 2024
- Published by MDPI AG in Big Data and Cognitive Computing
- Vol. 8 (1) , 7
A Survey of Incremental Deep Learning for Defect Detection in Manufacturing
Deep learning based visual cognition has greatly improved the accuracy of defect detection, reducing processing times and increasing product throughput across a variety of manufacturing use cases. There is however a continuing need for rigorous procedures to dynamically update model-based detection methods that use sequential streaming during the training phase. This paper reviews how new process, training or validation information is rigorously incorporated in real time when detection exceptions arise during inspection. In particular, consideration is given to how new tasks, classes or decision pathways are added to existing models or datasets in a controlled fashion. An analysis of studies from the incremental learning literature is presented, where the emphasis is on the mitigation of process complexity challenges such as, catastrophic forgetting. Further, practical implementation issues that are known to affect the complexity of deep learning model architecture, including memory allocation for incoming sequential data or incremental learning accuracy, is considered. The paper highlights case study results and methods that have been used to successfully mitigate such real-time manufacturing challenges.
- 5 January 2024
- Published by MDPI AG in Big Data and Cognitive Computing
- Vol. 8 (1) , 7
Open AccessA Survey of Incremental Deep Learning for Defect Detection in Manufacturing
Deep learning based visual cognition has greatly improved the accuracy of defect detection, reducing processing times and increasing product throughput across a variety of manufacturing use cases. There is however a continuing need for rigorous procedures to dynamically update model-based detection methods that use sequential streaming during the training phase. This paper reviews how new process, training or validation information is rigorously incorporated in real time when detection exceptions arise during inspection. In particular, consideration is given to how new tasks, classes or decision pathways are added to existing models or datasets in a controlled fashion. An analysis of studies from the incremental learning literature is presented, where the emphasis is on the mitigation of process complexity challenges such as, catastrophic forgetting. Further, practical implementation issues that are known to affect the complexity of deep learning model architecture, including memory allocation for incoming sequential data or incremental learning accuracy, is considered. The paper highlights case study results and methods that have been used to successfully mitigate such real-time manufacturing challenges.
- 1 November 2023
- Published by IATED Academy in ICERI Proceedings
- p. 8362-8367
DATA AUGMENTATION FOR ROBUST AUTOMATIC SHORT ANSWER GRADING
- 1 November 2023
- Published by IATED Academy in ICERI Proceedings
- p. 8362-8367
DATA AUGMENTATION FOR ROBUST AUTOMATIC SHORT ANSWER GRADING
- Open Access
Human-in-Loop: A Review of Smart Manufacturing Deployments
The recent increase in computational capability has led to an unprecedented increase in the range of new applications where machine learning can be used in real time. Notwithstanding the range of use cases where automation is now feasible, humans are likely to retain a critical role in the operation and certification of manufacturing systems for the foreseeable future. This paper presents a use case review of how human operators affect the performance of cyber–physical systems within a ’smart’ or ’cognitive’ setting. Such applications are classified using Industry 4.0 (I4.0) or 5.0 (I5.0) terminology. The authors argue that, as there is often no general agreement as to when a specific use case moves from being an I4.0 to an I5.0 example, the use of a hybrid Industry X.0 notation at the intersection between I4.0 and I5.0 is warranted. Through a structured review of the literature, the focus is on how secure human-mediated autonomous production can be performed most effectively to augment and optimise machine operation.
Open AccessHuman-in-Loop: A Review of Smart Manufacturing Deployments
The recent increase in computational capability has led to an unprecedented increase in the range of new applications where machine learning can be used in real time. Notwithstanding the range of use cases where automation is now feasible, humans are likely to retain a critical role in the operation and certification of manufacturing systems for the foreseeable future. This paper presents a use case review of how human operators affect the performance of cyber–physical systems within a ’smart’ or ’cognitive’ setting. Such applications are classified using Industry 4.0 (I4.0) or 5.0 (I5.0) terminology. The authors argue that, as there is often no general agreement as to when a specific use case moves from being an I4.0 to an I5.0 example, the use of a hybrid Industry X.0 notation at the intersection between I4.0 and I5.0 is warranted. Through a structured review of the literature, the focus is on how secure human-mediated autonomous production can be performed most effectively to augment and optimise machine operation.
- Open Access
Wireless Communications for Smart Manufacturing and Industrial IoT: Existing Technologies, 5G and Beyond
Smart manufacturing is a vision and major driver for change in today’s industry. The goal of smart manufacturing is to optimize manufacturing processes through constantly monitoring, controlling, and adapting processes towards more efficient and personalised manufacturing. This requires and relies on technologies for connected machines incorporating a variety of computation, sensing, actuation, and machine to machine communications modalities. As such, understanding the change towards smart manufacturing requires knowledge of the enabling technologies, their applications in real world scenarios and the communication protocols and their performance to meet application requirements. Particularly, wireless communication is becoming an integral part of modern smart manufacturing and is expected to play an important role in achieving the goals of smart manufacturing. This paper presents an extensive review of wireless communication protocols currently applied in manufacturing environments and provides a comprehensive review of the associated use cases whilst defining their expected impact on the future of smart manufacturing. Based on the review, we point out a number of open challenges and directions for future research in wireless communication technologies for smart manufacturing.
Open AccessWireless Communications for Smart Manufacturing and Industrial IoT: Existing Technologies, 5G and Beyond
Smart manufacturing is a vision and major driver for change in today’s industry. The goal of smart manufacturing is to optimize manufacturing processes through constantly monitoring, controlling, and adapting processes towards more efficient and personalised manufacturing. This requires and relies on technologies for connected machines incorporating a variety of computation, sensing, actuation, and machine to machine communications modalities. As such, understanding the change towards smart manufacturing requires knowledge of the enabling technologies, their applications in real world scenarios and the communication protocols and their performance to meet application requirements. Particularly, wireless communication is becoming an integral part of modern smart manufacturing and is expected to play an important role in achieving the goals of smart manufacturing. This paper presents an extensive review of wireless communication protocols currently applied in manufacturing environments and provides a comprehensive review of the associated use cases whilst defining their expected impact on the future of smart manufacturing. Based on the review, we point out a number of open challenges and directions for future research in wireless communication technologies for smart manufacturing.
- 13 October 2017
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 254-259
On the computation of the maximal structured singular value for aeronautical applications
Peer-reviewed \ud \ud This paper considers the necessary transformations and the\ud computational issues associated with the determination of the maximal\ud structured singular value without the use of a frequency gridding strategy. It\ud is shown that, for the case of purely real model perturbations, convergence\ud difficulties exist in determining bounds on the maximal structured singular\ud value using existing Matlab software. A new computational scheme is presented\ud which improves on existing methods for the computation of the worst case\ud combination of real uncertain parameters. This scheme easily outperforms\ud regularisation type solutions, which have been suggested as one way of\ud improving the convergence properties of a strictly real robustness analysis.\ud The improvement is illustrated on a well known civil aircraft robustness\ud analysis example.\ud \ud ACCEPTEDpeer-reviewe
- 13 October 2017
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 254-259
On the computation of the maximal structured singular value for aeronautical applications
Peer-reviewed \ud \ud This paper considers the necessary transformations and the\ud computational issues associated with the determination of the maximal\ud structured singular value without the use of a frequency gridding strategy. It\ud is shown that, for the case of purely real model perturbations, convergence\ud difficulties exist in determining bounds on the maximal structured singular\ud value using existing Matlab software. A new computational scheme is presented\ud which improves on existing methods for the computation of the worst case\ud combination of real uncertain parameters. This scheme easily outperforms\ud regularisation type solutions, which have been suggested as one way of\ud improving the convergence properties of a strictly real robustness analysis.\ud The improvement is illustrated on a well known civil aircraft robustness\ud analysis example.\ud \ud ACCEPTEDpeer-reviewe