Michał Piekarski

This paper presents an in-depth analysis of multi-modal, deep learning-based frameworks for fault detection within big research infrastructures, with a specific focus on synchrotron facilities. The study investigates various approaches and architectures and their accuracy in identifying anomalies indicative of potential faults or irregularities in operation. Leveraging a case study approach, we check the performance and applicability of these frameworks within the complex environment of big research infrastructures. Through comprehensive analysis and comparison, we highlight the strengths, limitations, and potential challenges associated with deploying deep learning techniques for fault detection in such a large-scale environment. We achieved accuracy at the level of 94.6% with image data input and a high sensitivity of 95.7% with the multi-modal framework. This investigation contributes valuable insights for researchers and practitioners seeking to enhance the reliability and efficiency of fault detection systems in synchrotron facilities and analogous setups.

The National Synchrotron Radiation Center SOLARIS, ranked among the top infrastructures of that type worldwide, is the only one located in Central-Eastern Europe, in Poland. The SOLARIS Center, with six fully operational beamlines, serves as a hub for research across a diverse range of disciplines. This cutting-edge facility fosters innovation in fields like biology, chemistry, and physics as well as material engineering, nanotechnology, medicine, and pharmacology. With its advanced infrastructure and multidisciplinary approach, the SOLARIS Center enables discoveries and pushes the boundaries of knowledge. The most important aspect of such enormous research as well as industry infrastructure is to provide stable working conditions for the users and the conducted projects. Due to its unique properties, problem complexities, and challenges that require advanced approaches, the problem of anomaly detection and automatic analysis of signals for the beam stability assessment is still a huge challenge that has not been fully developed. To increase the effectiveness of centers with advanced research infrastructure we focus on the automatic analysis of transverse beam profiles generated by the Pinhole diagnostic beam-line. Pinhole beamlines are typically installed in the middle and high-energy synchrotrons to thoroughly analyze emitted X-rays and therefore assess electron beam quality. To address the problem we take advantage of AI solutions including up-to-date pre-trained convolutional neural network (CNN) models among others EfficientNetB0-B4-B6, InceptionV3 and DenseNet121. In this research, we propose the benchmark for Pinhole image classification including data preprocessing, model implementation, training process, hyperparameter selection as well as testing phase. Created from scratch database contains over one million transverse beam profile images. The proposed solution, based on the InceptionV3 architecture, classifies pinhole beamline images with 94.1% accuracy and 96.6% precision which is a state-of-the-art result in this research area. Finally, we employed interpretability algorithms to perform an analysis of the models and achieved results.

One of the biggest challenge in the field of deep learning is the parameter selection and optimization process. In recent years different algorithms have been proposed including bio-inspired solutions to solve this problem, however, there are many challenges including local minima, saddle points, and vanishing gradients. In this paper, we introduce the Whale Optimisation Algorithm (WOA) based on the swarm foraging behavior of humpback whales to optimise neural network hyperparameters. We wish to stress that to the best of our knowledge this is the first attempt that uses Whale Optimisation Algorithm for the optimisation task of hyperparameters. After a detailed description of the WOA algorithm we formulate and explain the application in deep learning, present the implementation, and compare the proposed algorithm with other well-known algorithms including widely used Grid and Random Search methods. Additionally, we have implemented a third dimension feature analysis to the original WOA algorithm to utilize 3D search space (3D-WOA). Simulations show that the proposed algorithm can be successfully used for hyperparameters optimization, achieving accuracy of 89.85% and 80.60% for Fashion MNIST and Reuters datasets, respectively.

Deep learning methods, used in machine vision challenges, often face the problem of the amount and quality of data. To address this issue, we investigate the transfer learning method. In this study, we briefly describe the idea and introduce two main strategies of transfer learning. We also present the widely-used neural network models, that in recent years performed best in ImageNet classification challenges. Furthermore, we shortly describe three different experiments from computer vision field, that confirm the developed algorithms ability to classify images with overall accuracy 87.2-95%. Achieved numbers are state-of-the-art results in melanoma thickness prediction, anomaly detection and Clostridium di cile cytotoxicity classification problems.