Sebastian Meister

The Automated Fibre Placement process is commonly used in aerospace for the manufacturing of structural components, but requires a subsequent inspection to meet the corresponding safety requirements. In order to improve this mostly manual inspection step, machine learning methods for the interpretation of 2D surface images are being increasingly utilised in research. Depending on the manufacturing process, a very long time can elapse between the appearance of a manufacturing defect and its recognition. Hence, in this paper Convolutional and Recurrent Neural Network techniques are presented that allow a line-by-line analysis of the incoming height profile scans of a Laser Line Scan Sensor as a 1D signal, which enables a direct reaction to a defect, even if only one or a few individual height profiles of the defect have been recorded. The combination of Convolutional and Recurrent Neural Network structures is particularly beneficial for this application. The investigations in this paper are especially interesting for developers of automated inspection systems in composite engineering.

Automated fibre layup techniques are often applied for the production of complex structural components. In order to ensure a sufficient component quality, a subsequent visual inspection is necessary, especially in the aerospace industry. The use of automated optical inspection systems can reduce the inspection effort by up to 50 %. Laser line scan sensors, which capture the topology of the surface, are particularly advantageous for this purpose. These sensors project a laser beam at an angle onto the surface and detect its position via a camera. The optical properties of the observed surface potentially have a great influence on the quality of the recorded data. This is especially relevant for dark or highly scattering materials such as Carbon Fiber Reinforced Plastics (CFRP). For this reason, in this study we investigate the optical reflection and transmission properties of the commonly used Hexel HexPly 8552 IM7 prepreg CFRP in detail. Therefore, we utilise a Gonioreflectometer to investigate such optical characteristics of the material with respect to different fibre orientations, illumination directions and detection angles. In this way, specific scattering information of the material in the hemispherical space are recorded. The major novelty of this research are the findings about the scattering behaviour of the fibre composite material which can be used as a more precise input for the methods of image data quality assessment from our previous research and thus is particularly valuable for developers and users of camera based inspection systems for CFRP components.

Automated Fibre Placement is a common manufacturing technique for composite parts in the aero-space industry. Therefore, a visual part inspection is required which often covers up to 50% of the actual production time. Moreover, the inspection quality of this manual step fluctuates significantly. A camera-based automated inline inspection is capable of increasing the inspection efficiency and accuracy. However, the interpretability of the acquired data strongly depends on the sensor configuration and the inspected material. Thus, this paper introduces methods for modelling and assessing an imaging sensor on the example of a composite material reflecting a spot laser to a camera sensor. In this context, the reflection properties of the material are incorporated into a simulation and validated in comparison to real camera images from the experimental setup. The EMVA 1288 sensor model in combination with the Cramér–Rao lower bound indicates a feasible estimability of the beam propagation, but shows limitations in the predictability of the number of incident photons. The laser spot analysis indicated that the laser spot can deviate from an exact oval shape but its peak value is suitable for robust spot identification in an image. The outlined methodology is also adaptable to other imaging sensors, illumination sources and materials. Thus, the findings can be useful for other fields and manufacturing processes.

In the aerospace industry, the Automated Fiber Placement process is an established method for producing composite parts. Nowadays the required visual inspection, subsequent to this process, typically takes up to 50% of the total manufacturing time and the inspection quality strongly depends on the inspector. A Deep Learning based classification of manufacturing defects is a possibility to improve the process efficiency and accuracy. However, these techniques require several hundreds or thousands of training data samples. Acquiring this huge amount of data is difficult and time consuming in a real world manufacturing process. Thus, an approach for augmenting a smaller number of defect images for the training of a neural network classifier is presented. Five traditional methods and eight deep learning approaches are theoretically assessed according to the literature. The selected conditional Deep Convolutional Generative Adversarial Network and Geometrical Transformation techniques are investigated in detail, with regard to the diversity and realism of the synthetic images. Between 22 and 166 laser line scan sensor images per defect class from six common fiber placement inspection cases are utilised for tests. The GAN-Train GAN-Test method was applied for the validation. The studies demonstrated that a conditional Deep Convolutional Generative Adversarial Network combined with a previous Geometrical Transformation is well suited to generate a large realistic data set from less than 50 actual input images. The presented network architecture and the associated training weights can serve as a basis for applying the demonstrated approach to other fibre layup inspection images.