Data augmentation in microscopic images for material data mining
Open Access
- 18 August 2020
- journal article
- research article
- Published by Springer Nature in npj Computational Materials
- Vol. 6 (1) , 1-9
Abstract
Recent progress in material data mining has been driven by high-capacity models trained on large datasets. However, collecting experimental data (real data) has been extremely costly owing to the amount of human effort and expertise required. Here, we develop a novel transfer learning strategy to address problems of small or insufficient data. This strategy realizes the fusion of real and simulated data and the augmentation of training data in a data mining procedure. For a specific task of grain instance image segmentation, this strategy aims to generate synthetic data by fusing the images obtained from simulating the physical mechanism of grain formation and the “image style” information in real images. The results show that the model trained with the acquired synthetic data and only 35% of the real data can already achieve competitive segmentation performance of a model trained on all of the real data. Because the time required to perform grain simulation and to generate synthetic data are almost negligible as compared to the effort for obtaining real data, our proposed strategy is able to exploit the strong prediction power of deep learning without significantly increasing the experimental burden of training data preparation.Keywords
All Related Versions
This publication has 35 references indexed in Scilit:
- Information Science for Materials Discovery and Design2016
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Fully convolutional networks for semantic segmentation2015
- Recent developments in advanced aircraft aluminium alloysMaterials & Design (1980-2015), 2014
- Future Directions in 3D Materials Science: Outlook from the First International Conference on 3D Materials ScienceJOM, 2014
- Data clustering: 50 years beyond K-meansPattern Recognition Letters, 2010
- Simulation of curvature-driven grain growth by using a modified monte carlo algorithmMetallurgical and Materials Transactions A, 1995
- Computer simulation of normal grain growth in three dimensionsPhilosophical Magazine Part B, 1989
- Comparing partitionsJournal of Classification, 1985
- Objective Criteria for the Evaluation of Clustering MethodsJournal of the American Statistical Association, 1971