Machine learning in electron microscopy for advanced nanocharacterization: current developments, available tools and future outlook
Top Cited Papers
Open Access
- 14 October 2022
- journal article
- review article
- Published by Royal Society of Chemistry (RSC) in Nanoscale Horizons
- Vol. 7 (12) , 1427-1477
Abstract
In the last few years, electron microscopy has experienced a new methodological paradigm aimed to fix the bottlenecks and overcome the challenges of its analytical workflow. Machine learning and artificial intelligence are answering this call providing powerful resources towards automation, exploration, and development. In this review, we evaluate the state-of-the-art of machine learning applied to electron microscopy (and obliquely, to materials and nano-sciences). We start from the traditional imaging techniques to reach the newest higher-dimensionality ones, also covering the recent advances in spectroscopy and tomography. Additionally, the present review provides a practical guide for microscopists, and in general for material scientists, but not necessarily advanced machine learning practitioners, to straightforwardly apply the offered set of tools to their own research. To conclude, we explore the state-of-the-art of other disciplines with a broader experience in applying artificial intelligence methods to their research (e.g., high-energy physics, astronomy, Earth sciences, and even robotics, videogames, or marketing and finances), in order to narrow down the incoming future of electron microscopy, its challenges and outlook.Keywords
Funding Information
- Consejo Superior de Investigaciones Científicas (CSIC Interdisciplinary Thematic Platform (PTI+) on Quantum Technologies (PT-QTEP+))
- Agència de Gestió d’Ajuts Universitaris i de Recerca (2017 SGR 327, 2020 FI 00103, CERCA)
- European Regional Development Fund (ERDF A way of making Europe)
- Agencia Estatal de Investigación (SEV-2017-0706)
- Generalitat de Catalunya
- Ministerio de Ciencia e Innovación
- European Commission (PRTR-C17-I1)
This publication has 542 references indexed in Scilit:
- Reinforcement learning in robotics: A surveyThe International Journal of Robotics Research, 2013
- Crystallography Open Database (COD): an open-access collection of crystal structures and platform for world-wide collaborationNucleic Acids Research, 2011
- Reference-free particle selection enhanced with semi-supervised machine learning for cryo-electron microscopyJournal of Structural Biology, 2011
- Mapping titanium and tin oxide phases using EELS: An application of independent component analysisUltramicroscopy, 2011
- Automated nanocrystal orientation and phase mapping in the transmission electron microscope on the basis of precession electron diffractionZeitschrift für Kristallographie, 2010
- Automatic particle selection from electron micrographs using machine learning techniquesJournal of Structural Biology, 2009
- Crystallography Open Database – an open-access collection of crystal structuresJournal of Applied Crystallography, 2009
- Robust locally linear embeddingPattern Recognition, 2006
- Extending Energy-Filtered Transmission Electron Microscopy (EFTEM) into Three Dimensions Using Electron TomographyMicroscopy and Microanalysis, 2003
- Cryo-electron microscopy of vitrified specimensQuarterly Reviews of Biophysics, 1988