Dieter Weber

In four-dimensional scanning transmission electron microscopy (4D STEM) a focused beam is scanned over a specimen and a diffraction pattern is recorded at each position using a pixelated detector. During the experiment, it must be ensured that the scan coordinate system of the beam is correctly calibrated relative to the detector coordinate system. Various simplified and approximate models are used implicitly and explicitly for understanding and analyzing the recorded data, requiring translation between the physical reality of the instrument and the abstractions used in data interpretation. Here, we introduce a calibration method where interactive live data processing in combination with a digital twin is used to match a set of models and their parameters with the action of a real-world instrument.

We demonstrate live-updating ptychographic reconstruction with the extended ptychographical iterative engine, an iterative ptychography method, during ongoing data acquisition. The reconstruction starts with a small subset of the total data, and as the acquisition proceeds the data used for reconstruction are extended. This creates a live-updating view of object and illumination that allows monitoring the ongoing experiment and adjusting parameters with quick turn around. This is particularly advantageous for long-running acquisitions. We show that such a gradual reconstruction yields interpretable results already with a small subset of the data. We show simulated live processing with various scan patterns, parallelized reconstruction, and real-world live processing at the hard X-ray ptychographic nanoanalytical microscope PtyNAMi at the PETRA III beamline.

We demonstrate live-updating ptychographic reconstruction with ePIE, an iterative ptychography method, during ongoing data acquisition. The reconstruction starts with a small subset of the total data, and as the acquisition proceeds the data used for reconstruction is extended. This creates a live-updating view of object and illumination that allows monitoring the ongoing experiment and adjusting parameters with quick turn-around. This is particularly advantageous for long-running acquisitions. We show that such a gradual reconstruction yields interpretable results already with a small subset of the data. We show simulated live processing with various scan patterns, parallelized reconstruction, and real-world live processing at the hard X-ray ptychographic nanoanalytical microscope PtyNAMi at the PETRA III beamline.

An interactive simulation of a transmission electron microscope (TEM) called TEMGYM Basic is developed here, which enables users to understand how to operate and control an electron beam without the need to access an instrument. TEMGYM Basic allows users to familiarize themselves with alignment procedures offline, reducing the time and money required to become a proficient TEM operator. In addition to teaching the basics of electron beam alignments, the software enables users to create bespoke microscope configurations and develop an understanding of how to operate the configurations without sitting at a microscope. TEMGYM Basic also creates static ray diagram figures for a given lens configuration. The available components include apertures, lenses, quadrupoles, deflectors and biprisms. The software design uses first-order ray transfer matrices to calculate ray paths through each electron microscope component, and the program is developed entirely in Python to facilitate compatibility with machine-learning packages for future exploration of automated control.

We propose a modification of Wigner distribution deconvolution (WDD) to support live processing ptychography. Live processing allows to reconstruct and display the specimen transmission function gradually while diffraction patterns are acquired. For this purpose, we reformulate WDD and apply a dimensionality reduction technique that reduces memory consumption and increases processing speed. We show numerically that this approach maintains the reconstruction quality of specimen transfer functions as well as reduces computational complexity during acquisition processes. Although we only present the reconstruction for scanning transmission electron microscopy datasets, in general, the live processing algorithm we present in this paper can be applied to real-time ptychographic reconstruction for different fields of application.

Position averaged convergent beam electron diffraction (PACBED) is one of the most convenient and precise thickness determination techniques available in a scanning transmission electron microscope. The thickness is determined by finding the best match of the recorded PACBED pattern with a series of simulated diffraction patterns by visual inspection. The automatization of this process can be enhanced by convolutional neural networks (CNNs), making the method fast and easy to apply. However, the simulation of a synthetic dataset and the training of the CNNs carry a high computational cost. With the aim to simplify this process, we propose to build a server-based database of pretrained CNN models that is accessed by the user via a web service directly from the data acquisition and analysis software. We demonstrate a working prototype comprised of a shared CNN database containing three material systems. By this, the microscope operator can determine the specimen thickness by PACBED within a few seconds in a reproducible way during a microscope session, without any prior knowledge about machine learning or multislice modeling. Furthermore, the service is integrated into other software and workflows through the API.

We propose algorithms based on an optimisation method for inverse multislice ptychography in, e.g. electron microscopy. The multislice method is widely used to model the interaction between relativistic electrons and thick specimens. Since only the intensity of diffraction patterns can be recorded, the challenge in applying inverse multislice ptychography is to uniquely reconstruct the electrostatic potential in each slice up to some ambiguities. In this conceptual study, we show that a unique separation of atomic layers for simulated data is possible when considering a low acceleration voltage. We also introduce an adaptation for estimating the illuminating probe. For the sake of practical application, we finally present slice reconstructions using experimental 4D scanning transmission electron microscopy (STEM) data.

We report on the automatic alignment of a transmission electron microscope equipped with an orbital angular momentum sorter using a convolutional neural network. The neural network is able to control all relevant parameters of both the electron-optical setup of the microscope and the external voltage source of the sorter without input from the user. It can compensate for mechanical and optical misalignments of the sorter, in order to optimize its spectral resolution. The alignment is completed over a few frames and can be kept stable by making use of the fast fitting time of the neural network.