Data reduction for serial crystallography using a robust peak finder
Authors:
- Marjan Hadian-JaziMHMarjan Hadian-Jazi
- Alireza SadriASAlireza Sadri
- Anton BartyABAnton Barty
- Oleksandr YefanovOYOleksandr Yefanov
- Marina GalchenkovaMGMarina Galchenkova
- Dominik OberthuerDODominik Oberthuer
- Dana KomadinaDKDana Komadina
- Wolfgang BrehmWBWolfgang Brehm
- Henry KirkwoodHKHenry Kirkwood
- Grant MillsGMGrant Mills
- Raphael de WijnRWRaphael de Wijn
- Romain LetrunRLRomain Letrun
Open Access
- 13 September 2021
- journal article
- research article
- Published by International Union of Crystallography (IUCr) in Journal of Applied Crystallography
- Vol. 54 (5) , 1360-1378
Abstract
A peak-finding algorithm for serial crystallography (SX) data analysis based on the principle of `robust statistics' has been developed. Methods which are statistically robust are generally more insensitive to any departures from model assumptions and are particularly effective when analysing mixtures of probability distributions. For example, these methods enable the discretization of data into a group comprising inliers (i.e. the background noise) and another group comprising outliers (i.e. Bragg peaks). Our robust statistics algorithm has two key advantages, which are demonstrated through testing using multiple SX data sets. First, it is relatively insensitive to the exact value of the input parameters and hence requires minimal optimization. This is critical for the algorithm to be able to run unsupervised, allowing for automated selection or `vetoing' of SX diffraction data. Secondly, the processing of individual diffraction patterns can be easily parallelized. This means that it can analyse data from multiple detector modules simultaneously, making it ideally suited to real-time data processing. These characteristics mean that the robust peak finder (RPF) algorithm will be particularly beneficial for the new class of MHz X-ray free-electron laser sources, which generate large amounts of data in a short period of time.Keywords
Funding Information
- Australian Research Council, Centre of Excellence in Advanced Molecular Imaging (CE140100011)
- Australian Nuclear Science and Technology Organisation
- Helmholtz Association
This publication has 37 references indexed in Scilit:
- CASS—CFEL-ASG software suiteComputer Physics Communications, 2012
- The Coherent X-ray Imaging Data BankNature Methods, 2012
- CrystFEL: a software suite for snapshot serial crystallographyJournal of Applied Crystallography, 2012
- Femtosecond X-ray protein nanocrystallographyNature, 2011
- The PILATUS 1M detectorJournal of Synchrotron Radiation, 2006
- Announcing the worldwide Protein Data BankNature Structural & Molecular Biology, 2003
- Mean shift: a robust approach toward feature space analysisIEEE Transactions on Pattern Analysis and Machine Intelligence, 2002
- TheComputational Crystallography Toolbox: crystallographic algorithms in a reusable software frameworkJournal of Applied Crystallography, 2002
- Robust segmentation of visual data using ranked unbiased scale estimateRobotica, 1999
- Integration of single-crystal reflections using area multidetectorsJournal of Applied Crystallography, 1988