New Python-based methods for data processing
Open Access
- 18 June 2013
- journal article
- research article
- Published by International Union of Crystallography (IUCr) in Acta Crystallographica Section D Structural Biology
- Vol. 69 (7) , 1274-1282
Abstract
Current pixel-array detectors produce diffraction images at extreme data rates (of up to 2 TB h−1) that make severe demands on computational resources. New multiprocessing frameworks are required to achieve rapid data analysis, as it is important to be able to inspect the data quickly in order to guide the experiment in real time. By utilizing readily available web-serving tools that interact with the Python scripting language, it was possible to implement a high-throughput Bragg-spot analyzer (cctbx.spotfinder) that is presently in use at numerous synchrotron-radiation beamlines. Similarly, Python interoperability enabled the production of a new data-reduction package (cctbx.xfel) for serial femtosecond crystallography experiments at the Linac Coherent Light Source (LCLS). Future data-reduction efforts will need to focus on specialized problems such as the treatment of diffraction spots on interleaved lattices arising from multi-crystal specimens. In these challenging cases, accurate modeling of close-lying Bragg spots could benefit from the high-performance computing capabilities of graphics-processing units.Keywords
This publication has 52 references indexed in Scilit:
- Self-terminating diffraction gates femtosecond X-ray nanocrystallography measurementsNature Photonics, 2011
- Femtosecond X-ray protein nanocrystallographyNature, 2011
- High-speed crystal detection and characterization using a fast-readout detectorActa Crystallographica Section D Structural Biology, 2010
- Diffraction cartography: applying microbeams to macromolecular crystallography sample evaluation and data collectionActa Crystallographica Section D Structural Biology, 2010
- The Coherent X-ray Imaging (CXI) instrument at the Linac Coherent Light Source (LCLS)New Journal of Physics, 2010
- PHENIX: a comprehensive Python-based system for macromolecular structure solutionActa Crystallographica Section D Structural Biology, 2010
- Rastering strategy for screening and centring of microcrystal samples of human membrane proteins with a sub-10 µm size X-ray synchrotron beamJournal of The Royal Society Interface, 2009
- Untangle, a tool for filtering overlapping diffraction patterns from multicrystalsActa Crystallographica Section D Structural Biology, 2004
- An optimal algorithm for approximate nearest neighbor searching fixed dimensionsJournal of the ACM, 1998
- An Integration Routine Based on Profile Fitting with Optimized Fitting Area for the Evaluation of Weak and/or Overlapped Two-Dimensional Laue or Monochromatic PatternsJournal of Applied Crystallography, 1998