Chromatix: a differentiable, GPU-accelerated wave-optics library
Authors:
- Diptodip DebDDDiptodip Deb
- Gert-Jan BothGBGert-Jan Both
- Eric BezzamEBEric Bezzam
- Amit KohliAKAmit Kohli
- Siqi YangSYSiqi Yang
- Amey ChawareACAmey Chaware
- Cédric AllierCACédric Allier
- Changjia CaiCCChangjia Cai
- Geneva AnderbergGAGeneva Anderberg
- M. Hossein EybposhMEM. Hossein Eybposh
- Magdalena C. SchneiderMSMagdalena C. Schneider
- Rainer HeintzmannRainer Heintzmann
Preprint
Abstract
Modern microscopy methods incorporate computational modeling as an integral part of the imaging process, either to solve inverse problems or optimize the optical system design itself. These methods often depend on differentiable optics simulations, yet no standardized framework exists—forcing computational optics researchers to repeatedly and independently implement simulations with limited reusability and performance. These common problems limit the potential impact of computational optics as a field. Here we present Chromatix: an open-source, GPU-accelerated, differentiable wave optics simulation library. Chromatix builds on JAX to democratize fast, parallelized simulation of diverse optical systems and expand the design space in computational optics. Chromatix standardizes a growing collection of optical elements and propagation methods allowing a broad range of applications, which we demonstrate here for snapshot microscopy, holography, and phase retrieval. We demonstrate speed improvements of 2-6× on a single GPU and up to 22× on 8 GPUs.Keywords
Funding Information
- Howard Hughes Medical Institute
- German-Israeli Foundation for Scientific Research and Development (G-1566-413.13/2023)
- National Research Foundation of Korea (2023R1A2C3004040)
- the Ministry of Trade, Industry and Energy (MOTIE) and Korea Institute for Advancement of Technology
- Air Force Office of Scientific Research (FA955-22-1-0521)
- Chan Zuckerberg Initiative (2021-225666)
- Chan Zuckerberg Initiative (2023-321173)
- National Institutes of Health
- Chan Zuckerberg Initiative (2021-234544)
- Arnold and Mabel Beckman Foundation
- Alfred P. Sloan Foundation
- Kavli Innovation Grant
This publication has 54 references indexed in Scilit:
- Simultaneous orientation and 3D localization microscopy with a Vortex point spread functionNature Communications, 2021
- Miniscope3D: optimized single-shot miniature 3D fluorescence microscopyLight: Science & Applications, 2020
- Neuronal Dynamics Regulating Brain and Behavioral State TransitionsCell, 2019
- Temperature Rise under Two-Photon Optogenetic Brain StimulationCell Reports, 2018
- Three-dimensional scanless holographic optogenetics with temporal focusing (3D-SHOT)Nature Communications, 2017
- A convergent Born series for solving the inhomogeneous Helmholtz equation in arbitrarily large mediaJournal of Computational Physics, 2016
- A shared neural ensemble links distinct contextual memories encoded close in timeNature, 2016
- Modeling the Spatiotemporal Dynamics of Light and Heat Propagation for In Vivo OptogeneticsCell Reports, 2015
- Miniaturized integration of a fluorescence microscopeNature Methods, 2011
- Sub-diffraction-limit imaging by stochastic optical reconstruction microscopy (STORM)Nature Methods, 2006