Sinusoidal Sampling Enhanced Compressive Camera for High Speed Imaging
- 10 October 2019
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 43 (4) , 1380-1393
Abstract
Compressive sensing technique allows capturing fast phenomena at a much higher frame rate than the camera sensor, by recovering a frame sequence from their encoded combination. However, most conventional compressive video sensing methods limit the achieved frame rate improvement to tenfold and only support low resolution recovery. Making use of the camera's redundant spatial resolution for further frame rate improve, here we report a novel compressive video acquisition technique termed Sinusoidal Sampling Enhanced Compressive Camera (S2EC2) to encode denser frames within a snapshot. Specifically, we decompose the dense frames into groups and apply combinational coding: random codes within each group for compressive acquisition; group specific sinusoidal codes to multiplex different groups onto the high resolution sensor. The sinusoidal codes designed for these groups would shift their frequency components by different offsets in the Fourier domain and staggered the dominant frequencies of the coded measurements of these groups. Correspondingly, the reconstruction successfully separate coded measurements of different groups and recovers frames within each group. Besides, we also solve the implementation problem of insufficient gray scale spatial light modulation speed, and build a prototype achieving 2000 fps reconstruction with a 15.6 fps camera (the actual compression ratio is 0.009). The extensive experiments validate the proposed approach.Keywords
Funding Information
- National Natural Science Foundation of China (61722110, 61631009, 61627804)
This publication has 36 references indexed in Scilit:
- Wide-field, high-resolution Fourier ptychographic microscopyNature Photonics, 2013
- Efficient Space-Time Sampling with Pixel-Wise Coded Exposure for High-Speed ImagingIEEE Transactions on Pattern Analysis and Machine Intelligence, 2013
- Coded aperture compressive temporal imagingOptics Express, 2013
- An Overview of Computational Sparse Models and Their Applications in Artificial Intelligence2013
- On Plenoptic Multiplexing and ReconstructionInternational Journal of Computer Vision, 2012
- Structured illumination microscopy using unknown speckle patternsNature Photonics, 2012
- Distributed Optimization and Statistical Learning via the Alternating Direction Method of MultipliersFoundations and Trends in Machine Learning, 2011
- VSUMM: A mechanism designed to produce static video summaries and a novel evaluation methodPattern Recognition Letters, 2011
- Dappled photographyACM Transactions on Graphics, 2007
- Coded exposure photographyACM Transactions on Graphics, 2006