VLSI Design of Light-Field Factorization for Dual-Layer Factored Display
- 24 June 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Very Large Scale Integration (VLSI) Systems
- Vol. 32 (11) , 2093-2106
Abstract
This article introduces a VLSI design for light-field factorization, aimed at enhancing immersive 3-D visual experiences for computational light-field factored displays. The main design challenges are intensive memory-access demands and high computational complexity. Accordingly, we first propose half-block-based factorization (HBBF) and sparse ray sampling (SRS) to reduce DRAM bandwidth by 99% and SRAM size by 74%. Then, we devise integer hybrid quantization (INTH) to cut down computational logic by 41%, leading to improvements in die area and power efficiency. Finally, we fabricated a processor chip that incorporates 75.1 kB of SRAM and 5.9M logic gates using 40-nm CMOS technology. It can operate with three different performance modes: high quality (56.9 MPixel/s at 971 mW), balanced (62.5 MPixel/s at 442 mW), and low power (61.7 MPixel/s at 283 mW). Across these modes, its normalized energy ranges between 4.4 and 16.2 nJ/pixel. This implementation surpasses existing GPU platforms and offers an $85\times $ increase in processing speed and a $311\times $ reduction in power consumption. We also showcase a real-time computational 3-D display system with this chip, demonstrating its practical efficacy in computational 3-D display technology.
Keywords
Funding Information
- Raydium Semiconductor Corporation, Hsinchu, Taiwan
- Ministry of Science and Technology, Taiwan (MOST 109-2622-8-007-022)
This publication has 46 references indexed in Scilit:
- Three-dimensional light field fusion display system and coding scheme for extending depth of fieldOptics and Lasers in Engineering, 2023
- Render‐based factorization for additive light field displayComputer Animation and Virtual Worlds, 2021
- A 3-D Display Pipeline from Coded-Aperture Camera to Tensor Light-Field Display Through CNN2019
- A Dataset and Evaluation Methodology for Depth Estimation on 4D Light Fields2017
- Factored Displays: Improving resolution, dynamic range, color reproduction, and light field characteristics with advanced signal processingIEEE Signal Processing Magazine, 2016
- Polarizer Parallax Barrier 3D Display With High Brightness, Resolution and Low CrosstalkJournal of Display Technology, 2013
- Algorithms for nonnegative matrix and tensor factorizations: a unified view based on block coordinate descent frameworkJournal of Global Optimization, 2013
- Algorithms and applications for approximate nonnegative matrix factorizationComputational Statistics & Data Analysis, 2007
- Auto‐stereoscopic 60 view 3D using slanted lenticular lens arraysJournal of Information Display, 2007
- Three-Dimensional Image Sensing, Visualization, and Processing Using Integral ImagingProceedings of the IEEE, 2006