Abstract
To address the latency and energy bottlenecks caused by the physical separation of sensing and processing in conventional vision systems, we propose a novel in-sensor, in-memory architecture based on a fabricated monolithic 1D1R stack. The unit cell comprises a photodiode in series with a resistive random-access memory (RRAM) device, enabling computation at the point of capture. Organized into complementary crossbar arrays and driven by programmable peripheral units, this architecture supports image acquisition, temporal-difference motion extraction, spatial filtering, and morphological dilation directly within the sensor plane. System-level transient simulations using validated device models demonstrate the system’s robustness against non-idealities and its capability for dynamic exposure control via multi-state programming. Large-scale performance analyses validate the architecture’s efficiency, confirming that processing latency scales linearly with image height, independent of the width, across all operating modes. This capability yields processing speeds of approximately 336 frames per second for motion extraction and box-blur filtering. Furthermore, the system demonstrates energy consumption as low as 1.89 nJ per pixel for temporal differencing and 2.43 nJ per pixel for image capture. In-memory spatial filtering (box-blur) is achieved with high structural fidelity (SSIM > 0.97) at 3.13 nJ per pixel, while higher-level morphological dilation is executed at 3.22 nJ per pixel. Collectively, these performance metrics establish the proposed architecture as a versatile, reconfigurable, high-speed platform optimized for edge vision applications.

This publication has 38 references indexed in Scilit: