A New NN-Based Approach to In-Sensor PDM-to-PCM Conversion for Ultra TinyML KWS
Open Access
- 23 November 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems II: Express Briefs
- Vol. 70 (4) , 1595-1599
Abstract
This brief proposes a new approach based on a tiny neural network to convert Pulse Density Modulation (PDM) signals acquired from digital Micro-Electro-Mechanical System (MEMS) microphones into the standard Pulse Code Modulation (PCM) format for any further digital audio processing. The proposed approach allows for a compact and ultra-low-power hardware implementation of the conversion, suitable for ultra tinyML Key Word Spotting (KWS) applications, closely coupled with the sensor itself and tightly coupled with a neural network classifier. The converter achieves a signal-to-noise ratio value of 48 dB, which enables KWS accuracy of 89% over 12 classes. Implementation on a Xilinx Artix-7 FPGA results in 917 LUTs, 361 FFs, and 182 $\mu \text{W}$ Dynamic Power (DynP) consumption. By targeting the TSMC 0.13 $\mu \text{m}$ CMOS technology, the synthesis reports an area occupation of 0.086 mm2 and a DynP of 128.7 $\mu \text{W}$ /MHz. These results enable the integration of the proposed design into the CMOS circuitry closely coupled with the MEMS microphone.Keywords
This publication has 18 references indexed in Scilit:
- A Partially Binarized Hybrid Neural Network System for Low-Power and Resource Constrained Human Activity RecognitionIEEE Transactions on Circuits and Systems I: Regular Papers, 2020
- Low-Power HWAccelerator for AI Edge-Computing in Human Activity Recognition Systems2020
- Design Exploration and Performance Strategies towards Power-Efficient FPGA-Based Architectures for Sound Source LocalizationJournal of Sensors, 2019
- Deep Learning With Edge Computing: A ReviewProceedings of the IEEE, 2019
- Speech Recognition Using Deep Neural Networks: A Systematic ReviewIEEE Access, 2019
- FPGA optimization of convolution-based 2D filtering processor for image processing2016
- Design and implementation of telescopic OTA in 8 bit second-order continuous-time band-pass Sigma-Delta ADC2014
- Design of FIR Digital Filters Using ADALINE Neural Network2012
- A digital microphone array for distant speech recognition2010
- An economical class of digital filters for decimation and interpolationIEEE Transactions on Acoustics, Speech, and Signal Processing, 1981