Effect of neural network structure in accelerating performance and accuracy of a convolutional neural network with GPU/TPU for image analytics
Open Access
- 3 March 2022
- journal article
- research article
- Published by PeerJ in PeerJ Computer Science
- Vol. 8, e909
Abstract
Background: In deep learning the most significant breakthrough in the field of image recognition, object detection language processing was done by Convolutional Neural Network (CNN). Rapid growth in data and neural networks the performance of the DNN algorithms depends on the computation power and the storage capacity of the devices. Methods: In this paper, the convolutional neural network used for various image applications was studied and its acceleration in the various platforms like CPU, GPU, TPU was done. The neural network structure and the computing power and characteristics of the GPU, TPU was analyzed and summarized, the effect of these on accelerating the tasks is also explained. Cross-platform comparison of the CNN was done using three image applications the face mask detection (object detection/Computer Vision), Virus Detection in Plants (Image Classification: agriculture sector), and Pneumonia detection from X-ray Images (Image Classification/medical field). Results: The CNN implementation was done and a comprehensive comparison was done on the platforms to identify the performance, throughput, bottlenecks, and training time. The CNN layer-wise execution in GPU and TPU is explained with layer-wise analysis. The impact of the fully connected layer and convolutional layer on the network is analyzed. The challenges faced during the acceleration process were discussed and future works are identified.Keywords
This publication has 27 references indexed in Scilit:
- Performance analysis of CNN frameworks for GPUs2017
- Can FPGAs Beat GPUs in Accelerating Next-Generation Deep Neural Networks?2017
- Benchmarking State-of-the-Art Deep Learning Software Tools2016
- vDNN: Virtualized deep neural networks for scalable, memory-efficient neural network design2016
- Deep Residual Learning for Image Recognition2016
- Going deeper with convolutions2015
- Visualizing and Understanding Convolutional Networks2014
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998
- Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in positionBiological Cybernetics, 1980
- Receptive fields, binocular interaction and functional architecture in the cat's visual cortexThe Journal of Physiology, 1962