Effect of Architecture and Inference Parameters of Artificial Neural Network Models in the Detection Task on Energy Demand
Open Access
Abstract
Artificial neural network models for the task of detection are used in many fields and find various applications. Models of this kind require adequate computational resources and thus require adequate energy expenditure. The increase in the number of parameters, the complexity of architectures, and the need to process large data sets significantly increase energy consumption, which is becoming a key sustainability challenge. Optimization of computing and the development of energy-efficient hardware technologies are essential to reduce the energy footprint of these models. This article examines the effect of the type of model, as well as its parameters, on energy consumption during inference. For this purpose, sensors built into the graphics card were used, and software was developed to measure the energy demand of the graphics card for different architectures of YOLO models (v8, v9, v10), as well as for different batch and model sizes. This study showed that the increase in energy demand is not linearly dependent on batch size. After a certain level of batch size, the energy demand begins to decrease. This dependence does not occur only for n/t size models. Optimum utilization of computing power due to the number of processed images for the studied models occurs at the maximum studied batch size. In addition, tests were conducted on an embedded device.Keywords
This publication has 37 references indexed in Scilit:
- Field-based multispecies weed and crop detection using ground robots and advanced YOLO models: A data and model-centric approachSmart Agricultural Technology, 2024
- A new lightweight network for efficient UAV object detectionScientific Reports, 2024
- Statistical Analysis of Design Aspects of Various YOLO-Based Deep Learning Models for Object DetectionInternational Journal of Computational Intelligence Systems, 2023
- Multi-Class Retinal Diseases Detection Using Deep CNN With Minimal Memory ConsumptionIEEE Access, 2023
- An Enhanced YOLOv4 Model With Self-Dependent Attentive Fusion and Component Randomized Mosaic Augmentation for Metal Surface Defect DetectionIEEE Access, 2022
- Optimized convolution neural network based multiple eye disease detectionComputers in Biology and Medicine, 2022
- Classification of COVID-19 in chest X-ray images using DeTraC deep convolutional neural networkApplied Intelligence, 2020
- Thermal Object Detection in Difficult Weather Conditions Using YOLOIEEE Access, 2020
- A Fully-Autonomous Aerial Robot for Search and Rescue Applications in Indoor Environments using Learning-Based TechniquesJournal of Intelligent & Robotic Systems, 2018
- A survey on deep learning in medical image analysisMedical Image Analysis, 2017