Adaptive Pruning of Deep Neural Networks for Resource-Aware Embedded Intrusion Detection on the Edge
Preprint
Abstract
Artificial neural network pruning is a method in which artificial neural network sizes can be reduced while attempting to preserve the predicting capabilities of the network. This is done to make the model smaller or faster during inference time. In this work we analyze the ability of a selection of artificial neural network pruning methods to generalize to a new cybersecurity dataset utilizing a simpler network type than was designed for. We analyze each method using a variety of pruning degrees to best understand how each algorithm responds to the new environment. This has allowed us to determine the most well fit pruning method of those we searched for the task. Unexpectedly, we have found that many of them do not generalize to the problem well, leaving only a few algorithms working to an acceptable degree.Keywords
All Related Versions
This publication has 6 references indexed in Scilit:
- Structured Pruning for Deep Convolutional Neural Networks: A SurveyIEEE Transactions on Pattern Analysis and Machine Intelligence, 2023
- DAIS: Automatic Channel Pruning via Differentiable Annealing Indicator SearchIEEE Transactions on Neural Networks and Learning Systems, 2022
- DNN compression by ADMM-based joint pruningKnowledge-Based Systems, 2022
- BERT-of-Theseus: Compressing BERT by Progressive Module Replacing2020
- Kitsune: An Ensemble of Autoencoders for Online Network Intrusion Detection2018
- An introduction to computing with neural netsACM SIGARCH Computer Architecture News, 1988