OPTIMIZING CNN-BIGRU PERFORMANCE: MISH ACTIVATION AND COMPARATIVE ANALYSIS WITH RELU
Author:
Preprint
- 1 January 2024
- preprint
- Published by Elsevier in SSRN Electronic Journal
Abstract
Deep learning is currently extensively employed across a range of research domains. The continuous advancements in deep learning techniques contribute to solving intricate challenges. Activation functions (AF) are fundamental components within neural networks, enabling them to capture complex patterns and relationships in the data. By introducing non-linearities, AF empowers neural networks to model and adapt to the diverse and nuanced nature of real-world data, enhancing their ability to make accurate predictions across various tasks. In the context of intrusion detection, the Mish, a recent AF, was implemented in the CNN-BiGRU model, using three datasets: ASNM-TUN, ASNM-CDX, and HOGZILLA. The comparison with Rectified Linear Unit (ReLU), a widely used AF, revealed that Mish outperforms ReLU, showcasing superior performance across the evaluated datasets. This study illuminates the effectiveness of AF in elevating the performance of intrusion detection systems.Keywords
This publication has 9 references indexed in Scilit:
- Contamination Detection Using a Deep Convolutional Neural Network with Safe Machine—Environment InteractionElectronics, 2023
- TGA: A Novel Network Intrusion Detection Method Based on TCN, BiGRU and Attention MechanismElectronics, 2023
- An Efficient Intrusion Detection System with Custom Features using FPA-Gradient Boost Machine Learning AlgorithmInternational journal of Computer Networks & Communications, 2022
- Investigative Study of the Effect of Various Activation Functions with Stacked Autoencoder for Dimension Reduction of NIDS using SVMInternational Journal of Advanced Computer Science and Applications, 2021
- Network Anomaly Detection based on Late Fusion of Several Machine Learning AlgorithmsInternational journal of Computer Networks & Communications, 2020
- Elastic exponential linear units for convolutional neural networksNeurocomputing, 2020
- Review and Comparison of Commonly Used Activation Functions for Deep Neural Networks2020
- ASNM Datasets: A Collection of Network Attacks for Testing of Adversarial Classifiers and Intrusion DetectorsIEEE Access, 2020
- Discovering New Cyber Protection Approaches from a Security Professional ProspectiveInternational journal of Computer Networks & Communications, 2017