Efficient Resource-Aware Neural Architecture Search with a Neuro-Symbolic Approach
- 18 December 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 7700, 171-178
Abstract
Hardware-aware Neural Architectural Search (NAS) is gaining momentum to enable the deployment of deep learning on edge devices with limited computing capabilities. Incorporating device-related objectives such as affordable floating point operations, latency, power, memory usage, etc. into the optimization process makes searching for the most efficient neural architecture more complicated, since both model accuracy and hardware cost should guide the search. The main concern with most state-of-the-art hardware-aware NAS strategies is that they propose for evaluation also trivially infeasible network models for the capabilities of the hardware platform at hand. Moreover, previously generated models are frequently not exploited to intelligently generate new ones, leading to prohibitive computational costs for practical relevance. This paper aims to boost the computational efficiency of hardware-aware NAS by means of a neuro-symbolic framework revolving around a Probabilistic Inductive Logic Programming module to define and exploit a set of symbolic rules. This component learns and refines the probabilities associated with the rules, allowing the framework to adapt and improve over time, thus quickly narrowing down the search space toward the most promising neural architectures.Keywords
This publication has 20 references indexed in Scilit:
- Symbolic DNN-Tuner: A Python and ProbLog-based system for optimizing Deep Neural Networks hyperparametersSoftwareX, 2022
- DANCE: Differentiable Accelerator/Network Co-Exploration2021
- Symbolic DNN-TunerMachine Learning, 2021
- Single Path One-Shot Neural Architecture Search with Uniform Sampling2020
- FBNet: Hardware-Aware Efficient ConvNet Design via Differentiable Neural Architecture Search2019
- MnasNet: Platform-Aware Neural Architecture Search for Mobile2019
- Neural Architecture Search2019
- DPP-Net: Device-Aware Progressive Search for Pareto-Optimal Neural Architectures2018
- Neural Networks: Tricks of the Trade2012
- Learning the Parameters of Probabilistic Logic Programs from Interpretations2011