An SMT-Based Approach for Verifying Binarized Neural Networks
Preprint
Abstract
Deep learning has emerged as an effective approach for creating modern software systems, with neural networks often surpassing hand-crafted systems. Unfortunately, neural networks are known to suffer from various safety and security issues. Formal verification is a promising avenue for tackling this difficulty, by formally certifying that networks are correct. We propose an SMT-based technique for verifying Binarized Neural Networks - a popular kind of neural network, where some weights have been binarized in order to render the neural network more memory and energy efficient, and quicker to evaluate. One novelty of our technique is that it allows the verification of neural networks that include both binarized and non-binarized components. Neural network verification is computationally very difficult, and so we propose here various optimizations, integrated into our SMT procedure as deduction steps, as well as an approach for parallelizing verification queries. We implement our technique as an extension to the Marabou framework, and use it to evaluate the approach on popular binarized neural network architectures.Keywords
All Related Versions
This publication has 8 references indexed in Scilit:
- Global optimization of objective functions represented by ReLU networksMachine Learning, 2021
- Reluplex: a calculus for reasoning about deep neural networksFormal Methods in System Design, 2021
- Scalable Verification of Quantized Neural NetworksProceedings of the AAAI Conference on Artificial Intelligence, 2021
- Binarized Neural Architecture Search for Efficient Object RecognitionInternational Journal of Computer Vision, 2020
- Larq: An Open-Source Library for Training Binarized Neural NetworksJournal of Open Source Software, 2020
- Verification of Binarized Neural Networks via Inter-neuron Factoring2018
- Verifying Properties of Binarized Deep Neural NetworksProceedings of the AAAI Conference on Artificial Intelligence, 2018
- Adaptive Quantization for Deep Neural NetworkProceedings of the AAAI Conference on Artificial Intelligence, 2018