Abstract
This work introduces Weak-MAC (WeMAC), a precision scaling strategy for fixed point Multiply&Accumulate operations. By leveraging an algorithmic relaxation of multiplication, it improves the efficiency of deep convolutional neural networks. WeMAC can be run on a software-programmable 8-bit MAC unit and is retraining free, namely, it makes ConvNet achieving reasonable inference accuracy even without retraining. Simulation results conducted on three ConvNets trained over well recognized data-set (SVHN, CIFAR-10 and CIFAR-100) demonstrate WeMAC enables new Pareto points in the energy-accuracy tradeoff of HW accelerators. With 25% more energy efficiency w.r.t. full precision, WeMAC represents a middle way between the low energy consumption of 8-bit arithmetic and the high accuracy of 16-bit arithmetic.