Bharathwaj Suresh
Research Interests
Bharathwaj Suresh has a total of 4 co-authors. Here are the top co-authors by number of shared publications:
- Avishaii Abuhatzera
Corporate Strategy Office, Intel, Haifa 3508409, Israel
1 shared publication - Gurpreet Singh Kalsi
Processor Architecture Research Lab, Intel Labs
1 shared publication - Kamlesh Pillai
Intel Labs, USA
1 shared publication - Sreenivas Subramoney
Intel, Bengaluru, India
1 shared publication
Latest Publications
- Open Access
- 4 December 2021
- Published by MDPI AG in Mathematics
- Vol. 9 (23) , 3130
Early Prediction of DNN Activation Using Hierarchical Computations
Deep Neural Networks (DNNs) have set state-of-the-art performance numbers in diverse fields of electronics (computer vision, voice recognition), biology, bioinformatics, etc. However, the process of learning (training) from the data and application of the learnt information (inference) process requires huge computational resources. Approximate computing is a common method to reduce computation cost, but it introduces loss in task accuracy, which limits their application. Using an inherent property of Rectified Linear Unit (ReLU), a popular activation function, we propose a mathematical model to perform MAC operation using reduced precision for predicting negative values early. We also propose a method to perform hierarchical computation to achieve the same results as IEEE754 full precision compute. Applying this method on ResNet50 and VGG16 shows that up to 80% of ReLU zeros (which is 50% of all ReLU outputs) can be predicted and detected early by using just 3 out of 23 mantissa bits. This method is equally applicable to other floating-point representations.
- 4 December 2021
- Published by MDPI AG in Mathematics
- Vol. 9 (23) , 3130
Open AccessEarly Prediction of DNN Activation Using Hierarchical Computations
Deep Neural Networks (DNNs) have set state-of-the-art performance numbers in diverse fields of electronics (computer vision, voice recognition), biology, bioinformatics, etc. However, the process of learning (training) from the data and application of the learnt information (inference) process requires huge computational resources. Approximate computing is a common method to reduce computation cost, but it introduces loss in task accuracy, which limits their application. Using an inherent property of Rectified Linear Unit (ReLU), a popular activation function, we propose a mathematical model to perform MAC operation using reduced precision for predicting negative values early. We also propose a method to perform hierarchical computation to achieve the same results as IEEE754 full precision compute. Applying this method on ResNet50 and VGG16 shows that up to 80% of ReLU zeros (which is 50% of all ReLU outputs) can be predicted and detected early by using just 3 out of 23 mantissa bits. This method is equally applicable to other floating-point representations.