Abstract
Network-on-Chip (NoC) is a scalable on-chip communication architecture widely used in neural network accelerators. However, data-intensive applications like machine learning place significant demands on the NoC’s communication and computation, and often have a degree of resilience to data noise, which allows to use approximation techniques to reduce execution time and energy consumption for both computation and communication, under the constraints of acceptable quality loss. Traditional approximate NoCs do not consider the data distribution characteristics of the neural networks, resulting in a lower approximate rate. Moreover, these schemes do not take the synergistic optimization of computation and communication, which limits reductions in execution time. In this paper, we propose a Fused Approximation Scheme of NoC (FAS-NoC) that incorporates the characteristics of data distribution in neural networks. FAS-NoC includes an approximate compression and recovery scheme based on data hierarchy, and uses a congestion-aware scheme to adjust the approximate rate of the node. Additionally, by leveraging the characteristics of recovered data after approximate communication, the scheme optimizes the design of computing units within the computing array. FAS-NoC collaboratively optimizes approximate communication and computation, organically integrating the two aspects. Compared with the state-of-the-art approximate framework ACDC (ACDC_ABDTR and ACDC_APPROX), the execution time of FAS-NoC is reduced by 48.94% and 47.72%, respectively. The experimental results show that the additional area overhead of the FAS-NoC only accounts for 0.81% of the original node, the additional power consumption overhead only accounts for 0.75% of the original node.
Funding Information
  • National Key Research and Development Program of China (2023YFB2806802, 2021YFB3600104)
  • National Natural Science Foundation of China (62104098)
  • National Natural Science Foundation of China (U21B2032)
  • Natural Science Foundation of Jiangsu Province for Youth (BK20210178)
  • Xiaomi Youth Scholar-Innovation and Technology Award