Grace Dinh
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Research Interests
Grace Dinh has a total of 4 co-authors. Here are the top co-authors by number of shared publications:
- Charles Hong
UC Berkeley, United States of America
1 shared publication - Mahesh Subedar
Intel Labs, 2200 Mission College Blvd, Santa Clara, CA, USA
1 shared publication - Qijing Huang
NVIDIA Research, Berkeley, California, United States
1 shared publication - Yakun Sophia Shao
University of California, Berkeley, Berkeley, California, USA
1 shared publication
Latest Publications
- Open Access
- 28 October 2023
- Published by Association for Computing Machinery (ACM)
- p. 209-224
DOSA: Differentiable Model-Based One-Loop Search for DNN Accelerators
In the hardware design space exploration process, it is critical to optimize both hardware parameters and algorithm-to-hardware mappings. Previous work has largely approached this simultaneous optimization problem by separately exploring the hardware design space and the mapspace—both individually large and highly nonconvex spaces—independently. The resulting combinatorial explosion has created significant difficulties for optimizers. In this paper, we introduce DOSA, which consists of differentiable performance models and a gradient descent-based optimization technique to simultaneously explore both spaces and identify high-performing design points. Experimental results demonstrate that DOSA outperforms random search and Bayesian optimization by 2.80 × and 12.59 ×, respectively, in improving DNN model energy-delay product, given a similar number of samples. We also demonstrate the modularity and flexibility of DOSA by augmenting our analytical model with a learned model, allowing us to optimize buffer sizes and mappings of a real DNN accelerator and attain a 1.82 × improvement in energy-delay product.
- 28 October 2023
- Published by Association for Computing Machinery (ACM)
- p. 209-224
Open AccessDOSA: Differentiable Model-Based One-Loop Search for DNN Accelerators
In the hardware design space exploration process, it is critical to optimize both hardware parameters and algorithm-to-hardware mappings. Previous work has largely approached this simultaneous optimization problem by separately exploring the hardware design space and the mapspace—both individually large and highly nonconvex spaces—independently. The resulting combinatorial explosion has created significant difficulties for optimizers. In this paper, we introduce DOSA, which consists of differentiable performance models and a gradient descent-based optimization technique to simultaneously explore both spaces and identify high-performing design points. Experimental results demonstrate that DOSA outperforms random search and Bayesian optimization by 2.80 × and 12.59 ×, respectively, in improving DNN model energy-delay product, given a similar number of samples. We also demonstrate the modularity and flexibility of DOSA by augmenting our analytical model with a learned model, allowing us to optimize buffer sizes and mappings of a real DNN accelerator and attain a 1.82 × improvement in energy-delay product.