MA-Opt: Reinforcement Learning-Based Analog Circuit Optimization Using Multi-Actors
- 23 February 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Circuits and Systems I: Regular Papers
- Vol. 71 (5) , 2045-2056
Abstract
There is a need for electronic design automation (EDA) tools for analog circuit design since analog circuit design requires substantial human effort and expertise. Using reinforcement learning (RL)-inspired methodologies, this study presents MA-Opt, an analog circuit optimizer. We propose MA-Opt to provide multiple predictions of optimized circuit designs through the use of multiple actors. Multiple actors can be exploited effectively by sharing a memory that affects the loss function of network training, resulting in an accelerated optimization of circuits. Furthermore, we introduce a cooperative near-sampling method deploying a synergistic effect and then optimizing the design. The efficiency of MA-Opt was demonstrated by simulating three analog circuits and comparing the results to other methods. In the experiment, the use of multiple actors with a shared elite solution set and the cooperative near-sampling method proved to be effective. MA-Opt achieved minimum target metrics up to 34 $\%$ better than DNN-Opt within the same number of simulations while satisfying all given constraints. Moreover, at identical runtime, MA-Opt exhibited better Figure of Merits (FoMs) in comparison to DNN-Opt.Keywords
Funding Information
- DRAM PIM Design Base Technology Development (2022-0-01172)
- Development of Memory Module and Memory Compiler for Non-Volatile PIM through the Institute of Information and Communications Technology Planning and Evaluation
- Korea government (RS-2023-00222085)
- Samsung
- IC Design Education Center
This publication has 22 references indexed in Scilit:
- Reinforcement Learning-based Analog Circuit Optimizer using gm/ID for Sizing2023
- Prioritized Reinforcement Learning for Analog Circuit Optimization With Design Knowledge2021
- Circuit Connectivity Inspired Neural Network for Analog Mixed-Signal Functional Modeling2021
- Local Bayesian Optimization For Analog Circuit Sizing2021
- DNN-Opt: An RL Inspired Optimization for Analog Circuit Sizing using Deep Neural Networks2021
- From Specification to Silicon: Towards Analog/Mixed-Signal Design Automation using Surrogate NN Models with Transfer Learning2021
- GCN-RL Circuit Designer: Transferable Transistor Sizing with Graph Neural Networks and Reinforcement Learning2020
- Multi-objective Bayesian Optimization for Analog/RF Circuit Synthesis2018
- IPRAIL—intellectual property reuse-based analog IC layout automationIntegration, 2003
- Analogue and Mixed-Signal Systems Topologies Exploration Using Symbolic MethodsAnalog Integrated Circuits and Signal Processing, 2002