Ghangmin Yun
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Ghangmin Yun has a total of 10 co-authors. Here are the top co-authors by number of shared publications:
- Jueun Jung
Yonsei University
4 shared publications - Kyuho Jason Lee
Yonsei University
4 shared publications - Bokyoung Seo
Ulsan National Institute of Science and Technology
3 shared publications - Junghyun Yoo
Yonsei University
3 shared publications - Seungbin Kim
Ulsan National Institute of Science and Technology
2 shared publications Chaeyoon Kim
Yonsei University
1 shared publication
Latest Publications
- Open Access
- 5 August 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-7
HotBa: A Heterogeneous Mamba Accelerator with Δ-Guided Early Rejection for Speculative Decoding
Mamba has emerged as a promising alternative to Transformers for on-device LLM inference, offering linear complexity and eliminating KV-cache. However, autoregressive decoding reloads full model weights every token, accounting for 93.2% of total inference energy, with no existing accelerator resolving this overhead. We present HotBa, a heterogeneous Mamba accelerator that reduces per-token weight transfer by 82% and redundant computation by 59% via Δ-guided early rejection for wide-tree speculative decoding in Mamba, while a heterogeneous INT8/FP16 core and tree management unit achieve 40.4× area efficiency and 5.18× SSM speedup with 0.4% area overhead. Synthesized in 28nm CMOS, HotBa achieves 75.32 tokens/s with 1.65× speedup and 7.55× energy efficiency over the state-of-the-art Mamba accelerator.
- 5 August 2026
- Published by Association for Computing Machinery (ACM)
- p. 1-7
Open AccessHotBa: A Heterogeneous Mamba Accelerator with Δ-Guided Early Rejection for Speculative Decoding
Mamba has emerged as a promising alternative to Transformers for on-device LLM inference, offering linear complexity and eliminating KV-cache. However, autoregressive decoding reloads full model weights every token, accounting for 93.2% of total inference energy, with no existing accelerator resolving this overhead. We present HotBa, a heterogeneous Mamba accelerator that reduces per-token weight transfer by 82% and redundant computation by 59% via Δ-guided early rejection for wide-tree speculative decoding in Mamba, while a heterogeneous INT8/FP16 core and tree management unit achieve 40.4× area efficiency and 5.18× SSM speedup with 0.4% area overhead. Synthesized in 28nm CMOS, HotBa achieves 75.32 tokens/s with 1.65× speedup and 7.55× energy efficiency over the state-of-the-art Mamba accelerator.