Kyoungho Jeun
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Kyoungho Jeun has a total of 5 co-authors. Here are the top co-authors by number of shared publications:
- Eojin Lee
Inha University, Incheon, Republic of Korea
2 shared publications - Hyeonu Kim
Seoul National University, Seoul, Republic of Korea
2 shared publications - Seongmin Cho
Inha University, Incheon, Republic of Korea
1 shared publication - Seunghyuk Yu
Inha University, Incheon, Republic of Korea
1 shared publication - Sunyoung Hwang
Inha University, Incheon, Republic of Korea
1 shared publication
Latest Publications
- Open Access
- 17 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 49-62
ComPASS: A Compatible PIM Protocol Architecture and Scheduling Solution for Processor-PIM Collaboration
- 17 October 2025
- Published by Association for Computing Machinery (ACM)
- p. 49-62
Open AccessComPASS: A Compatible PIM Protocol Architecture and Scheduling Solution for Processor-PIM Collaboration
- 2 May 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Computer Architecture Letters
- Vol. 24 (1) , 185-188
Fold-PIM: A Cost-Efficient LPDDR5-Based PIM for On-Device SLMs
The increasing demand for on-device AI applications has shifted focus to Small Language Models (SLMs) optimized for mobile environments. However, the limited memory bandwidth of LPDDR5-based systems presents significant challenges for efficiently executing memory-bound matrix-vector multiplication operations, a core component of SLM inference. In this paper, we propose Fold-PIM, an LPDDR5-based Processing-in-Memory (PIM) architecture designed to address these challenges. FoldPIM features a shared PU architecture that leverages subarray level parallelism while maintaining cost efficiency. Additionally, we introduce key techniques, including adaptive tiling for efficient GEMV operations across diverse matrix sizes, a transposed data layout to minimize buffer overhead, and a tailored protocol to reduce vector replacement latency. Our evaluation results demonstrate that Fold-PIM achieves up to 3.9× speedup of token generation time in SLM inference compared to the baseline system without PIM.
- 2 May 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Computer Architecture Letters
- Vol. 24 (1) , 185-188
Fold-PIM: A Cost-Efficient LPDDR5-Based PIM for On-Device SLMs
The increasing demand for on-device AI applications has shifted focus to Small Language Models (SLMs) optimized for mobile environments. However, the limited memory bandwidth of LPDDR5-based systems presents significant challenges for efficiently executing memory-bound matrix-vector multiplication operations, a core component of SLM inference. In this paper, we propose Fold-PIM, an LPDDR5-based Processing-in-Memory (PIM) architecture designed to address these challenges. FoldPIM features a shared PU architecture that leverages subarray level parallelism while maintaining cost efficiency. Additionally, we introduce key techniques, including adaptive tiling for efficient GEMV operations across diverse matrix sizes, a transposed data layout to minimize buffer overhead, and a tailored protocol to reduce vector replacement latency. Our evaluation results demonstrate that Fold-PIM achieves up to 3.9× speedup of token generation time in SLM inference compared to the baseline system without PIM.