FYFan Yang

Fan Yang

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article


Fan Yang has a total of 13 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    PIMFuse: Kernel Fusion for Processing-in-Memory

    by Fan Yang, Zhe Zhou, Yusen Li, Amelie Chi Zhou, Guangyu Sun, Gang Wang, Xiaoguang Liu, Ming-Chang Yang

    Recent studies have demonstrated that processing-in-memory (PIM) can significantly accelerate memory-intensive applications across various domains. However, based on our experiments, we discover that PIM kernels in applications inherently have diverse resource requirements. To meet these resource requirements and fully utilize PIM resources, we first attempt to introduce the kernel fusion method to fuse PIM kernels with complementary resource requirements during the execution of multiple kernels. Based on our detailed study about PIM kernel fusion, we also reveal that both the kernel fusion combination and the thread allocation schemes during kernel fusion significantly impact overall performance. To determine the kernel fusion combination and thread allocation schemes that approach optimal performance, we propose PIMFuse, a framework leveraging kernel fusion to execute multiple PIM kernels. PIMFuse relies on accurate PIM kernel duration prediction models and fusion models to efficiently execute PIM kernels. Our experiments on real PIM devices show that PIMFuse reduces kernel execution time by up to 26.63% and on average by 15.51% compared to the baseline, and PIMFuse can be integrated with existing complex PIM applications to improve their performance. PIMFuse is publicly available at https://github.com/FanYang98/PIMFuse


  • Open Access

    Pac-PIM: A Parallel Communication Framework for Commodity Processing-in-memory Systems

    by Fan Yang, Zhe Zhou, Cong Li, Tsung-Yi Ho, Ming-Chang Yang

    Processing-in-memory (PIM) is a promising paradigm to effectively alleviate the bottleneck of memory access for memory-intensive applications. UPMEM PIM-enabled DIMMs, the first commercially available PIM platform integrating processing elements (PEs) in DIMMs, exemplifies this trend. However, the communication overhead between the host and PIM-enabled DIMMs remains significant. Although previous studies have attempted to reduce this overhead between the host and PIM-enabled DIMMs, our detailed investigation reveals that, from the software perspective, the native communication framework fails to fully leverage its parallelism for communication. We propose to combine rank-level parallelism and process-level parallelism in the layered fashion to take advantage of these and avoid their respective drawbacks. And we revamp the native communication framework by integrating this combination to introduce Pac-PIM ( Pa rallel C ommunication Framework for PIM ). Our evaluation, conducted using real UPMEM PIM-enabled DIMMs and representative PIM-enabled applications, shows that Pac-PIM significantly improves communication performance in all scenarios, with an average speedup of 1.53× compared to the native communication framework with excellent scalability. In addition, Pac-PIM can further improve communication performance along with other optimizations.


  • Open Access

    PIM-DL: Expanding the Applicability of Commodity DRAM-PIMs for Deep Learning via Algorithm-System Co-Optimization

    by Cong Li, Zhe Zhou, Yang Wang, Fan Yang, Ting Cao, Mao Yang, Yun Liang, Guangyu Sun

    DRAM-based processing-in-memory (DRAM-PIM) has gained commercial prominence in recent years. However, their integration for deep learning acceleration poses inherent challenges. Existing DRAM-PIMs are limited in computational capabilities, primarily applicable for element-wise and GEMV operators. Unfortunately, these operators contribute only a small portion of the execution time in most DNN workloads. Current systems still necessitate powerful hosts to handle a significant portion of compute-heavy operators. To expand the applicability of commodity DRAM-PIMs in accelerating deep learning, we introduce a novel PIM-DL framework. The philosophy behind PIM-DL is to replace the compute-heavy GEMM operations in linear layers with Lookup-Tables (LUTs). Such LUT-based neural networks (LUT-NNs) substantially reduce multiplications in DNN inference, rendering them suitable for efficient execution on DRAM-PIMs. To accurately convert DNNs into LUT-NNs and achieve optimal inference serving performance, we first introduce an enhanced LUT-NN (eLUT-NN) algorithm for model calibration, then we propose an Auto-Tuner capable of optimizing the mapping parameters on diverse DRAM-PIM platforms. We evaluate PIM-DL on off-the-shelf UPMEM PIM-DIMM products and simulated HBM-PIM/AiM platforms across multiple contemporary DNN workloads. Compared with GEMM-based inference on DRAM-PIMs, PIM-DL achieves 22.6×~37.1× speedup. Compared with CPU/GPU-based inference, PIM-DL achieves up to 3.54×/1.20× speedup.