Overhead Prediction for PIM-Enabled Applications with Performance-Aware Behaviour Models
Authors:
- 8 October 2025
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-8
Abstract
Today’s processing-in-memory (PIM) devices, such as UPMEM PIM, behave like computational offloading engines: applications must explicitly allocate memory ranks, upload PIM kernels, transfer data and control commands, launch kernels, and read back output data. Past research has focused on identifying offloading candidates and predicting the performance of corresponding PIM kernels. However, this is only half the truth: PIM management and data transfer overheads can easily jeopardize kernel-level performance gains, and thus must be taken into account by scheduling algorithms. These overheads, incurred as part of software development kit (SDK) operations, are application- and workload-dependent: workload partitioning (i.e., the amount and size of data transfers) often depends on workload size and resource allocation. Hence, PIM performance models must account for PIM SDK operations in addition to kernel execution, requiring time-intensive, application-specific benchmarks that must be repeated for each SDK release or workload change. We present a more efficient performance modelling approach based on behaviour models. We train a behaviour model that predicts an application’s PIM SDK operations for arbitrary workloads and resource allocations, and combine it with application-independent performance models for these operations. Thus, each application must be profiled only once, and profiling does not rely on availability of PIM modules or cycle-accurate simulation. We evaluate a proof-of-concept implementation of our approach on twelve UPMEM PIM applications, and show that it can predict application-specific PIM overheads from simulation traces with an error of less than 25 % in nine cases, and no more than 10 % in six cases.Keywords
Funding Information
- Deutsche Forschungsgemeinschaft
This publication has 21 references indexed in Scilit:
- Adaptive Query Compilation with Processing-in-Memory2023
- Benchmarking a New Paradigm: Experimental Analysis and Characterization of a Real Processing-in-Memory SystemIEEE Access, 2022
- Regression Model Trees: Compact Energy Models for Complex IoT Devices2022
- NMPO: Near-Memory Computing Profiling and Offloading2021
- Featured Weighted Automata2017
- Input–output conformance testing for software product linesJournal of Logical and Algebraic Methods in Programming, 2016
- Measuring Behaviour Interactions between Product-Line Features2015
- Featured Transition Systems: Foundations for Verifying Variability-Intensive Systems and Their Application to LTL Model CheckingIEEE Transactions on Software Engineering, 2012
- Behavioural modelling and verification of real-time software product lines2012
- Collecting Statistics over Runtime ExecutionsElectronic Notes in Theoretical Computer Science, 2002