Towards a Machine Learning-Assisted Kernel with LAKE
Authors:
Open Access
- 27 January 2023
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 846-861
Abstract
The complexity of modern operating systems (OSes), rapid diversification of hardware, and steady evolution of machine learning (ML) motivate us to explore the potential of ML to improve decision-making in OS kernels. We conjecture that ML can better manage tradeoff spaces for subsystems such as memory management and process and I/O scheduling that currently rely on hand-tuned heuristics to provide reasonable average-case performance. We explore the replacement of heuristics with ML-driven decision-making in five kernel subsystems, consider the implications for kernel design, shared OS-level components, and access to hardware acceleration. We identify obstacles, address challenges and characterize tradeoffs for the benefits ML can provide that arise in kernel-space. We find that use of specialized hardware such as GPUs is critical to absorbing the additional computational load required by ML decisioning, but that poor accessibility of accelerators in kernel space is a barrier to adoption. We also find that the benefits of ML and acceleration for OSes is subsystem-, workload- and hardware-dependent, suggesting that using ML in kernels will require frameworks to help kernel developers navigate new tradeoff spaces. We address these challenge by building a system called LAKE for supporting ML and exposing accelerators in kernel space. LAKE includes APIs for feature collection and management across abstraction layers and module boundaries. LAKE provides mechanisms for managing the variable profitability of acceleration, and interfaces for mitigating contention for resources between user and kernel space. We show that an ML-backed I/O latency predictor can have its inference time reduced by up to 96% with acceleration.Keywords
Funding Information
- National Science Foundation (CNS-1846169,CNS-2006943,CNS-2202649,CNS-2207317)
- National Nuclear Security Administration (DE-NA0003969)
- Texas Systems Research Consortium ()
This publication has 52 references indexed in Scilit:
- NBA (network balancing act)2015
- On the feasibility of online malware detection with performance countersACM SIGARCH Computer Architecture News, 2013
- CPI 22013
- PTask2011
- PacketShaderACM SIGCOMM Computer Communication Review, 2010
- A microdriver architecture for error correcting codes inside the Linux kernel2009
- Intel’s New AES Instructions for Enhanced Performance and Security2009
- Faster and Timing-Attack Resistant AES-GCM2009
- The design, implementation and initial evaluation of an advanced knowledge-based process schedulerACM SIGOPS Operating Systems Review, 2001
- Predicting application run times using historical information1998