Lightweight kernel isolation with virtualization and VM functions
Authors:
Open Access
- 17 March 2020
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 157-171
Abstract
Commodity operating systems execute core kernel subsystems in a single address space along with hundreds of dynamically loaded extensions and device drivers. Lack of isolation within the kernel implies that a vulnerability in any of the kernel subsystems or device drivers opens a way to mount a successful attack on the entire kernel. Historically, isolation within the kernel remained prohibitive due to the high cost of hardware isolation primitives. Recent CPUs, however, bring a new set of mechanisms. Extended page-table (EPT) switching with VM functions and memory protection keys (MPKs) provide memory isolation and invocations across boundaries of protection domains with overheads comparable to system calls. Unfortunately, neither MPKs nor EPT switching provide architectural support for isolation of privileged ring 0 kernel code, i.e., control of privileged instructions and well-defined entry points to securely restore state of the system on transition between isolated domains. Our work develops a collection of techniques for lightweight isolation of privileged kernel code. To control execution of privileged instructions, we rely on a minimal hypervisor that transparently deprivileges the system into a non-root VT-x guest. We develop a new isolation boundary that leverages extended page table (EPT) switching with the VMFUNC instruction. We define a set of invariants that allows us to isolate kernel components in the face of an intricate execution model of the kernel, e.g., provide isolation of preemptable, concurrent interrupt handlers. To minimize overheads of virtualization, we develop support for exitless interrupt delivery across isolated domains. We evaluate our approach by developing isolated versions of several device drivers in the Linux kernel.Keywords
Funding Information
- National Science Foundation (1840197)
This publication has 32 references indexed in Scilit:
- VirtuOS2013
- Everything you always wanted to know about synchronization but were afraid to ask2013
- Software fault isolation with API integrity and multi-principal modules2011
- Linux kernel vulnerabilities2011
- Towards trustworthy computing systemsACM SIGOPS Operating Systems Review, 2007
- SingularityACM SIGOPS Operating Systems Review, 2007
- Initial Evaluation of a User-Level Device Driver Framework2004
- DiscoACM Transactions on Computer Systems, 1997
- Flick1997
- Two years of experience with a μ-Kernel based OSACM SIGOPS Operating Systems Review, 1991