Nautilus: A Benchmarking Platform for DBMS Knob Tuning
Open Access
- 9 June 2024
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 72-76
Abstract
Recent research has shown the importance of tuning DBMS configuration knobs to achieve high performance. As a result, a large number of search-based and learning-based auto-tuning methods have been proposed. However, despite the promising results, we observe that (1) developing new auto-tuning methods, and (2) comparing them to existing methods is cumbersome and requires extensive engineering effort. This effort is compounded by the fact that auto-tuning methods typically need to be evaluated on multiple systems (PostgreSQL, MySQL, etc.) and benchmarks (TPC-C, TPC-H, etc.). In this paper we describe Nautilus, a platform that automates benchmarking for DBMS configuration tuning. Our insight in building Nautilus is that the process of developing auto-tuners can be separated into a tuning algorithm layer and a benchmarking layer. We focus on automating the benchmarking layer and thus make it easier for researchers to develop new tuning methods and compare with existing methods. We describe the design and implementation of Nautilus, highlighting its main features and advantages to the end-user. Furthermore, we are open-sourcing this project, so that the research community can freely use and benefit from it.Keywords
This publication has 12 references indexed in Scilit:
- Towards Dynamic and Safe Configuration Tuning for Cloud Databases2022
- UDOProceedings of the VLDB Endowment, 2021
- CGPTunerProceedings of the VLDB Endowment, 2021
- DBA bandits: Self-driving index tuning under ad-hoc, analytical workloads with safety guarantees2021
- An End-to-End Automatic Cloud Database Tuning System Using Deep Reinforcement Learning2019
- iBTuneProceedings of the VLDB Endowment, 2019
- BestConfig2017
- High-Performance Main-Memory Database Systems and Modern Virtualization2015
- OLTP-BenchProceedings of the VLDB Endowment, 2013
- Benchmarking cloud serving systems with YCSB2010