Improving OpenStack Swift interaction with the I/O Stack to Enable Software Defined Storage
Authors:
- Ramon NouRNRamon Nou
- Alberto MirandaAMAlberto Miranda
- Marc SiquierMSMarc Siquier
- Toni CortesTCToni Cortes
- 1 November 2017
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 63-70
Abstract
This paper analyses how OpenStack Swift, a distributed object storage service for a globally used middleware, interacts with the I/O subsystem through the Operating System. This interaction, which seems organised and clean on the middleware side, becomes disordered on the device side when using mechanical disk drives, due to the way threads are used internally to request data. We will show that only modifying the Swift threading model we achieve an 18% mean improvement in performance with objects larger than 512 KiB and obtain a similar performance with smaller objects. Compared to the original scenario, the performance obtained on both scenarios is obtained in a fair way: the bandwidth is shared equally between concurrently accessed objects. Moreover, this threading model allows us to apply techniques for Software Defined Storage (SDS). We show an implementation of a Bandwidth Differentiation technique that can control each data stream and that guarantees a high utilization of the device.Keywords
This publication has 6 references indexed in Scilit:
- Split-level I/O scheduling2015
- From application requests to virtual IOPs2014
- IOFlow2013
- SecondNet2010
- Competitive prefetching for concurrent sequential I/OACM SIGOPS Operating Systems Review, 2007
- Session-Based Adaptive Overload Control for Secure Dynamic Web Applications2005