IJCATR Volume 7 Issue 8

A Strategy for Improving the Performance of Small Files in Openstack Swift

Xiaoli Zhang , Chengyu Wen , Zizhen Yuan
10.7753/IJCATR0708.1006
keywords : Openstack; Swift object storage; high performance; small files; aggregated storage strategy.

PDF
This is an effective way to improve the storage access performance of small files in Openstack Swift by adding an aggregate storage module. Because Swift will lead to too much disk operation when querying metadata, the transfer performance of plenty of small files is low. In this paper, we propose an aggregated storage strategy (ASS), and implement it in Swift. ASS comprises two parts which include merge storage and index storage. At the first stage, ASS arranges the write request queue in chronological order, and then stores objects in volumes. These volumes are large files that are stored in Swift actually. During the short encounter time, the object-to-volume mapping information is stored in Key-Value store at the second stage. The experimental results show that the ASS can effectively improve Swift's small file transfer performance.
@artical{x782018ijcatr07081006,
Title = "A Strategy for Improving the Performance of Small Files in Openstack Swift ",
Journal ="International Journal of Computer Applications Technology and Research(IJCATR)",
Volume = "7",
Issue ="8",
Pages ="292 - 369",
Year = "2018",
Authors ="Xiaoli Zhang , Chengyu Wen , Zizhen Yuan "}
  • The paper proposes an aggregated storage strategy in Openstack Swift
  • A small Swift cluster with four nodes was deployed in the experiment
  • In this paper, ssbench tool is used to test the performance of Swift object storage system
  • Evaluate the effectiveness of the strategy by improving the Swift cluster.