Shard Level Transaction Based Cluster Management for Online Distributed Storage

DOI

10.2991/amcce-15.2015.244How to use a DOI?

Keywords

management; online distributed storage; shard level transaction

Abstract

Nowadays, distributed systems have been used everywhere, some for online applications, such as Apache HBase [1] and Cassandra [2], and some for offline applications, such as HDFS [3] and GFS. These systems achieve good result and largely reduce the cost. Due to the fact that distributed system is generally composed of lots of machines and failures occur recurrently, cluster management module is a must to handle these failures, thus provides availability and scalability. Low latency and high read and write performance is needed in many circumstances, such as in search engine and game field. Distributed storage for these systems need special ways to do cluster management. In this paper, a shard-level transaction based cluster management solution is proposed to handle such systems, and it can be easily extended.

Copyright

© 2015, the Authors. Published by Atlantis Press.

Open Access

This is an open access article distributed under the CC BY-NC license (http://creativecommons.org/licenses/by-nc/4.0/).

Download article (PDF)

TY  - CONF
AU  - Wei Liu
AU  - Jiabao Zhao
PY  - 2015/04
DA  - 2015/04
TI  - Shard Level Transaction Based Cluster Management for Online Distributed Storage
BT  - Proceedings of the 2015 International Conference on Automation, Mechanical Control and Computational Engineering
PB  - Atlantis Press
SN  - 1951-6851
UR  - https://doi.org/10.2991/amcce-15.2015.244
DO  - 10.2991/amcce-15.2015.244
ID  - Liu2015/04
ER  -