eCite Digital Repository

Providing consistent state to distributed storage system

Citation

Talluri, LSRK and Thirumalaisamy, R and Kota, R and Sadi, RPR and K C, U and Naha, RK and Mahanti, A, Providing consistent state to distributed storage system, Computers, 10, (2) pp. 1-12. ISSN 2073-431X (2021) [Refereed Article]


Preview
PDF
5Mb
  

Copyright Statement

Copyright 2021 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https:// creativecommons.org/licenses/by/4.0/).

DOI: doi:10.3390/computers10020023

Abstract

In cloud storage systems, users must be able to shut down the application when not in use and restart it from the last consistent state when required. BlobSeer is a data storage application, specially designed for distributed systems, that was built as an alternative solution for the existing popular open-source storage system-Hadoop Distributed File System (HDFS). In a cloud model, all the components need to stop and restart from a consistent state when the user requires it. One of the limitations of BlobSeer DFS is the possibility of data loss when the system restarts. As such, it is important to provide a consistent start and stop state to BlobSeer components when used in a Cloud environment to prevent any data loss. In this paper, we investigate the possibility of BlobSeer providing a consistent state distributed data storage system with the integration of checkpointing restart functionality. To demonstrate the availability of a consistent state, we set up a cluster with multiple machines and deploy BlobSeer entities with checkpointing functionality on various machines. We consider uncoordinated checkpoint algorithms for their associated benefits over other alternatives while integrating the functionality to various BlobSeer components such as the Version Manager (VM) and the Data Provider. The experimental results show that with the integration of the checkpointing functionality, a consistent state can be ensured for a distributed storage system even when the system restarts, preventing any possible data loss after the system has encountered various system errors and failures.

Item Details

Item Type:Refereed Article
Keywords:distributed system, distributed file system, BlobSeer, Hadoop, consistency, check-point, cloud computing
Research Division:Information and Computing Sciences
Research Group:Applied computing
Research Field:Applications in arts and humanities
Objective Division:Expanding Knowledge
Objective Group:Expanding knowledge
Objective Field:Expanding knowledge in the information and computing sciences
UTAS Author:K C, U (Mr Ujjwal K C)
UTAS Author:Naha, RK (Mr Ranesh Kumar Naha)
ID Code:151713
Year Published:2021
Web of Science® Times Cited:3
Deposited By:Information and Communication Technology
Deposited On:2022-08-03
Last Modified:2022-09-05
Downloads:3 View Download Statistics

Repository Staff Only: item control page