Stride static chunking algorithm for deduplication system

Young Woong Ko, Ho Min Jung, Wan Yeon Lee, Min Ja Kim, Chuck Yoo

Research output: Contribution to journalArticlepeer-review

7 Citations (Scopus)

Abstract

In this paper, we propose a stride static chunking deduplication algorithm using a hybrid approach that exploits the advantages of static chunking and byte-shift chunking algorithm. The key contribution of our approach is to reduce the computation time and enhance deduplication performance. We assume that duplicated data blocks are generally gathered into groups; thus, if we find one duplicated data block using byte-shift, then we can find subsequent data blocks with the static chunking approach. Experimental results show that stride static chunking algorithm gives significant benefits over static chunking, byte-shift chunking and variable-length chunking algorithm, particularly for reducing processing time and storage space.

Original languageEnglish
Pages (from-to)1544-1547
Number of pages4
JournalIEICE Transactions on Information and Systems
VolumeE96-D
Issue number7
DOIs
Publication statusPublished - 2013 Jul

Keywords

  • Byte-shift
  • Deduplication
  • Static chunking
  • Stride

ASJC Scopus subject areas

  • Software
  • Hardware and Architecture
  • Computer Vision and Pattern Recognition
  • Electrical and Electronic Engineering
  • Artificial Intelligence

Cite this