Extending TCP for accelerating replication on cluster file systems over sdns

Sungheon Lim; Hyogon Kim

doi:10.1109/NETSOFT.2019.8806672

Extending TCP for accelerating replication on cluster file systems over sdns

Sungheon Lim, Hyogon Kim

Department of Computer Science and Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

This paper explores the changes required of TCP to efficiently support cluster file systems such as Hadoop Distributed File System (HDFS) where the storage nodes are connected through a software defined networking (SDN). Traditional chain replications in these file systems incur large delay and cause inefficient network use. But SDN can cooperate with the cluster file systems to address the problems by pre-Arranging a distribution tree, which opens the possibility of parallel replication. Unfortunately, it cannot be realized without extending TCP, to accommodate the parallel transfer on the transport layer. This paper discusses how to extend TCP to make it possible, and demonstrates the feasibility by implementing a prototype in the Linux kernel. The prototype saves the data replication time by 25% while substantially reducing network use.

Original language	English
Title of host publication	Proceedings of the 2019 IEEE Conference on Network Softwarization
Subtitle of host publication	Unleashing the Power of Network Softwarization, NetSoft 2019
Editors	Christian Jacquenet, Filip De Turck, Prosper Chemouil, Flavio Esposito, Olivier Festor, Walter Cerroni, Stefano Secci
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	48-53
Number of pages	6
ISBN (Electronic)	9781538693766
DOIs	https://doi.org/10.1109/NETSOFT.2019.8806672
Publication status	Published - 2019 Jun
Event	5th IEEE Conference on Network Softwarization, NetSoft 2019 - Paris, France Duration: 2019 Jun 24 → 2019 Jun 28

Publication series

Name	Proceedings of the 2019 IEEE Conference on Network Softwarization: Unleashing the Power of Network Softwarization, NetSoft 2019

Conference

Conference	5th IEEE Conference on Network Softwarization, NetSoft 2019
Country/Territory	France
City	Paris
Period	19/6/24 → 19/6/28

Bibliographical note

Publisher Copyright:
© 2019 IEEE.

Keywords

HDFS
Software Defined Networking (SDN)
TCP extension
cluster file system
data replication
network utilization

ASJC Scopus subject areas

Safety, Risk, Reliability and Quality
Computer Networks and Communications
Software

Access to Document

10.1109/NETSOFT.2019.8806672

Cite this

Lim, S., & Kim, H. (2019). Extending TCP for accelerating replication on cluster file systems over sdns. In C. Jacquenet, F. De Turck, P. Chemouil, F. Esposito, O. Festor, W. Cerroni, & S. Secci (Eds.), Proceedings of the 2019 IEEE Conference on Network Softwarization: Unleashing the Power of Network Softwarization, NetSoft 2019 (pp. 48-53). Article 8806672 (Proceedings of the 2019 IEEE Conference on Network Softwarization: Unleashing the Power of Network Softwarization, NetSoft 2019). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/NETSOFT.2019.8806672

Extending TCP for accelerating replication on cluster file systems over sdns. / Lim, Sungheon; Kim, Hyogon.
Proceedings of the 2019 IEEE Conference on Network Softwarization: Unleashing the Power of Network Softwarization, NetSoft 2019. ed. / Christian Jacquenet; Filip De Turck; Prosper Chemouil; Flavio Esposito; Olivier Festor; Walter Cerroni; Stefano Secci. Institute of Electrical and Electronics Engineers Inc., 2019. p. 48-53 8806672 (Proceedings of the 2019 IEEE Conference on Network Softwarization: Unleashing the Power of Network Softwarization, NetSoft 2019).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Lim, S & Kim, H 2019, Extending TCP for accelerating replication on cluster file systems over sdns. in C Jacquenet, F De Turck, P Chemouil, F Esposito, O Festor, W Cerroni & S Secci (eds), Proceedings of the 2019 IEEE Conference on Network Softwarization: Unleashing the Power of Network Softwarization, NetSoft 2019., 8806672, Proceedings of the 2019 IEEE Conference on Network Softwarization: Unleashing the Power of Network Softwarization, NetSoft 2019, Institute of Electrical and Electronics Engineers Inc., pp. 48-53, 5th IEEE Conference on Network Softwarization, NetSoft 2019, Paris, France, 19/6/24. https://doi.org/10.1109/NETSOFT.2019.8806672

Lim S, Kim H. Extending TCP for accelerating replication on cluster file systems over sdns. In Jacquenet C, De Turck F, Chemouil P, Esposito F, Festor O, Cerroni W, Secci S, editors, Proceedings of the 2019 IEEE Conference on Network Softwarization: Unleashing the Power of Network Softwarization, NetSoft 2019. Institute of Electrical and Electronics Engineers Inc. 2019. p. 48-53. 8806672. (Proceedings of the 2019 IEEE Conference on Network Softwarization: Unleashing the Power of Network Softwarization, NetSoft 2019). doi: 10.1109/NETSOFT.2019.8806672

Lim, Sungheon ; Kim, Hyogon. / Extending TCP for accelerating replication on cluster file systems over sdns. Proceedings of the 2019 IEEE Conference on Network Softwarization: Unleashing the Power of Network Softwarization, NetSoft 2019. editor / Christian Jacquenet ; Filip De Turck ; Prosper Chemouil ; Flavio Esposito ; Olivier Festor ; Walter Cerroni ; Stefano Secci. Institute of Electrical and Electronics Engineers Inc., 2019. pp. 48-53 (Proceedings of the 2019 IEEE Conference on Network Softwarization: Unleashing the Power of Network Softwarization, NetSoft 2019).

@inproceedings{73de1ad8b21a45f4a6611612a25eda94,

title = "Extending TCP for accelerating replication on cluster file systems over sdns",

abstract = "This paper explores the changes required of TCP to efficiently support cluster file systems such as Hadoop Distributed File System (HDFS) where the storage nodes are connected through a software defined networking (SDN). Traditional chain replications in these file systems incur large delay and cause inefficient network use. But SDN can cooperate with the cluster file systems to address the problems by pre-Arranging a distribution tree, which opens the possibility of parallel replication. Unfortunately, it cannot be realized without extending TCP, to accommodate the parallel transfer on the transport layer. This paper discusses how to extend TCP to make it possible, and demonstrates the feasibility by implementing a prototype in the Linux kernel. The prototype saves the data replication time by 25% while substantially reducing network use.",

keywords = "HDFS, Software Defined Networking (SDN), TCP extension, cluster file system, data replication, network utilization",

author = "Sungheon Lim and Hyogon Kim",

note = "Publisher Copyright: {\textcopyright} 2019 IEEE.; 5th IEEE Conference on Network Softwarization, NetSoft 2019 ; Conference date: 24-06-2019 Through 28-06-2019",

year = "2019",

month = jun,

doi = "10.1109/NETSOFT.2019.8806672",

language = "English",

series = "Proceedings of the 2019 IEEE Conference on Network Softwarization: Unleashing the Power of Network Softwarization, NetSoft 2019",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "48--53",

editor = "Christian Jacquenet and {De Turck}, Filip and Prosper Chemouil and Flavio Esposito and Olivier Festor and Walter Cerroni and Stefano Secci",

booktitle = "Proceedings of the 2019 IEEE Conference on Network Softwarization",

}

TY - GEN

T1 - Extending TCP for accelerating replication on cluster file systems over sdns

AU - Lim, Sungheon

AU - Kim, Hyogon

PY - 2019/6

Y1 - 2019/6

N2 - This paper explores the changes required of TCP to efficiently support cluster file systems such as Hadoop Distributed File System (HDFS) where the storage nodes are connected through a software defined networking (SDN). Traditional chain replications in these file systems incur large delay and cause inefficient network use. But SDN can cooperate with the cluster file systems to address the problems by pre-Arranging a distribution tree, which opens the possibility of parallel replication. Unfortunately, it cannot be realized without extending TCP, to accommodate the parallel transfer on the transport layer. This paper discusses how to extend TCP to make it possible, and demonstrates the feasibility by implementing a prototype in the Linux kernel. The prototype saves the data replication time by 25% while substantially reducing network use.

AB - This paper explores the changes required of TCP to efficiently support cluster file systems such as Hadoop Distributed File System (HDFS) where the storage nodes are connected through a software defined networking (SDN). Traditional chain replications in these file systems incur large delay and cause inefficient network use. But SDN can cooperate with the cluster file systems to address the problems by pre-Arranging a distribution tree, which opens the possibility of parallel replication. Unfortunately, it cannot be realized without extending TCP, to accommodate the parallel transfer on the transport layer. This paper discusses how to extend TCP to make it possible, and demonstrates the feasibility by implementing a prototype in the Linux kernel. The prototype saves the data replication time by 25% while substantially reducing network use.

KW - HDFS

KW - Software Defined Networking (SDN)

KW - TCP extension

KW - cluster file system

KW - data replication

KW - network utilization

UR - http://www.scopus.com/inward/record.url?scp=85072033690&partnerID=8YFLogxK

U2 - 10.1109/NETSOFT.2019.8806672

DO - 10.1109/NETSOFT.2019.8806672

M3 - Conference contribution

AN - SCOPUS:85072033690

T3 - Proceedings of the 2019 IEEE Conference on Network Softwarization: Unleashing the Power of Network Softwarization, NetSoft 2019

SP - 48

EP - 53

BT - Proceedings of the 2019 IEEE Conference on Network Softwarization

A2 - Jacquenet, Christian

A2 - De Turck, Filip

A2 - Chemouil, Prosper

A2 - Esposito, Flavio

A2 - Festor, Olivier

A2 - Cerroni, Walter

A2 - Secci, Stefano

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 5th IEEE Conference on Network Softwarization, NetSoft 2019

Y2 - 24 June 2019 through 28 June 2019

ER -

Extending TCP for accelerating replication on cluster file systems over sdns

Abstract

Publication series

Conference

Bibliographical note

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this