Analysis and enhancement of pipelining the protocol overheads for a high throughput

Hyun Wook Jin; Chuck Yoo

Analysis and enhancement of pipelining the protocol overheads for a high throughput

Hyun Wook Jin, Chuck Yoo

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

This paper investigates the protocol overhead pipelining between the host and network interface card (NIC). Existing researches into the protocol overhead pipelining assume that protocol overheads in the host and NIC can be naturally pipelined. Our architecture-aware investigation, however, finds a new fact that the host and NIC compete against each other to access the host memory, system bus, and I/O bus, so that the overhead pipelining is seriously hindered, which leads to a sub-optimal performance. We suggest several methods to avoid such competitions for the hardware resources and implement a pipelining UDP named π-UDP on Myrinet. As a result, π-UDP achieves over 97% of the theoretical maximum throughput of Myrinet.

Original language	English
Title of host publication	Proceedings of the International Conference on Parallel and Distributed Processing Techniques and Applications, PDPTA 2003
Editors	H.R. Arabnia, Y. Mun, H.R. Arabnia, Y. Mun
Pages	935-941
Number of pages	7
Publication status	Published - 2003
Event	Proceedings of the International Conference on Parallel and Distributed Processing Techniques and Applications - Las Vegas, NV, United States Duration: 2003 Jun 23 → 2003 Jun 26

Publication series

Name	Proceedings of the International Conference on Parallel and Distributed Processing Techniques and Applications
Volume	2

Other

Other	Proceedings of the International Conference on Parallel and Distributed Processing Techniques and Applications
Country/Territory	United States
City	Las Vegas, NV
Period	03/6/23 → 03/6/26

Keywords

Gigabit LAN
Myrinet
Overhead pipelining
UDP/IP

ASJC Scopus subject areas

General Engineering

Cite this

Jin, H. W., & Yoo, C. (2003). Analysis and enhancement of pipelining the protocol overheads for a high throughput. In H. R. Arabnia, Y. Mun, H. R. Arabnia, & Y. Mun (Eds.), Proceedings of the International Conference on Parallel and Distributed Processing Techniques and Applications, PDPTA 2003 (pp. 935-941). (Proceedings of the International Conference on Parallel and Distributed Processing Techniques and Applications; Vol. 2).

Analysis and enhancement of pipelining the protocol overheads for a high throughput. / Jin, Hyun Wook; Yoo, Chuck.
Proceedings of the International Conference on Parallel and Distributed Processing Techniques and Applications, PDPTA 2003. ed. / H.R. Arabnia; Y. Mun; H.R. Arabnia; Y. Mun. 2003. p. 935-941 (Proceedings of the International Conference on Parallel and Distributed Processing Techniques and Applications; Vol. 2).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Jin, HW & Yoo, C 2003, Analysis and enhancement of pipelining the protocol overheads for a high throughput. in HR Arabnia, Y Mun, HR Arabnia & Y Mun (eds), Proceedings of the International Conference on Parallel and Distributed Processing Techniques and Applications, PDPTA 2003. Proceedings of the International Conference on Parallel and Distributed Processing Techniques and Applications, vol. 2, pp. 935-941, Proceedings of the International Conference on Parallel and Distributed Processing Techniques and Applications, Las Vegas, NV, United States, 03/6/23.

Jin HW, Yoo C. Analysis and enhancement of pipelining the protocol overheads for a high throughput. In Arabnia HR, Mun Y, Arabnia HR, Mun Y, editors, Proceedings of the International Conference on Parallel and Distributed Processing Techniques and Applications, PDPTA 2003. 2003. p. 935-941. (Proceedings of the International Conference on Parallel and Distributed Processing Techniques and Applications).

Jin, Hyun Wook ; Yoo, Chuck. / Analysis and enhancement of pipelining the protocol overheads for a high throughput. Proceedings of the International Conference on Parallel and Distributed Processing Techniques and Applications, PDPTA 2003. editor / H.R. Arabnia ; Y. Mun ; H.R. Arabnia ; Y. Mun. 2003. pp. 935-941 (Proceedings of the International Conference on Parallel and Distributed Processing Techniques and Applications).

@inproceedings{a374285e94a04809adf80981c8fd862f,

title = "Analysis and enhancement of pipelining the protocol overheads for a high throughput",

abstract = "This paper investigates the protocol overhead pipelining between the host and network interface card (NIC). Existing researches into the protocol overhead pipelining assume that protocol overheads in the host and NIC can be naturally pipelined. Our architecture-aware investigation, however, finds a new fact that the host and NIC compete against each other to access the host memory, system bus, and I/O bus, so that the overhead pipelining is seriously hindered, which leads to a sub-optimal performance. We suggest several methods to avoid such competitions for the hardware resources and implement a pipelining UDP named π-UDP on Myrinet. As a result, π-UDP achieves over 97% of the theoretical maximum throughput of Myrinet.",

keywords = "Gigabit LAN, Myrinet, Overhead pipelining, UDP/IP",

author = "Jin, {Hyun Wook} and Chuck Yoo",

year = "2003",

language = "English",

isbn = "1892512416",

series = "Proceedings of the International Conference on Parallel and Distributed Processing Techniques and Applications",

pages = "935--941",

editor = "H.R. Arabnia and Y. Mun and H.R. Arabnia and Y. Mun",

booktitle = "Proceedings of the International Conference on Parallel and Distributed Processing Techniques and Applications, PDPTA 2003",

note = "Proceedings of the International Conference on Parallel and Distributed Processing Techniques and Applications ; Conference date: 23-06-2003 Through 26-06-2003",

}

TY - GEN

T1 - Analysis and enhancement of pipelining the protocol overheads for a high throughput

AU - Jin, Hyun Wook

AU - Yoo, Chuck

PY - 2003

Y1 - 2003

N2 - This paper investigates the protocol overhead pipelining between the host and network interface card (NIC). Existing researches into the protocol overhead pipelining assume that protocol overheads in the host and NIC can be naturally pipelined. Our architecture-aware investigation, however, finds a new fact that the host and NIC compete against each other to access the host memory, system bus, and I/O bus, so that the overhead pipelining is seriously hindered, which leads to a sub-optimal performance. We suggest several methods to avoid such competitions for the hardware resources and implement a pipelining UDP named π-UDP on Myrinet. As a result, π-UDP achieves over 97% of the theoretical maximum throughput of Myrinet.

AB - This paper investigates the protocol overhead pipelining between the host and network interface card (NIC). Existing researches into the protocol overhead pipelining assume that protocol overheads in the host and NIC can be naturally pipelined. Our architecture-aware investigation, however, finds a new fact that the host and NIC compete against each other to access the host memory, system bus, and I/O bus, so that the overhead pipelining is seriously hindered, which leads to a sub-optimal performance. We suggest several methods to avoid such competitions for the hardware resources and implement a pipelining UDP named π-UDP on Myrinet. As a result, π-UDP achieves over 97% of the theoretical maximum throughput of Myrinet.

KW - Gigabit LAN

KW - Myrinet

KW - Overhead pipelining

KW - UDP/IP

UR - http://www.scopus.com/inward/record.url?scp=1642264312&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:1642264312

SN - 1892512416

T3 - Proceedings of the International Conference on Parallel and Distributed Processing Techniques and Applications

SP - 935

EP - 941

BT - Proceedings of the International Conference on Parallel and Distributed Processing Techniques and Applications, PDPTA 2003

A2 - Arabnia, H.R.

A2 - Mun, Y.

A2 - Arabnia, H.R.

A2 - Mun, Y.

T2 - Proceedings of the International Conference on Parallel and Distributed Processing Techniques and Applications

Y2 - 23 June 2003 through 26 June 2003

ER -

Analysis and enhancement of pipelining the protocol overheads for a high throughput

Abstract

Publication series

Other

Keywords

ASJC Scopus subject areas

Other files and links

Fingerprint

Cite this