Enhanced collective communication functions using factorization and pairwise-exchange communication

Dongyoung Kim; Dongseung Kim

doi:10.1109/ICPADS.2005.149

Enhanced collective communication functions using factorization and pairwise-exchange communication

Dongyoung Kim, Dongseung Kim

GREEN SCHOOL (Graduate School of Energy and Environment)

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

This paper proposes new algorithms to enhance the collective communication functions, and reports the analysis and experimental results of them. The new algorithms use factorization and pairwise-exchange dissemination methods in broadcast, allgather and allreduce. They demand at most log₂P stages, and deliver better performance than the previous algorithms such as ring, recursive doubling and dissemination algorithms. Experimental results show the improvement of 50% or so over MPICH version 1.2.6 on a Linux cluster using TCP over Fast Ethernet and Gigabit Ethernet. The algorithms are being extended to other communication functions such as all-to-all broadcast and reduce-scatter.

Original language	English
Title of host publication	Proceedings - 11th International Conference on Parallel and Distributed Systems Workshops, ICPADS 2005
Editors	L. Barolli
Pages	675-681
Number of pages	7
DOIs	https://doi.org/10.1109/ICPADS.2005.149
Publication status	Published - 2005
Event	11th International Conference on Parallel and Distributed Systems Workshops, ICPADS 2005 - Fukuoka, Japan Duration: 2005 Jul 20 → 2005 Jul 22

Publication series

Name	Proceedings of the International Conference on Parallel and Distributed Systems - ICPADS
Volume	1
ISSN (Print)	1521-9097

Other

Other	11th International Conference on Parallel and Distributed Systems Workshops, ICPADS 2005
Country/Territory	Japan
City	Fukuoka
Period	05/7/20 → 05/7/22

ASJC Scopus subject areas

Hardware and Architecture

Access to Document

10.1109/ICPADS.2005.149

Cite this

Kim, D., & Kim, D. (2005). Enhanced collective communication functions using factorization and pairwise-exchange communication. In L. Barolli (Ed.), Proceedings - 11th International Conference on Parallel and Distributed Systems Workshops, ICPADS 2005 (pp. 675-681). (Proceedings of the International Conference on Parallel and Distributed Systems - ICPADS; Vol. 1). https://doi.org/10.1109/ICPADS.2005.149

Enhanced collective communication functions using factorization and pairwise-exchange communication. / Kim, Dongyoung; Kim, Dongseung.
Proceedings - 11th International Conference on Parallel and Distributed Systems Workshops, ICPADS 2005. ed. / L. Barolli. 2005. p. 675-681 (Proceedings of the International Conference on Parallel and Distributed Systems - ICPADS; Vol. 1).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Kim, D & Kim, D 2005, Enhanced collective communication functions using factorization and pairwise-exchange communication. in L Barolli (ed.), Proceedings - 11th International Conference on Parallel and Distributed Systems Workshops, ICPADS 2005. Proceedings of the International Conference on Parallel and Distributed Systems - ICPADS, vol. 1, pp. 675-681, 11th International Conference on Parallel and Distributed Systems Workshops, ICPADS 2005, Fukuoka, Japan, 05/7/20. https://doi.org/10.1109/ICPADS.2005.149

Kim D, Kim D. Enhanced collective communication functions using factorization and pairwise-exchange communication. In Barolli L, editor, Proceedings - 11th International Conference on Parallel and Distributed Systems Workshops, ICPADS 2005. 2005. p. 675-681. (Proceedings of the International Conference on Parallel and Distributed Systems - ICPADS). doi: 10.1109/ICPADS.2005.149

Kim, Dongyoung ; Kim, Dongseung. / Enhanced collective communication functions using factorization and pairwise-exchange communication. Proceedings - 11th International Conference on Parallel and Distributed Systems Workshops, ICPADS 2005. editor / L. Barolli. 2005. pp. 675-681 (Proceedings of the International Conference on Parallel and Distributed Systems - ICPADS).

@inproceedings{320fc396162644259318ece8773b8e5e,

title = "Enhanced collective communication functions using factorization and pairwise-exchange communication",

abstract = "This paper proposes new algorithms to enhance the collective communication functions, and reports the analysis and experimental results of them. The new algorithms use factorization and pairwise-exchange dissemination methods in broadcast, allgather and allreduce. They demand at most log2P stages, and deliver better performance than the previous algorithms such as ring, recursive doubling and dissemination algorithms. Experimental results show the improvement of 50% or so over MPICH version 1.2.6 on a Linux cluster using TCP over Fast Ethernet and Gigabit Ethernet. The algorithms are being extended to other communication functions such as all-to-all broadcast and reduce-scatter.",

author = "Dongyoung Kim and Dongseung Kim",

year = "2005",

doi = "10.1109/ICPADS.2005.149",

language = "English",

isbn = "0769522815",

series = "Proceedings of the International Conference on Parallel and Distributed Systems - ICPADS",

pages = "675--681",

editor = "L. Barolli",

booktitle = "Proceedings - 11th International Conference on Parallel and Distributed Systems Workshops, ICPADS 2005",

note = "11th International Conference on Parallel and Distributed Systems Workshops, ICPADS 2005 ; Conference date: 20-07-2005 Through 22-07-2005",

}

TY - GEN

T1 - Enhanced collective communication functions using factorization and pairwise-exchange communication

AU - Kim, Dongyoung

AU - Kim, Dongseung

PY - 2005

Y1 - 2005

N2 - This paper proposes new algorithms to enhance the collective communication functions, and reports the analysis and experimental results of them. The new algorithms use factorization and pairwise-exchange dissemination methods in broadcast, allgather and allreduce. They demand at most log2P stages, and deliver better performance than the previous algorithms such as ring, recursive doubling and dissemination algorithms. Experimental results show the improvement of 50% or so over MPICH version 1.2.6 on a Linux cluster using TCP over Fast Ethernet and Gigabit Ethernet. The algorithms are being extended to other communication functions such as all-to-all broadcast and reduce-scatter.

AB - This paper proposes new algorithms to enhance the collective communication functions, and reports the analysis and experimental results of them. The new algorithms use factorization and pairwise-exchange dissemination methods in broadcast, allgather and allreduce. They demand at most log2P stages, and deliver better performance than the previous algorithms such as ring, recursive doubling and dissemination algorithms. Experimental results show the improvement of 50% or so over MPICH version 1.2.6 on a Linux cluster using TCP over Fast Ethernet and Gigabit Ethernet. The algorithms are being extended to other communication functions such as all-to-all broadcast and reduce-scatter.

UR - http://www.scopus.com/inward/record.url?scp=23944464462&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=23944464462&partnerID=8YFLogxK

U2 - 10.1109/ICPADS.2005.149

DO - 10.1109/ICPADS.2005.149

M3 - Conference contribution

AN - SCOPUS:23944464462

SN - 0769522815

T3 - Proceedings of the International Conference on Parallel and Distributed Systems - ICPADS

SP - 675

EP - 681

BT - Proceedings - 11th International Conference on Parallel and Distributed Systems Workshops, ICPADS 2005

A2 - Barolli, L.

T2 - 11th International Conference on Parallel and Distributed Systems Workshops, ICPADS 2005

Y2 - 20 July 2005 through 22 July 2005

ER -

Enhanced collective communication functions using factorization and pairwise-exchange communication

Abstract

Publication series

Other

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this