Design of fast collective communication functions on clustered workstations with ethernet and myrinet

Dongyoung Kim; Dongseung Kim

doi:10.1007/978-3-540-77704-5_9

Design of fast collective communication functions on clustered workstations with ethernet and myrinet

Dongyoung Kim, Dongseung Kim

GREEN SCHOOL (Graduate School of Energy and Environment)

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

In cluster computing, current communication functions under MPI library are not well optimized. Especially, the performance is worse if there are multiple sources and/or destinations involved, which are the cases of collective communication. Our algorithms uses multidimensional factorization and pairwise exchange communication/dissemination methods to improve the performance. They deliver better performance than previous algorithms such as ring, recursive doubling and dissemination algorithms. Experimental results show the improvement of 50% or so over MPICH version 1.2.6 on a Linux cluster.

Original language	English
Title of host publication	High-Performance Computing - 6th International Symposium, ISHPC 2005 and First International Workshop on Advanced Low Power Systems, ALPS 2006, Revised Selected Papers
Publisher	Springer Verlag
Pages	105-116
Number of pages	12
ISBN (Print)	3540777032, 9783540777038
DOIs	https://doi.org/10.1007/978-3-540-77704-5_9
Publication status	Published - 2008
Event	6th International Symposium on High Performance Computing, ISHPC 2005 and 1st International Workshop on Advanced Low Power Systems, ALPS 2006 - Nara, Japan Duration: 2005 Sept 7 → 2005 Sept 9

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	4759 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	6th International Symposium on High Performance Computing, ISHPC 2005 and 1st International Workshop on Advanced Low Power Systems, ALPS 2006
Country/Territory	Japan
City	Nara
Period	05/9/7 → 05/9/9

Keywords

Broadcast
Cluster computing
MPI
Message passing communication

ASJC Scopus subject areas

Theoretical Computer Science
Computer Science(all)

Access to Document

10.1007/978-3-540-77704-5_9

Cite this

Kim, D., & Kim, D. (2008). Design of fast collective communication functions on clustered workstations with ethernet and myrinet. In High-Performance Computing - 6th International Symposium, ISHPC 2005 and First International Workshop on Advanced Low Power Systems, ALPS 2006, Revised Selected Papers (pp. 105-116). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 4759 LNCS). Springer Verlag. https://doi.org/10.1007/978-3-540-77704-5_9

Design of fast collective communication functions on clustered workstations with ethernet and myrinet. / Kim, Dongyoung; Kim, Dongseung.
High-Performance Computing - 6th International Symposium, ISHPC 2005 and First International Workshop on Advanced Low Power Systems, ALPS 2006, Revised Selected Papers. Springer Verlag, 2008. p. 105-116 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 4759 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Kim, D & Kim, D 2008, Design of fast collective communication functions on clustered workstations with ethernet and myrinet. in High-Performance Computing - 6th International Symposium, ISHPC 2005 and First International Workshop on Advanced Low Power Systems, ALPS 2006, Revised Selected Papers. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 4759 LNCS, Springer Verlag, pp. 105-116, 6th International Symposium on High Performance Computing, ISHPC 2005 and 1st International Workshop on Advanced Low Power Systems, ALPS 2006, Nara, Japan, 05/9/7. https://doi.org/10.1007/978-3-540-77704-5_9

Kim D, Kim D. Design of fast collective communication functions on clustered workstations with ethernet and myrinet. In High-Performance Computing - 6th International Symposium, ISHPC 2005 and First International Workshop on Advanced Low Power Systems, ALPS 2006, Revised Selected Papers. Springer Verlag. 2008. p. 105-116. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-540-77704-5_9

Kim, Dongyoung ; Kim, Dongseung. / Design of fast collective communication functions on clustered workstations with ethernet and myrinet. High-Performance Computing - 6th International Symposium, ISHPC 2005 and First International Workshop on Advanced Low Power Systems, ALPS 2006, Revised Selected Papers. Springer Verlag, 2008. pp. 105-116 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{842490d95a814782915cba2ee59b001c,

title = "Design of fast collective communication functions on clustered workstations with ethernet and myrinet",

abstract = "In cluster computing, current communication functions under MPI library are not well optimized. Especially, the performance is worse if there are multiple sources and/or destinations involved, which are the cases of collective communication. Our algorithms uses multidimensional factorization and pairwise exchange communication/dissemination methods to improve the performance. They deliver better performance than previous algorithms such as ring, recursive doubling and dissemination algorithms. Experimental results show the improvement of 50% or so over MPICH version 1.2.6 on a Linux cluster.",

keywords = "Broadcast, Cluster computing, MPI, Message passing communication",

author = "Dongyoung Kim and Dongseung Kim",

year = "2008",

doi = "10.1007/978-3-540-77704-5_9",

language = "English",

isbn = "3540777032",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Verlag",

pages = "105--116",

booktitle = "High-Performance Computing - 6th International Symposium, ISHPC 2005 and First International Workshop on Advanced Low Power Systems, ALPS 2006, Revised Selected Papers",

note = "6th International Symposium on High Performance Computing, ISHPC 2005 and 1st International Workshop on Advanced Low Power Systems, ALPS 2006 ; Conference date: 07-09-2005 Through 09-09-2005",

}

TY - GEN

T1 - Design of fast collective communication functions on clustered workstations with ethernet and myrinet

AU - Kim, Dongyoung

AU - Kim, Dongseung

PY - 2008

Y1 - 2008

N2 - In cluster computing, current communication functions under MPI library are not well optimized. Especially, the performance is worse if there are multiple sources and/or destinations involved, which are the cases of collective communication. Our algorithms uses multidimensional factorization and pairwise exchange communication/dissemination methods to improve the performance. They deliver better performance than previous algorithms such as ring, recursive doubling and dissemination algorithms. Experimental results show the improvement of 50% or so over MPICH version 1.2.6 on a Linux cluster.

AB - In cluster computing, current communication functions under MPI library are not well optimized. Especially, the performance is worse if there are multiple sources and/or destinations involved, which are the cases of collective communication. Our algorithms uses multidimensional factorization and pairwise exchange communication/dissemination methods to improve the performance. They deliver better performance than previous algorithms such as ring, recursive doubling and dissemination algorithms. Experimental results show the improvement of 50% or so over MPICH version 1.2.6 on a Linux cluster.

KW - Broadcast

KW - Cluster computing

KW - MPI

KW - Message passing communication

UR - http://www.scopus.com/inward/record.url?scp=38549095138&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=38549095138&partnerID=8YFLogxK

U2 - 10.1007/978-3-540-77704-5_9

DO - 10.1007/978-3-540-77704-5_9

M3 - Conference contribution

AN - SCOPUS:38549095138

SN - 3540777032

SN - 9783540777038

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 105

EP - 116

BT - High-Performance Computing - 6th International Symposium, ISHPC 2005 and First International Workshop on Advanced Low Power Systems, ALPS 2006, Revised Selected Papers

PB - Springer Verlag

T2 - 6th International Symposium on High Performance Computing, ISHPC 2005 and 1st International Workshop on Advanced Low Power Systems, ALPS 2006

Y2 - 7 September 2005 through 9 September 2005

ER -

Design of fast collective communication functions on clustered workstations with ethernet and myrinet

Abstract

Publication series

Conference

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this