Resource Utilization-Aware Scheduling Technique Based on Dynamic Cache Refresh Scheme in Large-Scale Cloud Data centers

Heeseok Choi; Jihun Kang; Daewon Lee; Kwangsik Chung; Heonc Yu

doi:10.1109/CSCI.2017.272

Resource Utilization-Aware Scheduling Technique Based on Dynamic Cache Refresh Scheme in Large-Scale Cloud Data centers

Heeseok Choi, Jihun Kang, Daewon Lee, Kwangsik Chung, Heonc Yu

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

1 Citation (Scopus)

Abstract

In recent years, as researches on big data processing have become active, the frequency of use of HPC and large-scale data center is increasing for data processing. In addition, in the cloud computing environments, a large-scale environment consisting of huge nodes is being built, and additional problems arise due to the large-scale node configuration. In this paper, we analyze the overhead of gathering status information of large-scale nodes each time a virtual machine (VM) is migrated in a cloud environment composed of large-scale nodes. Then, we present a dynamic cache refresh (DCR) scheme to mitigate the unnecessary time of gathering status information of large-scale nodes. Our DCR scheme is able to obtain up-to-date information when necessary and reduce communication overhead without frequent cache refreshes. Based on experimental performance evaluations, we prove that our dynamic cache refresh (DCR) scheme achieves a significant reduction of the network bottleneck and the unnecessary delay time compared to existing cloud scheduler.

Original language	English
Title of host publication	Proceedings - 2017 International Conference on Computational Science and Computational Intelligence, CSCI 2017
Editors	Fernando G. Tinetti, Quoc-Nam Tran, Leonidas Deligiannidis, Mary Qu Yang, Mary Qu Yang, Hamid R. Arabnia
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	1560-1565
Number of pages	6
ISBN (Electronic)	9781538626528
DOIs	https://doi.org/10.1109/CSCI.2017.272
Publication status	Published - 2018 Dec 4
Event	2017 International Conference on Computational Science and Computational Intelligence, CSCI 2017 - Las Vegas, United States Duration: 2017 Dec 14 → 2017 Dec 16

Publication series

Name	Proceedings - 2017 International Conference on Computational Science and Computational Intelligence, CSCI 2017

Other

Other	2017 International Conference on Computational Science and Computational Intelligence, CSCI 2017
Country/Territory	United States
City	Las Vegas
Period	17/12/14 → 17/12/16

Bibliographical note

Publisher Copyright:
© 2017 IEEE.

Keywords

cloud computing
large-scale data center
openstack
resource-utilization monitoring

ASJC Scopus subject areas

Computer Science (miscellaneous)
Artificial Intelligence
Computer Networks and Communications
Computer Science Applications
Safety, Risk, Reliability and Quality

Access to Document

10.1109/CSCI.2017.272

Cite this

Choi, H., Kang, J., Lee, D., Chung, K., & Yu, H. (2018). Resource Utilization-Aware Scheduling Technique Based on Dynamic Cache Refresh Scheme in Large-Scale Cloud Data centers. In F. G. Tinetti, Q.-N. Tran, L. Deligiannidis, M. Q. Yang, M. Q. Yang, & H. R. Arabnia (Eds.), Proceedings - 2017 International Conference on Computational Science and Computational Intelligence, CSCI 2017 (pp. 1560-1565). Article 8561036 (Proceedings - 2017 International Conference on Computational Science and Computational Intelligence, CSCI 2017). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/CSCI.2017.272

Resource Utilization-Aware Scheduling Technique Based on Dynamic Cache Refresh Scheme in Large-Scale Cloud Data centers. / Choi, Heeseok; Kang, Jihun; Lee, Daewon et al.
Proceedings - 2017 International Conference on Computational Science and Computational Intelligence, CSCI 2017. ed. / Fernando G. Tinetti; Quoc-Nam Tran; Leonidas Deligiannidis; Mary Qu Yang; Mary Qu Yang; Hamid R. Arabnia. Institute of Electrical and Electronics Engineers Inc., 2018. p. 1560-1565 8561036 (Proceedings - 2017 International Conference on Computational Science and Computational Intelligence, CSCI 2017).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Choi, H, Kang, J, Lee, D, Chung, K & Yu, H 2018, Resource Utilization-Aware Scheduling Technique Based on Dynamic Cache Refresh Scheme in Large-Scale Cloud Data centers. in FG Tinetti, Q-N Tran, L Deligiannidis, MQ Yang, MQ Yang & HR Arabnia (eds), Proceedings - 2017 International Conference on Computational Science and Computational Intelligence, CSCI 2017., 8561036, Proceedings - 2017 International Conference on Computational Science and Computational Intelligence, CSCI 2017, Institute of Electrical and Electronics Engineers Inc., pp. 1560-1565, 2017 International Conference on Computational Science and Computational Intelligence, CSCI 2017, Las Vegas, United States, 17/12/14. https://doi.org/10.1109/CSCI.2017.272

Choi H, Kang J, Lee D, Chung K, Yu H. Resource Utilization-Aware Scheduling Technique Based on Dynamic Cache Refresh Scheme in Large-Scale Cloud Data centers. In Tinetti FG, Tran QN, Deligiannidis L, Yang MQ, Yang MQ, Arabnia HR, editors, Proceedings - 2017 International Conference on Computational Science and Computational Intelligence, CSCI 2017. Institute of Electrical and Electronics Engineers Inc. 2018. p. 1560-1565. 8561036. (Proceedings - 2017 International Conference on Computational Science and Computational Intelligence, CSCI 2017). doi: 10.1109/CSCI.2017.272

Choi, Heeseok ; Kang, Jihun ; Lee, Daewon et al. / Resource Utilization-Aware Scheduling Technique Based on Dynamic Cache Refresh Scheme in Large-Scale Cloud Data centers. Proceedings - 2017 International Conference on Computational Science and Computational Intelligence, CSCI 2017. editor / Fernando G. Tinetti ; Quoc-Nam Tran ; Leonidas Deligiannidis ; Mary Qu Yang ; Mary Qu Yang ; Hamid R. Arabnia. Institute of Electrical and Electronics Engineers Inc., 2018. pp. 1560-1565 (Proceedings - 2017 International Conference on Computational Science and Computational Intelligence, CSCI 2017).

@inproceedings{ec0cbf1370344ce9b5f6f525b0f5bce4,

title = "Resource Utilization-Aware Scheduling Technique Based on Dynamic Cache Refresh Scheme in Large-Scale Cloud Data centers",

abstract = "In recent years, as researches on big data processing have become active, the frequency of use of HPC and large-scale data center is increasing for data processing. In addition, in the cloud computing environments, a large-scale environment consisting of huge nodes is being built, and additional problems arise due to the large-scale node configuration. In this paper, we analyze the overhead of gathering status information of large-scale nodes each time a virtual machine (VM) is migrated in a cloud environment composed of large-scale nodes. Then, we present a dynamic cache refresh (DCR) scheme to mitigate the unnecessary time of gathering status information of large-scale nodes. Our DCR scheme is able to obtain up-to-date information when necessary and reduce communication overhead without frequent cache refreshes. Based on experimental performance evaluations, we prove that our dynamic cache refresh (DCR) scheme achieves a significant reduction of the network bottleneck and the unnecessary delay time compared to existing cloud scheduler.",

keywords = "cloud computing, large-scale data center, openstack, resource-utilization monitoring",

author = "Heeseok Choi and Jihun Kang and Daewon Lee and Kwangsik Chung and Heonc Yu",

note = "Publisher Copyright: {\textcopyright} 2017 IEEE.; 2017 International Conference on Computational Science and Computational Intelligence, CSCI 2017 ; Conference date: 14-12-2017 Through 16-12-2017",

year = "2018",

month = dec,

day = "4",

doi = "10.1109/CSCI.2017.272",

language = "English",

series = "Proceedings - 2017 International Conference on Computational Science and Computational Intelligence, CSCI 2017",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "1560--1565",

editor = "Tinetti, {Fernando G.} and Quoc-Nam Tran and Leonidas Deligiannidis and Yang, {Mary Qu} and Yang, {Mary Qu} and Arabnia, {Hamid R.}",

booktitle = "Proceedings - 2017 International Conference on Computational Science and Computational Intelligence, CSCI 2017",

}

TY - GEN

T1 - Resource Utilization-Aware Scheduling Technique Based on Dynamic Cache Refresh Scheme in Large-Scale Cloud Data centers

AU - Choi, Heeseok

AU - Kang, Jihun

AU - Lee, Daewon

AU - Chung, Kwangsik

AU - Yu, Heonc

PY - 2018/12/4

Y1 - 2018/12/4

N2 - In recent years, as researches on big data processing have become active, the frequency of use of HPC and large-scale data center is increasing for data processing. In addition, in the cloud computing environments, a large-scale environment consisting of huge nodes is being built, and additional problems arise due to the large-scale node configuration. In this paper, we analyze the overhead of gathering status information of large-scale nodes each time a virtual machine (VM) is migrated in a cloud environment composed of large-scale nodes. Then, we present a dynamic cache refresh (DCR) scheme to mitigate the unnecessary time of gathering status information of large-scale nodes. Our DCR scheme is able to obtain up-to-date information when necessary and reduce communication overhead without frequent cache refreshes. Based on experimental performance evaluations, we prove that our dynamic cache refresh (DCR) scheme achieves a significant reduction of the network bottleneck and the unnecessary delay time compared to existing cloud scheduler.

AB - In recent years, as researches on big data processing have become active, the frequency of use of HPC and large-scale data center is increasing for data processing. In addition, in the cloud computing environments, a large-scale environment consisting of huge nodes is being built, and additional problems arise due to the large-scale node configuration. In this paper, we analyze the overhead of gathering status information of large-scale nodes each time a virtual machine (VM) is migrated in a cloud environment composed of large-scale nodes. Then, we present a dynamic cache refresh (DCR) scheme to mitigate the unnecessary time of gathering status information of large-scale nodes. Our DCR scheme is able to obtain up-to-date information when necessary and reduce communication overhead without frequent cache refreshes. Based on experimental performance evaluations, we prove that our dynamic cache refresh (DCR) scheme achieves a significant reduction of the network bottleneck and the unnecessary delay time compared to existing cloud scheduler.

KW - cloud computing

KW - large-scale data center

KW - openstack

KW - resource-utilization monitoring

UR - http://www.scopus.com/inward/record.url?scp=85060610580&partnerID=8YFLogxK

U2 - 10.1109/CSCI.2017.272

DO - 10.1109/CSCI.2017.272

M3 - Conference contribution

AN - SCOPUS:85060610580

T3 - Proceedings - 2017 International Conference on Computational Science and Computational Intelligence, CSCI 2017

SP - 1560

EP - 1565

BT - Proceedings - 2017 International Conference on Computational Science and Computational Intelligence, CSCI 2017

A2 - Tinetti, Fernando G.

A2 - Tran, Quoc-Nam

A2 - Deligiannidis, Leonidas

A2 - Yang, Mary Qu

A2 - Arabnia, Hamid R.

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 2017 International Conference on Computational Science and Computational Intelligence, CSCI 2017

Y2 - 14 December 2017 through 16 December 2017

ER -

Resource Utilization-Aware Scheduling Technique Based on Dynamic Cache Refresh Scheme in Large-Scale Cloud Data centers

Abstract

Publication series

Other

Bibliographical note

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this