GPGPU task scheduling technique for reducing the performance deviation of multiple GPGPU tasks in RPC-based GPU virtualization environments

Jihun Kang, Heonchang Yu

    Research output: Contribution to journalArticlepeer-review

    3 Citations (Scopus)

    Abstract

    In remote procedure call (RPC)-based graphic processing unit (GPU) virtualization environments, GPU tasks requested by multiple-user virtual machines (VMs) are delivered to the VM owning the GPU and are processed in a multi-process form. However, because the thread executing the computing on general GPUs cannot arbitrarily stop the task or trigger context switching, GPU monopoly may be prolonged owing to a long-running general-purpose computing on graphics processing unit (GPGPU) task. Furthermore, when scheduling tasks on the GPU, the time for which each user VM uses the GPU is not considered. Thus, in cloud environments that must provide fair use of computing resources, equal use of GPUs between each user VM cannot be guaranteed. We propose a GPGPU task scheduling scheme based on thread division processing that supports GPU use evenly by multiple VMs that process GPGPU tasks in an RPC-based GPU virtualization environment. Our method divides the threads of the GPGPU task into several groups and controls the execution time of each thread group to prevent a specific GPGPU task from a long time monopolizing the GPU. The efficiency of the proposed technique is verified through an experiment in an environment where multiple VMs simultaneously perform GPGPU tasks.

    Original languageEnglish
    Article number508
    JournalSymmetry
    Volume13
    Issue number3
    DOIs
    Publication statusPublished - 2021 Mar

    Bibliographical note

    Publisher Copyright:
    © 2021 by the authors. Licensee MDPI, Basel, Switzerland.

    Keywords

    • GPGPU computing
    • GPU sharing
    • GPU virtualization
    • HPC cloud

    ASJC Scopus subject areas

    • Computer Science (miscellaneous)
    • Chemistry (miscellaneous)
    • General Mathematics
    • Physics and Astronomy (miscellaneous)

    Fingerprint

    Dive into the research topics of 'GPGPU task scheduling technique for reducing the performance deviation of multiple GPGPU tasks in RPC-based GPU virtualization environments'. Together they form a unique fingerprint.

    Cite this