Virtual Experience-Based Mobile Device Selection Algorithm for Federated Learning

Mincheol Paik, Haneul Ko, Sangheon Pack

    Research output: Contribution to journalArticlepeer-review

    1 Citation (Scopus)

    Abstract

    In federated learning (FL), to minimize the convergence time while reaching a desired accuracy, it is important to select appropriate mobile devices (MDs) as participants with the considerations of their characteristics (e.g., data distribution, channel condition, and computing power). In this article, we first formulate a Markov decision process-based MD selection problem in which the increased accuracy per unit-time is maximized. To solve the formulated problem without any prior knowledge of the environment, a deep Q-network (DQN) algorithm can be exploited. However, storing previous experiences into the replay memory for DQN consumes an increased time since the FL server needs to conduct a number of actual FL procedures and observe the resulted rewards. To address this problem, we proposed a virtual experience-based MD selection algorithm (VE-MSA). In VE-MSA, the FL server generates virtual experiences (especially reward) without any actual FL procedures by using two neural networks approximating the round time and the increased accuracy in a round according to the selected MDs, respectively. Evaluation results demonstrate that the derived optimal policy can achieve a target accuracy within the shortest time among comparison schemes.

    Original languageEnglish
    Pages (from-to)2294-2303
    Number of pages10
    JournalIEEE Systems Journal
    Volume17
    Issue number2
    DOIs
    Publication statusPublished - 2023 Jun 1

    Bibliographical note

    Publisher Copyright:
    © 2007-2012 IEEE.

    Keywords

    • Client selection
    • deep Q-network (DQN)
    • experi- ence relay
    • federated learning (FL)
    • straggler problem

    ASJC Scopus subject areas

    • Information Systems
    • Electrical and Electronic Engineering
    • Control and Systems Engineering
    • Computer Networks and Communications
    • Computer Science Applications

    Fingerprint

    Dive into the research topics of 'Virtual Experience-Based Mobile Device Selection Algorithm for Federated Learning'. Together they form a unique fingerprint.

    Cite this