Enhancing gas detection-based swarming through deep reinforcement learning

Sangmin Lee, Seongjoon Park, Hwangnam Kim

    Research output: Contribution to journalArticlepeer-review

    1 Citation (Scopus)

    Abstract

    Swarm-Intelligence (SI), the collective behavior of decentralized and self-organized system, is used to efficiently carry out practical missions in various environments. To guarantee the performance of swarm, it is highly important that each object operates as an individual system while the devices are organized as simple as possible. This paper proposes an efficient, scalable, and practical swarming system using gas detection device. Each object of the proposed system has multiple sensors and detects gas in real time. To let the objects move toward gas rich spot, we propose two approaches for system design, vector-sum based, and Reinforcement Learning (RL) based. We firstly introduce our deterministic vector-sum-based approach and address the RL-based approach to extend the applicability and flexibility of the system. Through system performance evaluation, we validated that each object with a simple device configuration performs its mission perfectly in various environments.

    Original languageEnglish
    Pages (from-to)14794-14812
    Number of pages19
    JournalJournal of Supercomputing
    Volume78
    Issue number13
    DOIs
    Publication statusPublished - 2022 Sept

    Bibliographical note

    Funding Information:
    Swarm Robotics (SR) [] refers to the technology of moving several simple robots at once, and its background is in SI. SR was initially used to support and validate biological research. The ant cluster optimization algorithm [] and the particle cluster optimization algorithm [] are typical. Since then, as algorithms for swarm robots have been proposed in robotics, studies to solve real-world problems are actively conducted. Full-fledged research began in the early 21st century. Typical examples are Sentibots [] supported by DARPA and Swarm-bots project [] supported by the EU. Seaswarm [], which removes oil from the sea surface in a disaster situation, is also a representative example of SR. In recent years, SR has been commonly introduced in various logistics lines and military operations. In addition, Ars Electronica [], Intel [], EHang [] are actively utilizing swarm robot technology by directing various types of drone shows.

    Funding Information:
    This research was supported by the Human Resources Program in Energy Technology of the Korea Institute of Energy Technology Evaluation and Planning (KETEP) and the Ministry of Trade, Industry & Energy (MOTIE) of the Republic of Korea (No. 20204010600220) and the National Research Foundation of Korea funded by the Korean Government (grant 2020R1A2C1012389).

    Publisher Copyright:
    © 2022, The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature.

    Keywords

    • Multi-robot control
    • Reinforcement learning
    • Remote sensing
    • Swarm-intelligence

    ASJC Scopus subject areas

    • Theoretical Computer Science
    • Software
    • Information Systems
    • Hardware and Architecture

    Fingerprint

    Dive into the research topics of 'Enhancing gas detection-based swarming through deep reinforcement learning'. Together they form a unique fingerprint.

    Cite this