Deep Neural Network-Based Cooperative Visual Tracking Through Multiple Micro Aerial Vehicles

Eric Price, Guilherme Lawless, Roman Ludwig, Igor Martinovic, Heinrich H. Bulthoff, Michael J. Black, Aamir Ahmad

    Research output: Contribution to journalArticlepeer-review

    49 Citations (Scopus)

    Abstract

    Multicamera tracking of humans and animals in outdoor environments is a relevant and challenging problem. Our approach to it involves a team of cooperating microaerial vehicles (MAVs) with on-board cameras only. Deep neural networks (DNNs) often fail at detecting small-scale objects or those that are far away from the camera, which are typical characteristics of a scenario with aerial robots. Thus, the core problem addressed in this letter is how to achieve on-board, online, continuous, and accurate vision-based detections using DNNs for visual person tracking through MAVs. Our solution leverages cooperation among multiple MAVs and active selection of most informative regions of image. We demonstrate the efficiency of our approach through simulations with up to 16 robots and real-robot experiments involving two aerial robots tracking a person, while maintaining an active perception-driven formation. ROS-based source code is provided for the benefit of the community.

    Original languageEnglish
    Pages (from-to)3193-3200
    Number of pages8
    JournalIEEE Robotics and Automation Letters
    Volume3
    Issue number4
    DOIs
    Publication statusPublished - 2018 Oct

    Bibliographical note

    Publisher Copyright:
    © 2016 IEEE.

    Keywords

    • Visual tracking
    • aerial systems: Perception and autonomy
    • multirobot systems

    ASJC Scopus subject areas

    • Control and Systems Engineering
    • Biomedical Engineering
    • Human-Computer Interaction
    • Mechanical Engineering
    • Computer Vision and Pattern Recognition
    • Computer Science Applications
    • Control and Optimization
    • Artificial Intelligence

    Fingerprint

    Dive into the research topics of 'Deep Neural Network-Based Cooperative Visual Tracking Through Multiple Micro Aerial Vehicles'. Together they form a unique fingerprint.

    Cite this