Deep Neural Network-Based Cooperative Visual Tracking Through Multiple Micro Aerial Vehicles

51Citations
Citations of this article
94Readers
Mendeley users who have this article in their library.

Abstract

Multicamera tracking of humans and animals in outdoor environments is a relevant and challenging problem. Our approach to it involves a team of cooperating microaerial vehicles (MAVs) with on-board cameras only. Deep neural networks (DNNs) often fail at detecting small-scale objects or those that are far away from the camera, which are typical characteristics of a scenario with aerial robots. Thus, the core problem addressed in this letter is how to achieve on-board, online, continuous, and accurate vision-based detections using DNNs for visual person tracking through MAVs. Our solution leverages cooperation among multiple MAVs and active selection of most informative regions of image. We demonstrate the efficiency of our approach through simulations with up to 16 robots and real-robot experiments involving two aerial robots tracking a person, while maintaining an active perception-driven formation. ROS-based source code is provided for the benefit of the community.

Cite

CITATION STYLE

APA

Price, E., Lawless, G., Ludwig, R., Martinovic, I., Bulthoff, H. H., Black, M. J., & Ahmad, A. (2018). Deep Neural Network-Based Cooperative Visual Tracking Through Multiple Micro Aerial Vehicles. IEEE Robotics and Automation Letters, 3(4), 3193–3200. https://doi.org/10.1109/LRA.2018.2850224

Register to see more suggestions

Mendeley helps you to discover research relevant for your work.

Already have an account?

Save time finding and organizing research with Mendeley

Sign up for free