Leveraging Event Streams with Deep Reinforcement Learning for End-to-End UAV Tracking - Equipe Robot interaction, Ambient system, Machine learning, Behaviour, Optimization
Pré-Publication, Document De Travail Année : 2024

Leveraging Event Streams with Deep Reinforcement Learning for End-to-End UAV Tracking

Résumé

In this paper, we present our proposed approach for active tracking to increase the autonomy of Unmanned Aerial Vehicles (UAVs) using event cameras, low-energy imaging sensors that offer significant advantages in speed and dynamic range. The proposed tracking controller is designed to respond to visual feedback from the mounted event sensor, adjusting the drone movements to follow the target. To leverage the full motion capabilities of a quadrotor and the unique properties of event sensors, we propose an end-to-end deep-reinforcement learning (DRL) framework that maps raw sensor data from event streams directly to control actions for the UAV. To learn an optimal policy under highly variable and challenging conditions, we opt for a simulation environment with domain randomization for effective transfer to real-world environments. We demonstrate the effectiveness of our approach through experiments in challenging scenarios, including fast-moving targets and changing lighting conditions, which result in improved generalization capabilities.
Fichier principal
Vignette du fichier
root.pdf (5.2 Mo) Télécharger le fichier
IEEEtran.bst (55.54 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04714734 , version 1 (02-10-2024)

Identifiants

Citer

Ala Souissi, Hajer Fradi, Panagiotis Papadakis. Leveraging Event Streams with Deep Reinforcement Learning for End-to-End UAV Tracking. 2024. ⟨hal-04714734⟩
9 Consultations
5 Téléchargements

Altmetric

Partager

More