Explaining Anomalous Events in Flight Data of UAV With Deep Attention-Based Multi-Instance Learning
- 3 August 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Vehicular Technology
- Vol. 73 (1) , 107-119
Abstract
Ensuring the safety and reliability of unmanned aerial vehicles (UAVs) has become a critical issue as they continue to advance. Analyzing anomalous events using event-based explanations is an effective approach to identifying key anomalous behaviors and mitigating potential risks. However, this task is challenging because anomalous events in flight data lack time-step labels in real-world UAV flight scenarios. To address this challenge, we propose a dual attention-based multi-instance learning (DA-DI-MIL) for pinpointing anomaly instances and automatically explaining anomalous events. Our MIL-based framework, from a weakly supervised learning perspective, treats a segment of flight data as a ‘bag’ with an available label, and its time steps as ‘instances’ without labels. The dual attention mechanism in DA-DI-MIL combines a temporal pseudo-label, predicted by temporal attention, and sensor variable importance obtained from delta feature attention to better pinpoint anomalies from instance-level labels. We use these labels in our proposed MIL-based framework to establish the relationships between anomalous events and anomalous behaviors. We conducted extensive experiments on real UAV flight data with engine failures to demonstrate the effectiveness and robustness of our proposed method compared to existing state-of-the-art methods. DA-DI-MIL achieves near 90% in evaluation metrics with less than 5 time steps' delay of anomalous event detection and around 85% in temporal anomaly detection. Additionally, we present an illustration of both global and local interpretations in the time domain and feature space, providing comprehensive insights into anomalous events. Our proposed method has efficiently and automatically explained anomalous events in UAV flight data, contributing to high-level aviation safety and reliability.Keywords
Funding Information
- National Key R&D Program of China (2022YFB3304600)
This publication has 27 references indexed in Scilit:
- Unmanned Aerial Vehicle Flight Data Anomaly Detection and Recovery Prediction Based on Spatio-Temporal CorrelationIEEE Transactions on Reliability, 2021
- An anomaly detection framework for time series data: An interval-based approachKnowledge-Based Systems, 2021
- Machine learning pipeline for battery state-of-health estimationNature Machine Intelligence, 2021
- Adversarial Examples in Deep Learning for Multivariate Time Series Regression2020
- Survey on Unmanned Aerial Vehicle Networks: A Cyber Physical System PerspectiveIEEE Communications Surveys & Tutorials, 2019
- A Gaussian Data Augmentation Technique on Highly Dimensional, Limited Labeled Data for Multiclass Classification Using Deep Learning2019
- Multivariate Regression-Based Fault Detection and Recovery of UAV Flight DataIEEE Transactions on Instrumentation and Measurement, 2019
- Multiple instance learning: A survey of problem characteristics and applicationsPattern Recognition, 2018
- Event Detection in Marine Time Series DataLecture Notes in Computer Science, 2015
- Isolation Forest2008