Anomalous Indoor Human Trajectory Detection Based on the Transformer Encoder and Self-Organizing Map
Open Access
- 21 November 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 11, 131848-131865
Abstract
Anomalous human trajectory detection is a critical task in security surveillance in working areas. To identify anomalous human trajectories, understanding features of their movement plays an important role. Therefore, in this work, a Transformer encoder and self-organizing map-based model called TENSO is proposed to learn trajectory characteristics for detecting anomalies. In particular, the proposed model learns the internal characteristics of normal trajectories and clusters of normal trajectory representations in a latent space. To learn the internal characteristics of normal trajectories, the encoder of Transformer with a self-attention mechanism first encodes trajectories into sequences of embedding vectors of trajectory points in the latent space. Then, a decoder reconstructs the trajectories from the latent space. In addition, to learn clusters of normal trajectory representations in the latent space, the self-organizing map (SOM) layer is used, which gets its input as the output of the Transformer encoder. In the training phase, the TENSO model is trained using a total loss of trajectory reconstruction and SOM losses. In the anomaly detection phase, a test trajectory is evaluated to determine whether it is an anomaly based on trajectory reconstruction errors and the quantization error on the SOM. In this phase, a new metric is proposed which, namely WS, is the weighted sum of recall and precision to choose the appropriate threshold for detecting anomalies. The TENSO model-based framework is evaluated using two real trajectory datasets: MIT Badge and sCREEN. Experimental results show that the proposed framework identifies anomalies effectively and outperforms the baselines.Keywords
Funding Information
- Institute of Information & Communication Technology Planning & Evaluation
- Korea government (2020-0-00869)
- Development of 5G-based Shipbuilding & Marine Smart Communication Platform and Convergence Service)
- Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education (2021R1I1A3051364)
This publication has 42 references indexed in Scilit:
- Time-Dependent Popular Routes Based Trajectory Outlier Detection2015
- A framework for anomaly detection in maritime trajectory behaviorKnowledge and Information Systems, 2015
- Personalized route recommendation using big trajectory data2015
- Normalization: A Preprocessing StageIARJSET, 2015
- A New Framework for Traffic Anomaly Detection2014
- Clustering and aggregating clues of trajectories for mining trajectory patterns and routesThe VLDB Journal, 2011
- Detecting anomalies in people’s trajectories using spectral graph analysisComputer Vision and Image Understanding, 2011
- Trajectory clustering2007
- Time-focused clustering of trajectories of moving objectsJournal of Intelligent Information Systems, 2006
- The self-organizing mapProceedings of the IEEE, 1990