V-PTP-IC: End-to-End Joint Modeling of Dynamic Scenes and Social Interactions for Pedestrian Trajectory Prediction from Vehicle-Mounted Cameras
Preprint
- 15 October 2025
- preprint
- Published by MDPI AG in Preprints.org
Abstract
Pedestrian trajectory prediction from vehicle-mounted cameras is a safety-critical capability in intelligent transportation systems and autonomous driving, particularly in highly dynamic and visually complex urban traffic. In such scenarios, ego-motion–induced jitter, frequent occlusions, and diverse background motions jointly challenge the modeling of both dynamic scene and social interactions, both of which are equally critical for forecasting future trajectories. Existing approaches, often developed for fixed-camera or surveillance setups, lack robustness to these dynamic driving conditions. We present V-PTP-IC (Vehicle-view Pedestrian Trajectory Prediction with Interaction Considerations), an end-to-end framework that jointly models dynamic scene and social interactions. The framework employs SORT-based multi-object tracking to initialize pedestrian trajectories and SIFT-based static keypoint matching for ego-motion compensation and trajectory stabilization. A VGG19-based dynamic scene encoder captures evolving environmental layouts, while a Social-LSTM module models spatiotemporal dependencies among pedestrians. A unified feature fusion strategy balances both modalities to generate accurate, diverse, and socially compliant trajectory forecasts. Extensive experiments on the JAAD in-vehicle dataset demonstrate that V-PTP-IC reduces the average displacement error (ADE) by 22.2 and the final displacement error (FDE) by 25.8 compared with state-of-the-art baselines. These results confirm the framework’s ability to balance prediction accuracy, diversity, and robustness, offering a scalable solution for autonomous driving in dynamically changing real-world environments.Keywords
All Related Versions
- Version 1, 2025-10-15, Preprints
- Published version: Sensors, 25 (23), 7151.
This publication has 12 references indexed in Scilit:
- Pedestrian trajectory prediction method based on the Social-LSTM model for vehicle collisionTransportation Safety and Environment, 2023
- A Review on Scene Prediction for Automated DrivingPhysics, 2022
- A Survey on Motion Prediction of Pedestrians and Vehicles for Autonomous DrivingIEEE Access, 2021
- On the analysis of movement smoothnessJournal of NeuroEngineering and Rehabilitation, 2015
- Human-aware robot navigation: A surveyRobotics and Autonomous Systems, 2013
- Probabilistic Analysis of Dynamic Scenes and Collision Risks Assessment to Improve Driving SafetyIEEE Intelligent Transportation Systems Magazine, 2011
- Comparison of Markov Chain Abstraction and Monte Carlo Simulation for the Safety Assessment of Autonomous CarsIEEE Transactions on Intelligent Transportation Systems, 2011
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- Social force model for pedestrian dynamicsPhysical Review E, 1995
- A Markovian Decision ProcessIndiana University Mathematics Journal, 1957