nuScenes Knowledge Graph - A comprehensive semantic representation of traffic scenes for trajectory prediction
Authors:
- 2 October 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 42-52
Abstract
Trajectory prediction in traffic scenes involves accurately forecasting the behaviour of surrounding vehicles. To achieve this objective it is crucial to consider contextual information, including the driving path of vehicles, road topology, lane dividers, and traffic rules. Although studies demonstrated the potential of leveraging heterogeneous context for improving trajectory prediction, state-of-the-art deep learning approaches still rely on a limited subset of this information. This is mainly due to the limited availability of comprehensive representations. This paper presents an approach that utilizes knowledge graphs to model the diverse entities and their semantic connections within traffic scenes. Further, we present nuScenes Knowledge Graph (nSKG), a knowledge graph for the nuScenes dataset, that models explicitly all scene participants and road elements, as well as their semantic and spatial relationships. To facilitate the usage of the nSKG via graph neural networks for trajectory prediction, we provide the data in a format, ready-to-use by the PyGlibrary. All artefacts can be found here: https://tinyurl.com/5t2vv9yu.Keywords
All Related Versions
This publication has 48 references indexed in Scilit:
- Schema.org: Evolution of Structured Data on the WebQueue, 2015
- Concept and development of a unified ontology for generating test and use‐case catalogues for assisted and automated vehicle guidanceIET Intelligent Transport Systems, 2014
- Whatever next? Predictive brains, situated agents, and the future of cognitive scienceBehavioral and Brain Sciences, 2013
- A Geo-ontology Design Pattern for Semantic Trajectories2013
- How Prediction Errors Shape Perception, Attention, and MotivationFrontiers in Psychology, 2012
- The automotive ontology2011
- Expectation (and attention) in visual cognitionTrends in Cognitive Sciences, 2009
- DBpedia: A Nucleus for a Web of Open Data2007
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998
- The body in the mind: The bodily basis of meaning, imagination and reasonEducational Studies in Mathematics, 1992