A Mobile Outdoor Augmented Reality Method Combining Deep Learning Object Detection and Spatial Relationships for Geovisualization
Open Access
Abstract
The purpose of this study was to develop a robust, fast and markerless mobile augmented reality method for registration, geovisualization and interaction in uncontrolled outdoor environments. We propose a lightweight deep-learning-based object detection approach for mobile or embedded devices; the vision-based detection results of this approach are combined with spatial relationships by means of the host device’s built-in Global Positioning System receiver, Inertial Measurement Unit and magnetometer. Virtual objects generated based on geospatial information are precisely registered in the real world, and an interaction method based on touch gestures is implemented. The entire method is independent of the network to ensure robustness to poor signal conditions. A prototype system was developed and tested on the Wuhan University campus to evaluate the method and validate its results. The findings demonstrate that our method achieves a high detection accuracy, stable geovisualization results and interaction.Keywords
Funding Information
- National Natural Science Foundation of China (41371427)
- National Key Research and Development Program of China (2016YFC0803106)
This publication has 53 references indexed in Scilit:
- A Spatial Lattice Model Applied for Meteorological Visualization and AnalysisISPRS International Journal of Geo-Information, 2017
- A Real-Time Marker-Based Visual Sensor Based on a FPGA and a Soft Core ProcessorSensors, 2016
- A Visual Analytics Approach for Extracting Spatio-Temporal Urban Mobility Information from Mobile Network TrafficISPRS International Journal of Geo-Information, 2012
- Augmented reality and photogrammetry: A synergy to visualize physical and virtual city environmentsISPRS Journal of Photogrammetry and Remote Sensing, 2010
- Geovisual analytics for spatial decision support: Setting the research agendaInternational Journal of Geographical Information Science, 2007
- Geovisualization: an example from the Catholme Ceremonial ComplexArchaeological Prospection, 2006
- Integrating spatio-temporal information in environmental monitoring data—a visualization approach applied to moss dataScience of The Total Environment, 2005
- Geovisualization for knowledge construction and decision supportIEEE Computer Graphics and Applications, 2004
- Explorations in the Use of Augmented Reality for Geographic VisualizationPRESENCE: Virtual and Augmented Reality, 2002
- Recent advances in augmented realityIEEE Computer Graphics and Applications, 2001