ProbeGeo: A Comprehensive Landmark Mining Framework Based on Web Content
- 30 July 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE/ACM Transactions on Networking
- Vol. 32 (5) , 4398-4413
Abstract
IP geolocation is essential for various location-aware Internet applications. High-quality IP geolocation landmarks play a decisive role in IP geolocation accuracy. However, the previous research works focusing on mining landmarks from the Internet are hampered by limited quantity, poor coverage, and insufficient landmark quality. In this paper, we present a new framework called ProbeGeo to mine high-quality landmarks automatically. We divide landmarks into common landmarks and probe landmarks , providing systematic mining methods based on online retrieval and web content. ProbeGeo expands traditional common landmarks by taking advantage of the exposure of multiple IoT (Internet of Things) devices on the Internet, mining them based on search engines and webpage contents. Common landmarks , consisting of multi-type devices, significantly improve landmark quantity and coverage. Furthermore, ProbeGeo establishes a methodology for acquiring new probe landmarks from Internet VPs (Vantage Points) webpages, extracting geographical locations from heterogeneous webpages and utilizing active probe functions. Probe landmarks enhance landmark quality and functions, bringing new geolocation frameworks and breaking through the geolocation accuracy bottleneck. We develop the ProbeGeo as a continuously running system and conduct real-world experiments to validate its efficacy. Our results show that ProbeGeo can detect 89,849 high-quality landmarks, including 6,874 probe landmarks and 82,975 common landmarks . ProbeGeo landmarks are about 10x more than existing work, distributed in 181 countries and 7,094 cities. ProbeGeo landmarks cover more than 8 types of devices, and more than 60% of them remain stable over one month. Moreover, the landmark accuracy of more than 58% of ProbeGeo landmarks is above street level, which has not been achieved in previous works. ProbeGeo can provide geolocation services with higher landmark accuracy and broader coverage by correlating a large scale of landmarks.Keywords
Funding Information
- National Key Research and Development Program of China (2022YFB3105001)
- National Natural Science Foundation of China (62172251)
This publication has 29 references indexed in Scilit:
- DET: Enabling Efficient Probing of IPv6 Active AddressesIEEE/ACM Transactions on Networking, 2022
- GeoCAM: An IP-Based Geolocation Service Through Fine-Grained and Stable Webcam LandmarksIEEE/ACM Transactions on Networking, 2021
- Under the Concealing Surface: Detecting and Understanding Live Webcams in the WildProceedings of the ACM on Measurement and Analysis of Computing Systems, 2020
- Towards IP-based Geolocation via Fine-grained and Stable Webcam Landmarks2020
- A look at router geolocation in public and commercial databases2017
- Ethical considerations in network measurement papersCommunications of the ACM, 2016
- An Algorithm of City-Level Landmark Mining Based on Internet Forum2015
- A bagging SVM to learn from positive and unlabeled examplesPattern Recognition Letters, 2014
- IP geolocation databasesACM SIGCOMM Computer Communication Review, 2011
- Constraint-Based Geolocation of Internet HostsIEEE/ACM Transactions on Networking, 2006