Hybrid Focused Crawling for Homemade Explosives Discovery on Surface and Dark Web
Authors:
- Christos IliouCIChristos Iliou
- George KalpakisGKGeorge Kalpakis
- Theodora TsikrikaTTTheodora Tsikrika
- Stefanos VrochidisStefanos Vrochidis
- Ioannis KompatsiarisIKIoannis Kompatsiaris
- 15 December 2016
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 229-234
Abstract
This work proposes a generic focused crawling framework for discovering resources on any given topic that reside on the Surface or the Dark Web. The proposed crawler is able to seamlessly traverse the Surface Web and several darknets present in the Dark Web (i.e. Tor, I2P and Freenet) during a single crawl by automatically adapting its crawling behavior and its classifier-guided hyperlink selection strategy based on the network type. This hybrid focused crawler is demonstrated for the discovery of Web resources containing recipes for producing homemade explosives. The evaluation experiments indicate the effectiveness of the proposed ap-proach both for the Surface and the Dark Web.Keywords
This publication has 10 references indexed in Scilit:
- Interactive Discovery and Retrieval of Web Resources Containing Home Made Explosive Recipes2016
- Concept Detection in Multimedia Web Resources About Home Made Explosives2015
- A Framework for the Discovery, Analysis, and Retrieval of Multimedia Homemade Explosives Information on the Web2015
- Focussed crawling of environmental Web resources based on the combination of multimedia evidenceMultimedia Tools and Applications, 2015
- Content and Popularity Analysis of Tor Hidden Services2014
- A focused crawler for Dark Web forumsJournal of the American Society for Information Science and Technology, 2010
- Web CrawlingFoundations and Trends® in Information Retrieval, 2010
- Uncovering the dark Web: A case study of Jihad on the WebJournal of the American Society for Information Science and Technology, 2008
- Link contexts in classifier-guided topical crawlersIEEE Transactions on Knowledge and Data Engineering, 2005
- Learning to crawlACM Transactions on Information Systems, 2005