AutoBLG: Automatic URL blacklist generator using search space expansion and filters
Authors:
- Bo SunBSBo Sun
- Mitsuaki AkiyamaMAMitsuaki Akiyama
- Takeshi YagiTYTakeshi Yagi
- Mitsuhiro HatadaMHMitsuhiro Hatada
- Tatsuya MoriTMTatsuya Mori
- 1 July 2015
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 625-631
Abstract
Modern web users are exposed to a browser security threat called drive-by-download attacks that occur by simply visiting a malicious Uniform Resource Locator (URL) that embeds code to exploit web browser vulnerabilities. Many web users tend to click such URLs without considering the underlying threats. URL blacklists are an effective countermeasure to such browser-targeted attacks. URLs are frequently updated; therefore, collecting fresh malicious URLs is essential to ensure the effectiveness of a URL blacklist. We propose a framework called automatic blacklist generator (AutoBLG) that automatically identifies new malicious URLs using a given existing URL blacklist. The key idea of AutoBLG is expanding the search space of web pages while reducing the amount of URLs to be analyzed by applying several pre-filters to accelerate the process of generating blacklists. Auto-BLG comprises three primary primitives: URL expansion, URL filtration, and URL verification. Through extensive analysis using a high-performance web client honeypot, we demonstrate that AutoBLG can successfully extract new and previously unknown drive-by-download URLs.Keywords
This publication has 9 references indexed in Scilit:
- Cross-layer detection of malicious websites2013
- Detecting Malicious Websites by Learning IP Address Features2012
- EvilSeed: A Guided Approach to Finding Malicious Web Pages2012
- Controlling malware HTTP communications in dynamic analysis system using search engine2011
- Searching Structural Neighborhood of Malicious URLs to Improve Blacklisting2011
- Prophiler2011
- Design and Implementation of High Interaction Client Honeypot for Drive-by-Download AttacksIEICE Transactions on Communications, 2010
- Beyond blacklists2009
- Identifying suspicious URLs2009