ISRL: intelligent search by reinforcement learning in unstructured peer-to-peer networks
Authors:
- 16 January 2008
- journal article
- research article
- Published by Taylor & Francis in International Journal of Parallel, Emergent and Distributed Systems
- Vol. 23 (1) , 17-44
Abstract
Existing searches in unstructured peer-to-peer (P2P) networks are either blind or informed based on simple heuristics. Blind schemes suffer from low query quality. Simple heuristics lack theoretical background to support the simulation results. In this paper, we propose an intelligent searching scheme, called intelligent search by reinforcement learning (ISRL), which systematically seeks the best route to desired files by reinforcement learning (RL). In artificial intelligence, RL has been proven to be able to learn the best sequence of actions to achieve a certain goal. To discover the best path to desired files, ISRL not only explores new paths by forwarding queries to randomly chosen neighbors, but also exploits the paths that have been discovered for reducing the cumulative query cost. We design three models of ISRL: a basic version for finding one desired file, MP-ISRL for finding at least k files, and C-ISRL for reducing maintenance overhead through clustering when there are many queries. ISRL outperforms existing searching approaches in unstructured P2P networks by achieving similar query quality with lower cumulative query cost. The experimental result confirms the performance improvement of ISRL.Keywords
This publication has 17 references indexed in Scilit:
- A hybrid searching scheme in unstructured P2P networksInternational Journal of Parallel, Emergent and Distributed Systems, 2007
- How to Select a Good Alternate Path in Large Peer-to-Peer Systems?2006
- Improving Unstructured Peer-to-Peer Systems by Adaptive Connection EstablishmentIEEE Transactions on Computers, 2005
- Location awareness in unstructured peer-to-peer systemsIEEE Transactions on Parallel and Distributed Systems, 2005
- 'Dominating-set-based' searching in peer-to-peer networksInternational Journal of High Performance Computing and Networking, 2005
- Pong-cache poisoning in GUESS2004
- Making gnutella-like P2P systems scalable2003
- Incentives for sharing in peer-to-peer networks2001
- Swarm Intelligence1999
- Projections for efficient document clustering1997