Collaborative filtering recommendation algorithm based on Hadoop and Spark
Authors:
- 1 March 2015
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1510-1514
Abstract
The aim of this work was to develop and compare recommendation systems which use the item-based collaborative filtering algorithm, based on Hadoop and Spark. Data for the research were gathered from a real social portal the users of which can express their preferences regarding the applications on offer. The Hadoop version was implemented with the use of the Mahout library which was an element of the Hadoop ecosystem. The authors original solution was implemented with the use of the Apache Spark platform and the Scala programming language. The applied similarity measure was the Tanimoto coefficient which provides the most precise results for the available data. The initial assumptions were confirmed as the solution based on the Apache Spark platform turned out to be more efficient.Keywords
This publication has 8 references indexed in Scilit:
- A Survey of Recommendation AlgorithmsIOSR Journal of Computer Engineering, 2014
- Scaling-Up Item-Based Collaborative Filtering Recommendation Algorithm Based on Hadoop2011
- User-Based Collaborative-Filtering Recommendation Algorithms on Hadoop2010
- Combining Memory-Based and Model-Based Collaborative Filtering in Recommender System2009
- A Collaborative Filtering Recommendation Algorithm Based on Item Classification2009
- MapReduceCommunications of the ACM, 2008
- Item-based collaborative filtering recommendation algorithms2001
- Recommender systemsCommunications of the ACM, 1997