MapReduce Based Parallel Neural Networks in Enabling Large Scale Machine Learning
Open Access
- 22 November 2015
- journal article
- research article
- Published by Wiley in Computational Intelligence and Neuroscience
- Vol. 2015, 1-13
Abstract
Artificial neural networks (ANNs) have been widely used in pattern recognition and classification applications. However, ANNs are notably slow in computation especially when the size of data is large. Nowadays, big data has received a momentum from both industry and academia. To fulfill the potentials of ANNs for big data applications, the computation process must be speeded up. For this purpose, this paper parallelizes neural networks based on MapReduce, which has become a major computing model to facilitate data intensive applications. Three data intensive scenarios are considered in the parallelization process in terms of the volume of classification data, the size of the training data, and the number of neurons in the neural network. The performance of the parallelized neural networks is evaluated in an experimental MapReduce computer cluster from the aspects of accuracy in classification and efficiency in computation.Keywords
Funding Information
- National Natural Science Foundation of China (51437003)
This publication has 6 references indexed in Scilit:
- A MapReduce-based distributed SVM ensemble for scalable image classification and annotationComputers & Mathematics with Applications, 2013
- Privacy Preserving Back-Propagation Neural Network Learning Made Practical with Cloud ComputingIEEE Transactions on Parallel and Distributed Systems, 2013
- Generalized Neural Network Approach for Global Solar Energy Estimation in IndiaIEEE Transactions on Sustainable Energy, 2012
- Scalable Massively Parallel Artificial Neural NetworksJournal of Aerospace Information Systems, 2008
- MapReduceCommunications of the ACM, 2008
- PhoenixACM SIGPLAN Notices, 2003