Accelerating Random Forest training process using FPGA
Authors:
- 1 September 2013
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 1946147X,p. 1-7
Abstract
Random Forest (RF) is one of the state-of-art supervised learning methods in Machine Learning and inherently consists of two steps: the training and the evaluation step. In applications where the system needs to be updated periodically, the training step becomes the bottleneck of the system, imposing hard constraints on its adaptability to a changing environment. In this work, a novel FPGA architecture for accelerating the RF training step is presented, exploring key features of the device. By combing a fine-grain data-flow processing at low-level and by exploiting parallelism available at high level inherent in the algorithm, significant acceleration factors are achieved. Key to the above gains is a novel FPGA FIFO based merge sorter module, a core component in the architecture, that exhibits high efficiency in memory utilisation; as well as a batch training strategy that enable full exploitation of the high memory bandwidth offered by the on-chip memory featured on FPGA devices. The proposed system achieves speed-up factors of up to 230x over a 3GHz Intel Core i5 processor when an Altera Stratix IV device is utilised under classification problems drawn from VOC2007.Keywords
This publication has 10 references indexed in Scilit:
- FPGA implementation of Naive Bayes classifier for visual object recognition2011
- FPGASort2011
- The devil is in the details: an evaluation of recent feature encoding methods2011
- Performance Comparison of Graphics Processors to Reconfigurable Logic: A Case StudyIEEE Transactions on Computers, 2010
- A Heterogeneous FPGA Architecture for Support Vector Machine Training2010
- Sorting Units for FPGA-Based Embedded Systems2008
- An FPGA Implementation of Decision Tree Classification2007
- An empirical comparison of supervised learning algorithms2006
- Random ForestsMachine Learning, 2001
- On the handling of continuous-valued attributes in decision tree generationMachine Learning, 1992