A MapReduce Framework for Mining Maximal Contiguous Frequent Patterns in Large DNA Sequence Datasets
Authors:
- Rezaul KarimRKRezaul Karim
- Azam HossainAzam Hossain
- Mamunur RashidMRMamunur Rashid
- Byeong-Soo JeongBJByeong-Soo Jeong
- Ho-Jin ChoiHCHo-Jin Choi
- Karim MKMKarim M
- Hossain MHMHossain M
- Choi HjCHChoi Hj
- 1 January 2012
- journal article
- research article
- Published by Wolters Kluwer Health in IETE Technical Review
- Vol. 29 (2) , 162
Abstract
Current DNA sequence datasets have become extremely large, making it a great challenge for single-processor and main-memory-based computing systems to mine interesting patterns. Such limited hardware resources make the performance of most Apriori-like algorithms inefficient. However, recent implementation of a MapReduce framework has overcome these limitations. Furthermore, mining with maximal contiguous frequent patterns to express the function and structure of DNA sequences is a useful technique, capable of capturing the common data characteristics among related sequences. In this paper, we proposed an efficient approach for mining maximal contiguous frequent patterns in large DNA sequence data using MapReduce framework which can handle a massive DNA sequence datasets with a large number of nodes on a Hadoop platform. Our extensive experimental results show that the proposed approach can mine the complete set of maximal contiguous frequent patterns very efficiently.Keywords
This publication has 9 references indexed in Scilit:
- MapReduce for Data Intensive Scientific Analyses2008
- MapReduceCommunications of the ACM, 2008
- Pairwise document similarity in large collections with MapReduce2008
- A Suffix Tree Construction Algorithm for DNA Sequences2007
- Mining Frequent Contiguous Sequence Patterns in Biological Sequences2007
- Efficient Algorithms for Mining Maximal Frequent Concatenate Sequences in Biological Datasets2005
- Practical Suffix Tree Construction2004
- Algorithms for the Longest Common Subsequence ProblemJournal of the ACM, 1977
- Longest common subsequences of two random sequencesJournal of Applied Probability, 1975