$f$-Information Measures for Efficient Selection of Discriminative Genes From Microarray Data
Author:
- 16 September 2008
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Biomedical Engineering
- Vol. 56 (4) , 1063-1069
Abstract
Among the great amount of genes presented in microarray gene expression data, only a small fraction is effective for performing a certain diagnostic test. In this regard, mutual information has been shown to be successful for selecting a set of relevant and nonredundant genes from microarray data. However, information theory offers many more measures such as the f-information measures that may be suitable for selection of genes from microarray gene expression data. This paper presents different f-information measures as the evaluation criteria for gene selection problem. To compute the gene-gene redundancy (respectively, gene-class relevance), these information measures calculate the divergence of the joint distribution of two genes' expression values (respectively, the expression values of a gene and the class labels of samples) from the joint distribution when two genes (respectively, the gene and class label) are considered to be completely independent. The performance of different f-information measures is compared with that of the mutual information based on the predictive accuracy of naive Bayes classifier, K -nearest neighbor rule, and support vector machine. An important finding is that some f-information measures are shown to be effective for selecting relevant and nonredundant genes from microarray data. The effectiveness of different f-information measures, along with a comparison with mutual information, is demonstrated on breast cancer, leukemia, and colon cancer datasets. While some f -information measures provide 100% prediction accuracy for all three microarray datasets, mutual information attains this accuracy only for breast cancer dataset, and 98.6% and 93.6% for leukemia and colon cancer datasets, respectively.Keywords
This publication has 13 references indexed in Scilit:
- Optimal Search-Based Gene Subset Selection for Gene Array Cancer ClassificationIEEE Transactions on Information Technology in Biomedicine, 2007
- Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancyIEEE Transactions on Pattern Analysis and Machine Intelligence, 2005
- A novel method for prokaryotic promoter prediction based on DNA stabilityBMC Bioinformatics, 2005
- $f$-Information Measures in Medical Image RegistrationIEEE Transactions on Medical Imaging, 2004
- Cluster analysis for gene expression data: a surveyIEEE Transactions on Knowledge and Data Engineering, 2004
- Predicting the clinical status of human breast cancer by using gene expression profilesProceedings of the National Academy of Sciences, 2001
- Exploring Expression Data: Identification and Analysis of Coexpressed GenesGenome Research, 1999
- Broad patterns of gene expression revealed by clustering analysis of tumor and normal colon tissues probed by oligonucleotide arraysProceedings of the National Academy of Sciences, 1999
- Wrappers for feature subset selectionArtificial Intelligence, 1997
- The Nature of Statistical Learning Theory1995