Statistical learning theory: a tutorial
- 10 June 2011
- journal article
- research article
- Published by Wiley in WIREs Computational Statistics
- Vol. 3 (6) , 543-556
Abstract
In this article, we provide a tutorial overview of some aspects of statistical learning theory, which also goes by other names such as statistical pattern recognition, nonparametric classification and estimation, and supervised learning. We focus on the problem of two‐class pattern classification for various reasons. This problem is rich enough to capture many of the interesting aspects that are present in the cases of more than two classes and in the problem of estimation, and many of the results can be extended to these cases. Focusing on two‐class pattern classification simplifies our discussion, and yet it is directly applicable to a wide range of practical settings. We begin with a description of the two‐class pattern recognition problem. We then discuss various classical and state‐of‐the‐art approaches to this problem, with a focus on fundamental formulations, algorithms, and theoretical results. In particular, we describe nearest neighbor methods, kernel methods, multilayer perceptrons, Vapnik–Chervonenkis theory, support vector machines, and boosting. WIREs Comp Stat 2011 3 543–556 DOI: 10.1002/wics.179This article is categorized under: Statistical Learning and Exploratory Methods of the Data Sciences > Clustering and Classification Statistical and Graphical Methods of Data Analysis > Nonparametric Methods Statistical Learning and Exploratory Methods of the Data Sciences > Pattern Recognition Statistical Learning and Exploratory Methods of the Data Sciences > Knowledge Discovery Statistical Learning and Exploratory Methods of the Data Sciences > Support Vector Machines Statistical Learning and Exploratory Methods of the Data Sciences > Neural NetworksKeywords
This publication has 10 references indexed in Scilit:
- The Elements of Statistical Learning2009
- Reliable Reasoning2007
- Pattern Recognition and Machine Learning2006
- Kernel Methods for Pattern Analysis2004
- Neural Network Learning1999
- Learning pattern classification-a surveyIEEE Transactions on Information Theory, 1998
- A Tutorial on Support Vector Machines for Pattern RecognitionData Mining and Knowledge Discovery, 1998
- A Probabilistic Theory of Pattern Recognition1996
- An Introduction to Computational Learning Theory1994
- PARAMETER ESTIMATION1990