Abstract
This chapter examines the problem of active learning with model selection. Model selection and active learning are two important challenges for successful learning. A natural desire is to perform model selection and active learning at the same time, that is, we want to choose the best model and the best training input points. However, this is actually a chicken-and-egg problem since training input samples should have been fixed for performing model selection and models should have been fixed for performing active learning. The chapter discusses several compromise approaches, such as the sequential approach, the batch approach, and the ensemble approach. Using numerical examples, limitations of the sequential and batch approaches are pointed out, and the usefulness of the ensemble active learning approach is demonstrated.