Model selection for support vector machines via uniform design

Chien Ming Huang, Yuh Jye Lee, Dennis K.J. Lin, Su Yun Huang

Research output: Contribution to journalArticle

114 Scopus citations

Abstract

The problem of choosing a good parameter setting for a better generalization performance in a learning task is the so-called model selection. A nested uniform design (UD) methodology is proposed for efficient, robust and automatic model selection for support vector machines (SVMs). The proposed method is applied to select the candidate set of parameter combinations and carry out a k-fold cross-validation to evaluate the generalization performance of each parameter combination. In contrast to conventional exhaustive grid search, this method can be treated as a deterministic analog of random search. It can dramatically cut down the number of parameter trials and also provide the flexibility to adjust the candidate set size under computational time constraint. The key theoretic advantage of the UD model selection over the grid search is that the UD points are "far more uniform"and "far more space filling" than lattice grid points. The better uniformity and space-filling phenomena make the UD selection scheme more efficient by avoiding wasteful function evaluations of close-by patterns. The proposed method is evaluated on different learning tasks, different data sets as well as different SVM algorithms.

Original languageEnglish (US)
Pages (from-to)335-346
Number of pages12
JournalComputational Statistics and Data Analysis
Volume52
Issue number1
DOIs
StatePublished - Sep 15 2007

All Science Journal Classification (ASJC) codes

  • Statistics and Probability
  • Computational Mathematics
  • Computational Theory and Mathematics
  • Applied Mathematics

Fingerprint Dive into the research topics of 'Model selection for support vector machines via uniform design'. Together they form a unique fingerprint.

  • Cite this