A two-population evolutionary algorithm for feature extraction: Combining filter and wrapper

Eun Yeong Ahn, Tracy Mullen, John Yen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Extracting good features is critical to the performance of learning algorithms such as classifiers. Feature extraction selects and transforms original features to find information hidden in data. Due to the huge search space of selection and transformation of features, exhaustive search is computationally prohibitive and randomized search such as evolutionary algorithms (EA) are often used. In our prior work on evolutionary-based feature extraction, an individual, which represents a set of features, is evaluated by estimating the accuracy of a classifier when the individual's feature set is used for learning. Although incorporating a learning algorithm during evaluation, which is called the wrapper approach, generally performs better than evaluating an individual simply by the statistical properties of data, which is called the filter appproach, our EA based on a wrapper approach suffers from overfitting, so that a slight enhancement of fitness in training can dramatically reduce the classification accuracy for unseen testing data. To cope with this problem, this paper proposes a two-population EA for feature extraction (TEAFE) that combines filter and wrapper approaches, and shows the promising preliminary results.

Original languageEnglish (US)
Title of host publication2011 IEEE Congress of Evolutionary Computation, CEC 2011
Pages736-743
Number of pages8
DOIs
StatePublished - 2011
Event2011 IEEE Congress of Evolutionary Computation, CEC 2011 - New Orleans, LA, United States
Duration: Jun 5 2011Jun 8 2011

Other

Other2011 IEEE Congress of Evolutionary Computation, CEC 2011
CountryUnited States
CityNew Orleans, LA
Period6/5/116/8/11

All Science Journal Classification (ASJC) codes

  • Computational Theory and Mathematics
  • Theoretical Computer Science

Fingerprint Dive into the research topics of 'A two-population evolutionary algorithm for feature extraction: Combining filter and wrapper'. Together they form a unique fingerprint.

Cite this