Ensemble classification by critic-driven combining

David J. Miller, Lian Yan

    Research output: Contribution to journalConference articlepeer-review

    6 Scopus citations


    We develop new rules for combining estimates obtained from each classifier in an ensemble. A variety of combination techniques have been previously suggested, including averaging probability estimates, as well as hard voting schemes. We introduce a critic associated with each classifier, whose objective is to predict the classifier's errors. Since the critic only tackles a two-class problem, its predictions are generally more reliable than those of the classifier, and thus can be used as the basis for our suggested improved combination rules. While previous techniques are only effective when the individual classifier error rate is p<0.5, the new approach is successful, as proved under an independence assumption, even when this condition is violated - in particular, so long as p+q<1, with q the critic's error rate. More generally, critic-driven combining achieves consistent, substantial performance improvement over alternative methods, on a number of benchmark data sets.

    Original languageEnglish (US)
    Pages (from-to)1029-1032
    Number of pages4
    JournalICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings
    StatePublished - 1999
    EventProceedings of the 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP-99) - Phoenix, AZ, USA
    Duration: Mar 15 1999Mar 19 1999

    All Science Journal Classification (ASJC) codes

    • Software
    • Signal Processing
    • Electrical and Electronic Engineering


    Dive into the research topics of 'Ensemble classification by critic-driven combining'. Together they form a unique fingerprint.

    Cite this