Some analytical results on critic-driven ensemble classification

    Research output: Contribution to conferencePaper

    Abstract

    In recent work [14], we proposed a framework for ensemble classification wherein auxiliary networks, dubbed critics, are used to provide reliability information on the ensemble's individual classifiers/experts. We showed experimentally that critic-driven combining schemes extend the applicability of ensemble methods by overcoming the usual requirement that the individual classifier error rate p must be less than 0.5. Here, we support our previous work by proving, under an independence assumption, that performance for a particular critic-driven voting scheme improves with increasing ensemble size N, so long as p + q < 1, with q the critic's error rate in predicting accuracy of expert decisions. While this independence analysis gives significant insight into the conditions for success of critic-based schemes, it does not accurately predict the ensemble performance curve. We thus also develop an analytical approach for predicting the curve, by modeling dependence between experts.

    Original languageEnglish (US)
    Pages253-262
    Number of pages10
    StatePublished - Dec 1 1999
    EventProceedings of the 1999 9th IEEE Workshop on Neural Networks for Signal Processing (NNSP'99) - Madison, WI, USA
    Duration: Aug 23 1999Aug 25 1999

    Other

    OtherProceedings of the 1999 9th IEEE Workshop on Neural Networks for Signal Processing (NNSP'99)
    CityMadison, WI, USA
    Period8/23/998/25/99

    Fingerprint

    Classifiers

    All Science Journal Classification (ASJC) codes

    • Signal Processing
    • Software
    • Electrical and Electronic Engineering

    Cite this

    Miller, D. J., & Yan, L. (1999). Some analytical results on critic-driven ensemble classification. 253-262. Paper presented at Proceedings of the 1999 9th IEEE Workshop on Neural Networks for Signal Processing (NNSP'99), Madison, WI, USA, .
    Miller, David Jonathan ; Yan, Lian. / Some analytical results on critic-driven ensemble classification. Paper presented at Proceedings of the 1999 9th IEEE Workshop on Neural Networks for Signal Processing (NNSP'99), Madison, WI, USA, .10 p.
    @conference{bd8c55e29c8c499b862b0c531bfa209d,
    title = "Some analytical results on critic-driven ensemble classification",
    abstract = "In recent work [14], we proposed a framework for ensemble classification wherein auxiliary networks, dubbed critics, are used to provide reliability information on the ensemble's individual classifiers/experts. We showed experimentally that critic-driven combining schemes extend the applicability of ensemble methods by overcoming the usual requirement that the individual classifier error rate p must be less than 0.5. Here, we support our previous work by proving, under an independence assumption, that performance for a particular critic-driven voting scheme improves with increasing ensemble size N, so long as p + q < 1, with q the critic's error rate in predicting accuracy of expert decisions. While this independence analysis gives significant insight into the conditions for success of critic-based schemes, it does not accurately predict the ensemble performance curve. We thus also develop an analytical approach for predicting the curve, by modeling dependence between experts.",
    author = "Miller, {David Jonathan} and Lian Yan",
    year = "1999",
    month = "12",
    day = "1",
    language = "English (US)",
    pages = "253--262",
    note = "Proceedings of the 1999 9th IEEE Workshop on Neural Networks for Signal Processing (NNSP'99) ; Conference date: 23-08-1999 Through 25-08-1999",

    }

    Miller, DJ & Yan, L 1999, 'Some analytical results on critic-driven ensemble classification' Paper presented at Proceedings of the 1999 9th IEEE Workshop on Neural Networks for Signal Processing (NNSP'99), Madison, WI, USA, 8/23/99 - 8/25/99, pp. 253-262.

    Some analytical results on critic-driven ensemble classification. / Miller, David Jonathan; Yan, Lian.

    1999. 253-262 Paper presented at Proceedings of the 1999 9th IEEE Workshop on Neural Networks for Signal Processing (NNSP'99), Madison, WI, USA, .

    Research output: Contribution to conferencePaper

    TY - CONF

    T1 - Some analytical results on critic-driven ensemble classification

    AU - Miller, David Jonathan

    AU - Yan, Lian

    PY - 1999/12/1

    Y1 - 1999/12/1

    N2 - In recent work [14], we proposed a framework for ensemble classification wherein auxiliary networks, dubbed critics, are used to provide reliability information on the ensemble's individual classifiers/experts. We showed experimentally that critic-driven combining schemes extend the applicability of ensemble methods by overcoming the usual requirement that the individual classifier error rate p must be less than 0.5. Here, we support our previous work by proving, under an independence assumption, that performance for a particular critic-driven voting scheme improves with increasing ensemble size N, so long as p + q < 1, with q the critic's error rate in predicting accuracy of expert decisions. While this independence analysis gives significant insight into the conditions for success of critic-based schemes, it does not accurately predict the ensemble performance curve. We thus also develop an analytical approach for predicting the curve, by modeling dependence between experts.

    AB - In recent work [14], we proposed a framework for ensemble classification wherein auxiliary networks, dubbed critics, are used to provide reliability information on the ensemble's individual classifiers/experts. We showed experimentally that critic-driven combining schemes extend the applicability of ensemble methods by overcoming the usual requirement that the individual classifier error rate p must be less than 0.5. Here, we support our previous work by proving, under an independence assumption, that performance for a particular critic-driven voting scheme improves with increasing ensemble size N, so long as p + q < 1, with q the critic's error rate in predicting accuracy of expert decisions. While this independence analysis gives significant insight into the conditions for success of critic-based schemes, it does not accurately predict the ensemble performance curve. We thus also develop an analytical approach for predicting the curve, by modeling dependence between experts.

    UR - http://www.scopus.com/inward/record.url?scp=0033327086&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=0033327086&partnerID=8YFLogxK

    M3 - Paper

    AN - SCOPUS:0033327086

    SP - 253

    EP - 262

    ER -

    Miller DJ, Yan L. Some analytical results on critic-driven ensemble classification. 1999. Paper presented at Proceedings of the 1999 9th IEEE Workshop on Neural Networks for Signal Processing (NNSP'99), Madison, WI, USA, .