A mixture of experts classifier with learning based on both labelled and unlabelled data

David Jonathan Miller, Hasan S. Uyar

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    216 Scopus citations

    Abstract

    We address statistical classifier design given a mixed training set consisting of a small labelled feature set and a (generally larger) set of unlabel led feat u res. This situation arises, e.g., for medical images, where although training features may be plentiful, expensive expertise is required to extract their class labels. We propose a classifier structure and learning algorithm that make effective use of unlabelled data to improve performance. The learning is based on maximization of the total data likelihood, i.e. over both the labelled and unlabelled data subsets. Two distinct EM learning algorithms are proposed, differing in the EM formalism applied for unlabelled data. The classifier, based on a joint probability model for features and labels, is a "mixture of experts" structure that is equivalent to the radial basis function (RBP) classifier, but unlike RBFs, is amenable to likelihood-based training. The scope of application for the new method is greatly extended by the observation that test data, or any new data to classify, is in fact additional, unlabelled data-thus, a combined learning/classification operation-much akin to what is done in image segmentation-can be invoked whenever there is new data to classify. Experiments with data sets from the UC Irvine database demonstrate that the new learning algorithms and structure achieve substantial performance gains over alternative approaches.

    Original languageEnglish (US)
    Title of host publicationAdvances in Neural Information Processing Systems 9 - Proceedings of the 1996 Conference, NIPS 1996
    PublisherNeural information processing systems foundation
    Pages571-577
    Number of pages7
    ISBN (Print)0262100657, 9780262100656
    StatePublished - Jan 1 1997
    Event10th Annual Conference on Neural Information Processing Systems, NIPS 1996 - Denver, CO, United States
    Duration: Dec 2 1996Dec 5 1996

    Publication series

    NameAdvances in Neural Information Processing Systems
    ISSN (Print)1049-5258

    Other

    Other10th Annual Conference on Neural Information Processing Systems, NIPS 1996
    CountryUnited States
    CityDenver, CO
    Period12/2/9612/5/96

    All Science Journal Classification (ASJC) codes

    • Computer Networks and Communications
    • Information Systems
    • Signal Processing

    Fingerprint Dive into the research topics of 'A mixture of experts classifier with learning based on both labelled and unlabelled data'. Together they form a unique fingerprint.

  • Cite this

    Miller, D. J., & Uyar, H. S. (1997). A mixture of experts classifier with learning based on both labelled and unlabelled data. In Advances in Neural Information Processing Systems 9 - Proceedings of the 1996 Conference, NIPS 1996 (pp. 571-577). (Advances in Neural Information Processing Systems). Neural information processing systems foundation.