Semisupervised learning of mixture models with class constraints

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    1 Citation (Scopus)

    Abstract

    Most prior work on semisupervised clustering/mixture modeling with given class constraints assumes the number of classes is known, with each learned cluster assumed to be a class and, hence, subject to the given instance-level constraints. When the number of classes is incorrectly assumed and/or when the "one-cluster-perclass" assumption is not valid, the use of constraint information in these methods may actually be deleterious to learning the ground-truth data groups. In this work we extend semisupervised learning with constraints 1) to allow allocation of multiple mixture components to individual classes and 2) to estimate both the number of components/clusters and, leveraging the constraint information, the number of classes present in the data. For several real-world data sets, our method is shown to correctly estimate the number of classes and to give a favorable comparison with the recent mixture modeling approach of Shental et al.

    Original languageEnglish (US)
    Title of host publication2005 IEEE ICASSP '05 - Proc. - Design and Implementation of Signal Proces.Syst.,Indust. Technol. Track,Machine Learning for Signal Proces. Education, Spec. Sessions
    PublisherInstitute of Electrical and Electronics Engineers Inc.
    ISBN (Print)0780388747, 9780780388741
    DOIs
    StatePublished - Jan 1 2005
    Event2005 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP '05 - Philadelphia, PA, United States
    Duration: Mar 18 2005Mar 23 2005

    Publication series

    NameICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings
    VolumeV
    ISSN (Print)1520-6149

    Other

    Other2005 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP '05
    CountryUnited States
    CityPhiladelphia, PA
    Period3/18/053/23/05

    Fingerprint

    learning
    ground truth
    estimates

    All Science Journal Classification (ASJC) codes

    • Software
    • Signal Processing
    • Electrical and Electronic Engineering

    Cite this

    Zhao, Q., & Miller, D. J. (2005). Semisupervised learning of mixture models with class constraints. In 2005 IEEE ICASSP '05 - Proc. - Design and Implementation of Signal Proces.Syst.,Indust. Technol. Track,Machine Learning for Signal Proces. Education, Spec. Sessions [1416271] (ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings; Vol. V). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICASSP.2005.1416271
    Zhao, Qi ; Miller, David Jonathan. / Semisupervised learning of mixture models with class constraints. 2005 IEEE ICASSP '05 - Proc. - Design and Implementation of Signal Proces.Syst.,Indust. Technol. Track,Machine Learning for Signal Proces. Education, Spec. Sessions. Institute of Electrical and Electronics Engineers Inc., 2005. (ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings).
    @inproceedings{5289faa2eb744ce0b9e3e8c32c5eae1c,
    title = "Semisupervised learning of mixture models with class constraints",
    abstract = "Most prior work on semisupervised clustering/mixture modeling with given class constraints assumes the number of classes is known, with each learned cluster assumed to be a class and, hence, subject to the given instance-level constraints. When the number of classes is incorrectly assumed and/or when the {"}one-cluster-perclass{"} assumption is not valid, the use of constraint information in these methods may actually be deleterious to learning the ground-truth data groups. In this work we extend semisupervised learning with constraints 1) to allow allocation of multiple mixture components to individual classes and 2) to estimate both the number of components/clusters and, leveraging the constraint information, the number of classes present in the data. For several real-world data sets, our method is shown to correctly estimate the number of classes and to give a favorable comparison with the recent mixture modeling approach of Shental et al.",
    author = "Qi Zhao and Miller, {David Jonathan}",
    year = "2005",
    month = "1",
    day = "1",
    doi = "10.1109/ICASSP.2005.1416271",
    language = "English (US)",
    isbn = "0780388747",
    series = "ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings",
    publisher = "Institute of Electrical and Electronics Engineers Inc.",
    booktitle = "2005 IEEE ICASSP '05 - Proc. - Design and Implementation of Signal Proces.Syst.,Indust. Technol. Track,Machine Learning for Signal Proces. Education, Spec. Sessions",
    address = "United States",

    }

    Zhao, Q & Miller, DJ 2005, Semisupervised learning of mixture models with class constraints. in 2005 IEEE ICASSP '05 - Proc. - Design and Implementation of Signal Proces.Syst.,Indust. Technol. Track,Machine Learning for Signal Proces. Education, Spec. Sessions., 1416271, ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings, vol. V, Institute of Electrical and Electronics Engineers Inc., 2005 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP '05, Philadelphia, PA, United States, 3/18/05. https://doi.org/10.1109/ICASSP.2005.1416271

    Semisupervised learning of mixture models with class constraints. / Zhao, Qi; Miller, David Jonathan.

    2005 IEEE ICASSP '05 - Proc. - Design and Implementation of Signal Proces.Syst.,Indust. Technol. Track,Machine Learning for Signal Proces. Education, Spec. Sessions. Institute of Electrical and Electronics Engineers Inc., 2005. 1416271 (ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings; Vol. V).

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    TY - GEN

    T1 - Semisupervised learning of mixture models with class constraints

    AU - Zhao, Qi

    AU - Miller, David Jonathan

    PY - 2005/1/1

    Y1 - 2005/1/1

    N2 - Most prior work on semisupervised clustering/mixture modeling with given class constraints assumes the number of classes is known, with each learned cluster assumed to be a class and, hence, subject to the given instance-level constraints. When the number of classes is incorrectly assumed and/or when the "one-cluster-perclass" assumption is not valid, the use of constraint information in these methods may actually be deleterious to learning the ground-truth data groups. In this work we extend semisupervised learning with constraints 1) to allow allocation of multiple mixture components to individual classes and 2) to estimate both the number of components/clusters and, leveraging the constraint information, the number of classes present in the data. For several real-world data sets, our method is shown to correctly estimate the number of classes and to give a favorable comparison with the recent mixture modeling approach of Shental et al.

    AB - Most prior work on semisupervised clustering/mixture modeling with given class constraints assumes the number of classes is known, with each learned cluster assumed to be a class and, hence, subject to the given instance-level constraints. When the number of classes is incorrectly assumed and/or when the "one-cluster-perclass" assumption is not valid, the use of constraint information in these methods may actually be deleterious to learning the ground-truth data groups. In this work we extend semisupervised learning with constraints 1) to allow allocation of multiple mixture components to individual classes and 2) to estimate both the number of components/clusters and, leveraging the constraint information, the number of classes present in the data. For several real-world data sets, our method is shown to correctly estimate the number of classes and to give a favorable comparison with the recent mixture modeling approach of Shental et al.

    UR - http://www.scopus.com/inward/record.url?scp=33646814767&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=33646814767&partnerID=8YFLogxK

    U2 - 10.1109/ICASSP.2005.1416271

    DO - 10.1109/ICASSP.2005.1416271

    M3 - Conference contribution

    AN - SCOPUS:33646814767

    SN - 0780388747

    SN - 9780780388741

    T3 - ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

    BT - 2005 IEEE ICASSP '05 - Proc. - Design and Implementation of Signal Proces.Syst.,Indust. Technol. Track,Machine Learning for Signal Proces. Education, Spec. Sessions

    PB - Institute of Electrical and Electronics Engineers Inc.

    ER -

    Zhao Q, Miller DJ. Semisupervised learning of mixture models with class constraints. In 2005 IEEE ICASSP '05 - Proc. - Design and Implementation of Signal Proces.Syst.,Indust. Technol. Track,Machine Learning for Signal Proces. Education, Spec. Sessions. Institute of Electrical and Electronics Engineers Inc. 2005. 1416271. (ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings). https://doi.org/10.1109/ICASSP.2005.1416271