On an objective basis for the maximum entropy principle

David J. Miller, Hossein Soleimani

    Research output: Contribution to journalLetter

    Abstract

    In this letter, we elaborate on some of the issues raised by a recent paper by Neapolitan and Jiang concerning the maximum entropy (ME) principle and alternative principles for estimating probabilities consistent with known, measured constraint information. We argue that the ME solution for the "problematic" example introduced by Neapolitan and Jiang has stronger objective basis, rooted in results from information theory, than their alternative proposed solution. We also raise some technical concerns about the Bayesian analysis in their work, which was used to independently support their alternative to the ME solution. The letter concludes by noting some open problems involving maximum entropy statistical inference.

    Original languageEnglish (US)
    Pages (from-to)401-406
    Number of pages6
    JournalEntropy
    Volume17
    Issue number1
    DOIs
    StatePublished - Jan 1 2015

    All Science Journal Classification (ASJC) codes

    • Physics and Astronomy(all)

    Fingerprint Dive into the research topics of 'On an objective basis for the maximum entropy principle'. Together they form a unique fingerprint.

  • Cite this