Weighted entropy and its use in computer science and beyond

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The concept of weighted entropy takes into account values of different outcomes, i.e., makes entropy context-dependent, through the weight function. We analyse analogs of the Fisher information inequality and entropy-power inequality for the weighted entropy and discuss connections with weighted Lieb’s splitting inequality. The concepts of rates of the weighted entropy and information are also discussed.

Original languageEnglish (US)
Title of host publicationAnalytical and Computational Methods in Probability Theory - 1st International Conference, ACMPT 2017, Proceedings
EditorsVladimir V. Rykov, Nozer D. Singpurwalla, Andrey M. Zubkov
PublisherSpringer Verlag
Pages293-308
Number of pages16
ISBN (Print)9783319715032
DOIs
StatePublished - Jan 1 2017
Event1st International Conference Analytical and Computational Methods in Probability Theory, ACMPT 2017 - Moscow, Russian Federation
Duration: Oct 23 2017Oct 27 2017

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume10684 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other1st International Conference Analytical and Computational Methods in Probability Theory, ACMPT 2017
CountryRussian Federation
CityMoscow
Period10/23/1710/27/17

Fingerprint

Computer science
Computer Science
Entropy
Information Inequality
Information Entropy
Fisher Information
Weight Function
Analogue
Dependent
Concepts

All Science Journal Classification (ASJC) codes

  • Theoretical Computer Science
  • Computer Science(all)

Cite this

Kelbert, M., Stuhl, I., & Soukhov, I. M. (2017). Weighted entropy and its use in computer science and beyond. In V. V. Rykov, N. D. Singpurwalla, & A. M. Zubkov (Eds.), Analytical and Computational Methods in Probability Theory - 1st International Conference, ACMPT 2017, Proceedings (pp. 293-308). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 10684 LNCS). Springer Verlag. https://doi.org/10.1007/978-3-319-71504-9_25
Kelbert, Mark ; Stuhl, Izabella ; Soukhov, Iouri M. / Weighted entropy and its use in computer science and beyond. Analytical and Computational Methods in Probability Theory - 1st International Conference, ACMPT 2017, Proceedings. editor / Vladimir V. Rykov ; Nozer D. Singpurwalla ; Andrey M. Zubkov. Springer Verlag, 2017. pp. 293-308 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{5a77188e43c24ae6aefb3532fd59e21f,
title = "Weighted entropy and its use in computer science and beyond",
abstract = "The concept of weighted entropy takes into account values of different outcomes, i.e., makes entropy context-dependent, through the weight function. We analyse analogs of the Fisher information inequality and entropy-power inequality for the weighted entropy and discuss connections with weighted Lieb’s splitting inequality. The concepts of rates of the weighted entropy and information are also discussed.",
author = "Mark Kelbert and Izabella Stuhl and Soukhov, {Iouri M.}",
year = "2017",
month = "1",
day = "1",
doi = "10.1007/978-3-319-71504-9_25",
language = "English (US)",
isbn = "9783319715032",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer Verlag",
pages = "293--308",
editor = "Rykov, {Vladimir V.} and Singpurwalla, {Nozer D.} and Zubkov, {Andrey M.}",
booktitle = "Analytical and Computational Methods in Probability Theory - 1st International Conference, ACMPT 2017, Proceedings",
address = "Germany",

}

Kelbert, M, Stuhl, I & Soukhov, IM 2017, Weighted entropy and its use in computer science and beyond. in VV Rykov, ND Singpurwalla & AM Zubkov (eds), Analytical and Computational Methods in Probability Theory - 1st International Conference, ACMPT 2017, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 10684 LNCS, Springer Verlag, pp. 293-308, 1st International Conference Analytical and Computational Methods in Probability Theory, ACMPT 2017, Moscow, Russian Federation, 10/23/17. https://doi.org/10.1007/978-3-319-71504-9_25

Weighted entropy and its use in computer science and beyond. / Kelbert, Mark; Stuhl, Izabella; Soukhov, Iouri M.

Analytical and Computational Methods in Probability Theory - 1st International Conference, ACMPT 2017, Proceedings. ed. / Vladimir V. Rykov; Nozer D. Singpurwalla; Andrey M. Zubkov. Springer Verlag, 2017. p. 293-308 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 10684 LNCS).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Weighted entropy and its use in computer science and beyond

AU - Kelbert, Mark

AU - Stuhl, Izabella

AU - Soukhov, Iouri M.

PY - 2017/1/1

Y1 - 2017/1/1

N2 - The concept of weighted entropy takes into account values of different outcomes, i.e., makes entropy context-dependent, through the weight function. We analyse analogs of the Fisher information inequality and entropy-power inequality for the weighted entropy and discuss connections with weighted Lieb’s splitting inequality. The concepts of rates of the weighted entropy and information are also discussed.

AB - The concept of weighted entropy takes into account values of different outcomes, i.e., makes entropy context-dependent, through the weight function. We analyse analogs of the Fisher information inequality and entropy-power inequality for the weighted entropy and discuss connections with weighted Lieb’s splitting inequality. The concepts of rates of the weighted entropy and information are also discussed.

UR - http://www.scopus.com/inward/record.url?scp=85039445325&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85039445325&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-71504-9_25

DO - 10.1007/978-3-319-71504-9_25

M3 - Conference contribution

AN - SCOPUS:85039445325

SN - 9783319715032

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 293

EP - 308

BT - Analytical and Computational Methods in Probability Theory - 1st International Conference, ACMPT 2017, Proceedings

A2 - Rykov, Vladimir V.

A2 - Singpurwalla, Nozer D.

A2 - Zubkov, Andrey M.

PB - Springer Verlag

ER -

Kelbert M, Stuhl I, Soukhov IM. Weighted entropy and its use in computer science and beyond. In Rykov VV, Singpurwalla ND, Zubkov AM, editors, Analytical and Computational Methods in Probability Theory - 1st International Conference, ACMPT 2017, Proceedings. Springer Verlag. 2017. p. 293-308. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-319-71504-9_25