Classical information theory

Research output: Chapter in Book/Report/Conference proceedingChapter

Abstract

We begin with the definition of information gained by knowing that an event A has occurred: (1) (A dual point of view is also useful (although more evasive), where is the amount of information needed to specify event A.) Here and below stands for the underlying probability distribution. So the rarer an event A, the more information we gain if we know it has occurred. (More broadly, the rarer an event A, the more impact it will have. For example, the unlikely event that occurred in 1938 when fishermen caught a coelacanth - a prehistoric fish believed to be extinct - required a significant change to beliefs about evolution and biology. On the other hand, the likely event of catching a herring or a tuna would hardly imply any change in theories.)

Original languageEnglish (US)
Title of host publicationQuantum Information, Computation and Cryptography
Subtitle of host publicationAn Introductory Survey of Theory, Technology and Experiments
EditorsFabio Benatti
Pages33-64
Number of pages32
DOIs
StatePublished - Sep 1 2010

Publication series

NameLecture Notes in Physics
Volume808
ISSN (Print)0075-8450

Fingerprint

information theory
fishes
biology

All Science Journal Classification (ASJC) codes

  • Physics and Astronomy (miscellaneous)

Cite this

Soukhov, I. M. (2010). Classical information theory. In F. Benatti (Ed.), Quantum Information, Computation and Cryptography: An Introductory Survey of Theory, Technology and Experiments (pp. 33-64). (Lecture Notes in Physics; Vol. 808). https://doi.org/10.1007/978-3-642-11914-9_2
Soukhov, Iouri M. / Classical information theory. Quantum Information, Computation and Cryptography: An Introductory Survey of Theory, Technology and Experiments. editor / Fabio Benatti. 2010. pp. 33-64 (Lecture Notes in Physics).
@inbook{6a4925b666fe409ea1c6e37ff6b6513e,
title = "Classical information theory",
abstract = "We begin with the definition of information gained by knowing that an event A has occurred: (1) (A dual point of view is also useful (although more evasive), where is the amount of information needed to specify event A.) Here and below stands for the underlying probability distribution. So the rarer an event A, the more information we gain if we know it has occurred. (More broadly, the rarer an event A, the more impact it will have. For example, the unlikely event that occurred in 1938 when fishermen caught a coelacanth - a prehistoric fish believed to be extinct - required a significant change to beliefs about evolution and biology. On the other hand, the likely event of catching a herring or a tuna would hardly imply any change in theories.)",
author = "Soukhov, {Iouri M.}",
year = "2010",
month = "9",
day = "1",
doi = "10.1007/978-3-642-11914-9_2",
language = "English (US)",
isbn = "9783642119132",
series = "Lecture Notes in Physics",
pages = "33--64",
editor = "Fabio Benatti",
booktitle = "Quantum Information, Computation and Cryptography",

}

Soukhov, IM 2010, Classical information theory. in F Benatti (ed.), Quantum Information, Computation and Cryptography: An Introductory Survey of Theory, Technology and Experiments. Lecture Notes in Physics, vol. 808, pp. 33-64. https://doi.org/10.1007/978-3-642-11914-9_2

Classical information theory. / Soukhov, Iouri M.

Quantum Information, Computation and Cryptography: An Introductory Survey of Theory, Technology and Experiments. ed. / Fabio Benatti. 2010. p. 33-64 (Lecture Notes in Physics; Vol. 808).

Research output: Chapter in Book/Report/Conference proceedingChapter

TY - CHAP

T1 - Classical information theory

AU - Soukhov, Iouri M.

PY - 2010/9/1

Y1 - 2010/9/1

N2 - We begin with the definition of information gained by knowing that an event A has occurred: (1) (A dual point of view is also useful (although more evasive), where is the amount of information needed to specify event A.) Here and below stands for the underlying probability distribution. So the rarer an event A, the more information we gain if we know it has occurred. (More broadly, the rarer an event A, the more impact it will have. For example, the unlikely event that occurred in 1938 when fishermen caught a coelacanth - a prehistoric fish believed to be extinct - required a significant change to beliefs about evolution and biology. On the other hand, the likely event of catching a herring or a tuna would hardly imply any change in theories.)

AB - We begin with the definition of information gained by knowing that an event A has occurred: (1) (A dual point of view is also useful (although more evasive), where is the amount of information needed to specify event A.) Here and below stands for the underlying probability distribution. So the rarer an event A, the more information we gain if we know it has occurred. (More broadly, the rarer an event A, the more impact it will have. For example, the unlikely event that occurred in 1938 when fishermen caught a coelacanth - a prehistoric fish believed to be extinct - required a significant change to beliefs about evolution and biology. On the other hand, the likely event of catching a herring or a tuna would hardly imply any change in theories.)

UR - http://www.scopus.com/inward/record.url?scp=77956050466&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=77956050466&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-11914-9_2

DO - 10.1007/978-3-642-11914-9_2

M3 - Chapter

SN - 9783642119132

T3 - Lecture Notes in Physics

SP - 33

EP - 64

BT - Quantum Information, Computation and Cryptography

A2 - Benatti, Fabio

ER -

Soukhov IM. Classical information theory. In Benatti F, editor, Quantum Information, Computation and Cryptography: An Introductory Survey of Theory, Technology and Experiments. 2010. p. 33-64. (Lecture Notes in Physics). https://doi.org/10.1007/978-3-642-11914-9_2