1.

Record Nr.

UNISA996518463103316

Autore

Chambert-Loir Antoine

Titolo

Information Theory [[electronic resource] ] : Three Theorems by Claude Shannon / / by Antoine Chambert-Loir

Pubbl/distr/stampa

Cham : , : Springer International Publishing : , : Imprint : Springer, , 2022

ISBN

3-031-21561-3

Edizione

[1st ed. 2022.]

Descrizione fisica

1 online resource (XII, 209 p. 1 illus.)

Collana

La Matematica per il 3+2, , 2038-5757 ; ; 144

Disciplina

004.0151

Soggetti

Computer science—Mathematics

Coding theory

Information theory

Mathematics of Computing

Coding and Information Theory

Teoria de la informació

Teoria de la codificació

Llibres electrònics

Lingua di pubblicazione

Inglese

Formato

Materiale a stampa

Livello bibliografico

Monografia

Nota di contenuto

Elements of Theory of Probability -- Entropy and Mutual Information -- Coding -- Sampling -- Solutions to Exercises -- Bibliography -- Notation -- Index.

Sommario/riassunto

This book provides an introduction to information theory, focussing on Shannon’s three foundational theorems of 1948–1949. Shannon’s first two theorems, based on the notion of entropy in probability theory, specify the extent to which a message can be compressed for fast transmission and how to erase errors associated with poor transmission. The third theorem, using Fourier theory, ensures that a signal can be reconstructed from a sufficiently fine sampling of it. These three theorems constitute the roadmap of the book. The first chapter studies the entropy of a discrete random variable and related notions. The second chapter, on compression and error correcting, introduces the concept of coding, proves the existence of optimal codes and good codes (Shannon's first theorem), and shows how



information can be transmitted in the presence of noise (Shannon's second theorem). The third chapter proves the sampling theorem (Shannon's third theorem) and looks at its connections with other results, such as the Poisson summation formula. Finally, there is a discussion of the uncertainty principle in information theory. Featuring a good supply of exercises (with solutions), and an introductory chapter covering the prerequisites, this text stems out lectures given to mathematics/computer science students at the beginning graduate level.