E-raamat: Information Theory: From Coding to Learning

'Polyanskiy and Wu's book treats information theory and various subjects of statistics in a unique ensemble, a striking novelty in the literature. It develops in depth the connections between the two fields, which helps to presenting the theory in a more complete, elegant and transparent way. An exciting and inspiring read for graduate students and researchers.' Alexandre Tsybakov, CREST-ENSAE, Paris 'Since the publication of Claude E. Shannon's A Mathematical Theory of Communication in 1948, information theory has expanded beyond its original focus on reliable transmission and storage of information to applications in statistics, machine learning, computer science, and beyond. This textbook, written by two leading researchers at the intersection of these fields, offers a modern synthesis of both the classical subject matter and these recent developments. It is bound to become a classic reference.' Maxim Raginsky, University of Illinois, Urbana-Champaign 'The central role of information theory in data science and machine learning is highlighted in this book, and will be of interest to all researchers in these areas. The authors are two of the leading young information theorists currently active. Their deep understanding of the area is evident in the technical depth of the treatment, which also covers many communication theory-oriented aspects of information theory.' Venkat Anantharam, University of California, Berkeley 'Written in a mathematically rigorous yet accessible style, this book offers information-theoretic tools that are indispensable for high-dimensional statistics. It also presents the classic topic of coding theorems in the modern one-shot (finite block-length) approach. To put it briefly, this is the information theory textbook of the new era.' Shun Watanabe, Tokyo University of Agriculture and Technology