Information Theory

Author: Robert B. Ash

Publisher: Courier Corporation

ISBN: 0486141454

Category: Technology & Engineering

Page: 352

View: 918

DIVAnalysis of channel models and proof of coding theorems; study of specific coding systems; and study of statistical properties of information sources. Sixty problems, with solutions. Advanced undergraduate to graduate level. /div
Posted in Technology & Engineering

Science and Information Theory

Author: Leon Brillouin

Publisher: Courier Corporation

ISBN: 0486497550

Category: Science

Page: 351

View: 9323

Geared toward upper-level undergraduates and graduate students, this classic resource by a giant of 20th-century mathematics applies principles of information theory to Maxwell's demon, thermodynamics, and measurement problems. 1962 edition.
Posted in Science

An Introduction to Information Theory

Author: Fazlollah M. Reza

Publisher: Courier Corporation

ISBN: 0486158446

Category: Mathematics

Page: 528

View: 9710

Graduate-level study for engineering students presents elements of modern probability theory, information theory, coding theory, more. Emphasis on sample space, random variables, capacity, etc. Many reference tables and extensive bibliography. 1961 edition.
Posted in Mathematics

Information Theory

Author: Jan C. A. Lubbe (van der.)

Publisher: Cambridge University Press

ISBN: 9780521467605

Category: Technology & Engineering

Page: 350

View: 7491

Textbook on information theory, an important subject in electrical engineering and computer science.
Posted in Technology & Engineering

Information Theory

Structural Models for Qualitative Data

Author: Klaus Krippendorff

Publisher: SAGE

ISBN: 9780803921320

Category: Social Science

Page: 96

View: 6898

Krippendorff introduces social scientists to information theory and explains its application for structural modeling. He discusses key topics such as: how to confirm an information theory model; its use in exploratory research; and how it compares with other approaches such as network analysis, path analysis, chi square and analysis of variance. Information Theory simplifies and clarifies a complex but powerful statistical method for analysing multivariate qualitative data. It will serve both as a textbook and as a sourcebook for researchers in communication theory, information theory and systems theory.
Posted in Social Science

A First Course in Information Theory

Author: Raymond W. Yeung

Publisher: Springer Science & Business Media

ISBN: 1441986081

Category: Technology & Engineering

Page: 412

View: 3000

This book provides an up-to-date introduction to information theory. In addition to the classical topics discussed, it provides the first comprehensive treatment of the theory of I-Measure, network coding theory, Shannon and non-Shannon type information inequalities, and a relation between entropy and group theory. ITIP, a software package for proving information inequalities, is also included. With a large number of examples, illustrations, and original problems, this book is excellent as a textbook or reference book for a senior or graduate level course on the subject, as well as a reference for researchers in related fields.
Posted in Technology & Engineering

Abstract Methods in Information Theory

Author: Y–ichir“ Kakihara

Publisher: World Scientific

ISBN: 9789810237110

Category: Mathematics

Page: 251

View: 4587

Information Theory is studied from the following view points: (1) the theory of entropy as amount of information; (2) the mathematical structure of information sources (probability measures); and (3) the theory of information channels. Shannon entropy and Kolmogorov-Sinai entropy are defined and their basic properties are examined, where the latter entropy is extended to be a linear functional on a certain set of measures. Ergodic and mixing properties of stationary sources are studied as well as AMS (asymptotically mean stationary) sources. The main purpose of this book is to present information channels in the environment of real and functional analysis as well as probability theory. Ergodic channels are characterized in various manners. Mixing and AMS channels are also considered in detail with some illustrations. A few other aspects of information channels including measurability, approximation and noncommutative extensions, are also discussed.
Posted in Mathematics

Information Theory and the Brain

Author: Roland Baddeley

Publisher: Cambridge University Press

ISBN: 9780521087865

Category: Computers

Page: 360

View: 837

This book deals with information theory, a new and expanding area of neuroscience which provides a framework for understanding neuronal processing.
Posted in Computers

Elements of Information Theory

Author: Thomas M. Cover,Joy A. Thomas

Publisher: John Wiley & Sons

ISBN: 1118585771

Category: Computers

Page: 792

View: 8275

The latest edition of this classic is updated with new problem sets and material The Second Edition of this fundamental textbook maintains the book's tradition of clear, thought-provoking instruction. Readers are provided once again with an instructive mix of mathematics, physics, statistics, and information theory. All the essential topics in information theory are covered in detail, including entropy, data compression, channel capacity, rate distortion, network information theory, and hypothesis testing. The authors provide readers with a solid understanding of the underlying theory and applications. Problem sets and a telegraphic summary at the end of each chapter further assist readers. The historical notes that follow each chapter recap the main points. The Second Edition features: * Chapters reorganized to improve teaching * 200 new problems * New material on source coding, portfolio theory, and feedback capacity * Updated references Now current and enhanced, the Second Edition of Elements of Information Theory remains the ideal textbook for upper-level undergraduate and graduate courses in electrical engineering, statistics, and telecommunications. An Instructor's Manual presenting detailed solutions to all the problems in the book is available from the Wiley editorial department.
Posted in Computers

Introduction to Coding and Information Theory

Author: Steven Roman

Publisher: Springer Science & Business Media

ISBN: 9780387947044

Category: Computers

Page: 326

View: 7786

This book is intended to introduce coding theory and information theory to undergraduate students of mathematics and computer science. It begins with a review of probablity theory as applied to finite sample spaces and a general introduction to the nature and types of codes. The two subsequent chapters discuss information theory: efficiency of codes, the entropy of information sources, and Shannon's Noiseless Coding Theorem. The remaining three chapters deal with coding theory: communication channels, decoding in the presence of errors, the general theory of linear codes, and such specific codes as Hamming codes, the simplex codes, and many others.
Posted in Computers

Information Theory

Author: Stanford Goldman

Publisher: Courier Corporation

ISBN: 0486442713

Category: Mathematics

Page: 385

View: 5419

This introductory treatment offers students of electrical engineering or applied mathematics a clear presentation of the principles of information theory. Topics include information theory of discrete systems, properties of continuous signals, ergodic ensembles, entropy of continuous distributions, aspects of modulation and noise reduction, and other subjects. Numerous problems, many with complete solutions. 1953 edition.
Posted in Mathematics

Mathematical Foundations of Information Theory

Author: Aleksandr I?Akovlevich Khinchin

Publisher: Courier Corporation

ISBN: 0486604349

Category: Mathematics

Page: 120

View: 9136

First comprehensive introduction to information theory explores the work of Shannon, McMillan, Feinstein, and Khinchin. Topics include the entropy concept in probability theory, fundamental theorems, and other subjects. 1957 edition.
Posted in Mathematics

Entropy and Information Theory

Author: Robert M. Gray

Publisher: Springer Science & Business Media

ISBN: 9781441979704

Category: Technology & Engineering

Page: 409

View: 5043

This book is an updated version of the information theory classic, first published in 1990. About one-third of the book is devoted to Shannon source and channel coding theorems; the remainder addresses sources, channels, and codes and on information and distortion measures and their properties. New in this edition: Expanded treatment of stationary or sliding-block codes and their relations to traditional block codes Expanded discussion of results from ergodic theory relevant to information theory Expanded treatment of B-processes -- processes formed by stationary coding memoryless sources New material on trading off information and distortion, including the Marton inequality New material on the properties of optimal and asymptotically optimal source codes New material on the relationships of source coding and rate-constrained simulation or modeling of random processes Significant material not covered in other information theory texts includes stationary/sliding-block codes, a geometric view of information theory provided by process distance measures, and general Shannon coding theorems for asymptotic mean stationary sources, which may be neither ergodic nor stationary, and d-bar continuous channels.
Posted in Technology & Engineering

Information Theory

A Tutorial Introduction

Author: JV Stone

Publisher: Sebtel Press

ISBN: 0956372856

Category: Information theory

Page: 243

View: 9484

Originally developed by Claude Shannon in the 1940s, information theory laid the foundations for the digital revolution, and is now an essential tool in telecommunications, genetics, linguistics, brain sciences, and deep space communication. In this richly illustrated book, accessible examples are used to introduce information theory in terms of everyday games like ‘20 questions’ before more advanced topics are explored. Online MatLab and Python computer programs provide hands-on experience of information theory in action, and PowerPoint slides give support for teaching. Written in an informal style, with a comprehensive glossary and tutorial appendices, this text is an ideal primer for novices who wish to learn the essential principles and applications of information theory.
Posted in Information theory

Information Theory, Inference and Learning Algorithms

Author: David J. C. MacKay

Publisher: Cambridge University Press

ISBN: 9780521642989

Category: Computers

Page: 628

View: 6602

Fun and exciting textbook on the mathematics underpinning the most dynamic areas of modern science and engineering.
Posted in Computers

Quantum Information Theory

Author: Mark M. Wilde

Publisher: Cambridge University Press

ISBN: 1316813304

Category: Computers

Page: N.A

View: 1315

Developing many of the major, exciting, pre- and post-millennium developments from the ground up, this book is an ideal entry point for graduate students into quantum information theory. Significant attention is given to quantum mechanics for quantum information theory, and careful studies of the important protocols of teleportation, superdense coding, and entanglement distribution are presented. In this new edition, readers can expect to find over 100 pages of new material, including detailed discussions of Bell's theorem, the CHSH game, Tsirelson's theorem, the axiomatic approach to quantum channels, the definition of the diamond norm and its interpretation, and a proof of the Choi–Kraus theorem. Discussion of the importance of the quantum dynamic capacity formula has been completely revised, and many new exercises and references have been added. This new edition will be welcomed by the upcoming generation of quantum information theorists and the already established community of classical information theorists.
Posted in Computers

Information Theory

Author: John Frederick Young

Publisher: N.A

ISBN: N.A

Category: Information theory

Page: 168

View: 786

Posted in Information theory

Information Theory

Coding Theorems for Discrete Memoryless Systems

Author: Imre Csiszár,János Körner

Publisher: Elsevier

ISBN: 1483281574

Category: Mathematics

Page: 460

View: 6169

Information Theory: Coding Theorems for Discrete Memoryless Systems presents mathematical models that involve independent random variables with finite range. This three-chapter text specifically describes the characteristic phenomena of information theory. Chapter 1 deals with information measures in simple coding problems, with emphasis on some formal properties of Shannon’s information and the non-block source coding. Chapter 2 describes the properties and practical aspects of the two-terminal systems. This chapter also examines the noisy channel coding problem, the computation of channel capacity, and the arbitrarily varying channels. Chapter 3 looks into the theory and practicality of multi-terminal systems. This book is intended primarily for graduate students and research workers in mathematics, electrical engineering, and computer science.
Posted in Mathematics