Information Theory

Kolmogorov complexity
Information theory
Chain rule for Kolmogorov complexity

A

Advanced MIMO communications
Algorithmic information theory
An Algebra for Theoretical Genetics
Asymptotic equipartition property

B

Bandwidth
Bandwidth extension
Bar product (coding theory)
Frank Benford
Bisection bandwidth
Bra-ket notation

C

Channel capacity
Channel code
Code rate
Comparison of latency and throughput
Computational irreducibility
Conditional entropy
Conjugate coding
Constant-weight code
Constraint (information theory)
Covert channel

D

DISCUS
Differential entropy

E

EXIT chart
Entropy power inequality
Entropy rate
Error exponent
Exformation
Extreme physical information

F

Fano's inequality
Fisher information
Formation matrix

G

Gambling and information theory
Gibbs' inequality

H

Hartley function
Hirschman uncertainty
History of information theory
Hyper-encryption

I

IEEE Transactions on Information Theory
Infonomics
Informating
Information continuum
Information entropy
Information exchange
Information flow (information theory)
Information geometry
Interaction information

J

Joe Weinman
Journal of Multimedia

K

Kelly criterion
Karl Küpfmüller

L

List of information theory topics
Logic of information

M

A Mathematical Theory of Communication
Maximum entropy spectral estimation
Maximum entropy thermodynamics
Metcalfe's law
Min-entropy
Modulo-N code
Multi-user MIMO
Multiple-input multiple-output communications
Mutual information

N

Network coding
Noisy channel coding theorem
Nonextensive entropy
Harry Nyquist
Nyquist–Shannon sampling theorem

O

Observed information
Operator Grammar
Oversampling

P

Phase factor
Physical information
Pointwise mutual information
Pragmatic theory of information
Principle of least privilege
Privilege revocation

Q

Quantities of information
Quantum computer
Quantum information

R

Random number generator
Rate distortion theory
Receiver (information theory)
Redundancy (information theory)
Relay channel
Run-length encoding
Rényi entropy

S

Self-information
Semiotic information theory
Shannon index
Shannon's source coding theorem
Shannon–Hartley theorem
Spectral efficiency
A Symbolic Analysis of Relay and Switching Circuits

T

Theil index
Timeline of information theory
Total correlation
Tsallis entropy
Typical set

U

Unicity distance

Z

Z Channel (information theory)
Zero suppression