(IC 1.1) Information theory and Coding – Outline of topics
A playlist of these videos is available at:
Overview of central topics in Information theory and Coding.
Compression (source coding) theory:
Source coding theorem, Kraft-McMillan inequality, Rate-distortion theorem
Error-correction (channel coding) theory:
Channel coding theorem, Channel capacity, Typicality and the AEP
Compression algorithms:
Huffman codes, Arithmetic coding, Lempel-Ziv
Error-correction algorithms:
Hamming codes, Reed-Solomon codes, Turbo codes, Gallager (LDPC) codes
source