CSC310F Fall 2006 -- Lectures

Tentative Lecture Schedule

• Sept 11 -- What is Information Theory?; Intro to Compression and Coding (notes [ps.gz, pdf])
• Sept 13 -- Uniquely Decodable and Instantaneous Codes (notes [ps.gz, pdf])
• Sept 18 -- Constructing Instantaneous Codes, Average Code Length (notes [ps.gz, pdf])
• Sept 18 -- A1 posted
• Sept 20 -- Entropy, Information and Optimal Symbol Codes (Huffman Codes) (notes [ps.gz, pdf])
• Sept 22 -- Tutorial: A1 questions and questions on lectures1-4
• Sept 25 -- Block Coding, Shannon's Noiseless Coding Theorem (notes [ps.gz, pdf])
• Sept 27 -- Typical Sets, H-delta (notes [ps.gz, pdf])
• Sept 27 -- A1 due
• Oct 2 -- Stream Codes, Arithmetic Coding (notes [ps.gz, pdf])
• Oct 4 -- Arithmetic Coding Details (notes [ps.gz, pdf])
• Oct 6 -- Tutorial: A2 questions and questions on lectures5-8. ([ Example from Tutorial])
• Oct 6 -- A2 posted
• Oct 9 -- THANKSGIVING DAY, no class, University closed
• Oct 11 -- Adaptive Probabilities (notes [ps.gz, pdf])
• Oct 13 -- No Tutorial, extra office hours by Prof. Roweis in Pratt 290F from 10:10-11am.
• Oct 16 -- PPM and Dictionary Models (notes [ps.gz, pdf])
• Oct 18 -- Dictionary Models, LZ77, LZ78, LZW, gzip, bzip (notes [ps.gz, pdf])
• Oct 20 -- A2 due; Tutorial: Midterm Review and Example Questions
• Oct 23 -- Noisy Channel Coding (notes [ps.gz, pdf])
• Oct 25 -- Examples of Simples Codes in the Real World (notes [ps.gz, pdf])
• Oct 27 -- MIDTERM TEST (during tutorial time)
• Oct 30 -- Channel Capacity (notes [ps.gz, pdf])
• Nov 1 -- Linear Codes (notes [ps.gz, pdf])
• Nov 3 -- A3 posted, due Nov13.
• Nov 6 -- Equivalent Codes and Canonical Forms (notes [ps.gz, pdf])
• Nov 8 -- Proving Shannon's Second Theorem (notes [ps.gz, pdf])
• Nov 10 -- Tutorial (Questions on lectures 12-17 and A3)
• Nov 13 -- Proof of Shannon's Thm and Product Codes (notes [ps.gz, pdf])
• Nov 13 -- A3 due
• Nov 15 -- Hamming Codes (notes [ps.gz, pdf])
• Nov 20 -- Low Density Parity Check Codes (notes [ps.gz, pdf])
• Nov 20 -- A4 posted
• Nov 22 -- Erasure Channels, Reed-Solomon and Digital Fountain Codes (notes [ps.gz, pdf])
• Nov 27 -- Erasure Channels, Reed-Solomon and Digital Fountain Codes (notes [ps.gz, pdf])
• Nov 29 -- Lossy Compression and Rate-Distortion (notes [ps.gz, pdf])
• Dec 1 -- JPEG Lossy Image Compression (notes [ps.gz, pdf])
• Dec 4 -- A4 due
• Dec 4 -- Final Tutorial (during lecture time) (some summary/review notes [ps.gz, pdf])
• Dec 6 -- FINAL TEST (during lecture time)

CSC310F - Information Theory || www.cs.toronto.edu/~roweis/csc310/