| |
CSC310F Fall 2005 -- Lectures
Tentative Lecture Schedule
- Sept 12 -- What is Information Theory?; Intro to Compression and Coding
(notes [ps.gz,
pdf])
- Sept 14 -- Uniquely Decodable and Instantaneous Codes
(notes [ps.gz,
pdf])
- Sept 19 -- Constructing Instantaneous Codes, Average Code Length
(notes [ps.gz,
pdf])
- Sept 19 -- A1 posted
- Sept 21 -- Entropy, Information and Optimal Symbol Codes (Huffman Codes)
(notes [ps.gz,
pdf])
- Sept 22 -- Tutorial: A1 questions and questions on lectures1-4
- Sept 26 -- Block Coding, Shannon's Noiseless Coding Theorem
(notes [ps.gz,
pdf])
- Sept 28 -- Typical Sets, H-delta
(notes [ps.gz,
pdf])
- Sept 28 -- A1 due
- Oct 3 -- Stream Codes, Arithmetic Coding
(notes [ps.gz,
pdf])
- Oct 5 -- Arithmetic Coding Details
(notes [ps.gz,
pdf])
- Oct 6 -- Tutorial: questions on lectures 5-8.
- Oct 6 -- A2 posted
- Oct 10 -- THANKSGIVING DAY, no class, University closed
- Oct 12 -- Arithmetic Coding and Adaptive Probabilities
(notes [ps.gz,
pdf])
- Oct 13 -- Tutorial: A2 questions and questions on lectures5-9
- Oct 17 -- Adaptive Probability Models and PPM
(notes [ps.gz,
pdf])
- Oct 19 -- PPM and Dictionary Models
(notes [ps.gz,
pdf])
- Oct 20 -- A2 due; Tutorial: Midterm Review and Example Questions
- Oct 14 -- Dictionary Models, LZ77, LZ78, LZW, gzip, bzip
(notes [ps.gz,
pdf])
- Oct 26 -- Noisy Channel Coding
(notes [ps.gz,
pdf])
- Oct 27 -- MIDTERM TEST (during tutorial time)
- Oct 31 -- Channel Capacity
(notes [ps.gz,
pdf])
- Nov 1 -- A3 posted
- Nov 2 -- Examples of Simples Codes in the Real World
(notes [ps.gz,
pdf])
- Nov 7 -- Linear Codes
(notes [ps.gz,
pdf])
- Nov 9 -- Equivalent Codes and Canonical Forms
(notes [ps.gz,
pdf])
- Nov 14 -- Hamming Codes
(notes [ps.gz,
pdf])
- Nov 14 -- A3 due
- Nov 16 -- Low Density Parity Check Codes
(notes [ps.gz,
pdf])
- Nov 17 -- A4 posted
- Nov 21 -- Proving Shannon's Second Theorem
(notes [ps.gz,
pdf])
- Nov 23 -- Product Codes
(notes [ps.gz,
pdf])
- Nov 28 -- Lossy Compression and Rate-Distortion
(notes [ps.gz,
pdf])
- Nov 30 -- Erasure Channels, Reed-Solomon and Digital Fountain Codes
(notes [ps.gz,
pdf])
- Dec 1 -- Summary/Review (during tutorial time)
(notes [ps.gz,
pdf])
- Dec 1 -- A4 due
- Dec 5 -- Final Tutorial (during lecture time)
- Dec 7 -- FINAL TEST (during lecture time)
[
Home |
Course Information |
Lecture Schedule/Notes |
Textbook/Readings |
Assignments/Tests |
Computing |
]
CSC310F - Information Theory || www.cs.toronto.edu/~roweis/csc310/
|