CSC310 Home
 
Course Information
Lecture Schedule/Notes
Textbook/Readings
Assignments/Tests
Computing
 
Sam Roweis' Homepage
www.cs.toronto.edu/~roweis
 

CSC310F Fall 2006 - Textbook and Other Readings

Textbook

The textbook for the class will be David Mackay's book, Information Theory, Inference and Learning Algorithms.
The book is freely available online at this website.

Readings (tentative list, watch for updates)

  • We will be covering material from Parts I, II, III of the book.
  • Read chapter 1 for Lectures 1,2 and first tutorial.
    The material in chapter 2 may be a helpful review but is not directly part of the course content.
  • Read Chapters 4, 5,6 in Mackay's book. (Lectures 3-11b).
  • Read Chapters 8 and 9 in Mackay's book (starting with Lecture 12).
  • Read Chapters 10,11,47,50 in Mackay's book.

Additional Material

  • Mike Luby's original paper on Digital Fountain codes.
  • A nice review paper on Digital Fountain codes.
  • Here's a link to the Dasher Project homepage. This is the demo I showed in class.
  • Moffat's 1990 paper Implementing PPM, with details about tries, etc.
  • The famous LZ77, and LZ78 papers.
  • The 1988 paper Arithmetic Coding Revisited by Moffat, Neal , Witten is here.
  • The 1987 paper Arithmetic Coding for Data Compression by Witten, Neal, Cleary is here.
  • Shannon's classic paper, A Mathematical Theory of Communication is available here.
  • Huffman's famous 1952 paper, A Method for the Construction of Minimum Redundancy Codes is available here.
  • The notes from a short course given by David Mackay in 1995, out of which his book eventually grew.

[ Home | Course Information | Lecture Schedule/Notes | Textbook/Readings | Assignments/Tests | Computing | ]

CSC310F - Information Theory || www.cs.toronto.edu/~roweis/csc310/