EEC266 – Information Theory And Coding
3 units – Winter Quarter; alternate years
Lecture: 3 hours
Prerequisite: STA 120
Grading: Letter; one midterm exam, on final exam and homework and/or a project.
Information theory and coding. Measure of information. Redundancy reduction encoding of an information source. Capacity of a communication channel, error-free communications.
Expanded Course Description:
Topics are from an introduction to error-correction codes, channel capacity for continuous channels and source coding with a fidelity criterion.
- Information and Sources – The definition of information, the zero memory information source, the Markov information source.
- Properties of Codes – Uniquely decodable codes, prefix codes, conditions for existence, Huffman codes.
- The Coding of Information Sources – The average length of a code, the information rate of a source, compact codes, the redundancy of a code.
- Noisy Channels and Mutual Information – Probability relations in a channel, channel capacity for discrete channels, Channel Coding Theorem.
- N. Abramson, Information Theory and Coding, McGraw-Hill, 1963.
- R. G. Gallager, Information Theory and Reliable Communication, Wiley, 1968.
THIS COURSE DOES NOT DUPLICATE ANY EXISTING COURSE.
Last revised: November 1991