University of Colorado at Boulder
University of Colorado at Boulder Search A to Z Campus Map CU Search Links
ECE Home

ECEE Courses

Undergraduate
Graduate
Course List
Research
Contact Us

ECEN 5622 - Information Theory and Coding


Catalog Data ECEN 5622 (3). Information Theory and Coding. Entropy rates of information sources, fundamental limits of data compression, Huffman and arithmetic codes; mutual information, fundamental limits of information transmission over noisy communication channels with/without feedback. Selected topics in information storage, lossy data compression, and network information theory.
Credits and Design 3 credit hours. Elective course.
Prerequisite(s) ECEN 3810, Introduction to Probability
Textbook Elements of Information Theory, T.M. Cover and J.A. Thomas, John Wiley, 1991.

Reference: Information Theory and Reliable Communications, R.G. Gallagher.

  
Course Objectives
    To provide an in-depth understanding of various information theoretic limits, including entropy, reciprocity and rate distortion function, and to discuss various applications of information theory.
Topics Covered
  1. Single-user information theory: noiseless source coding; channel coding; noisy source coding (quantization and rate distortion theory); and source-channel coding theorem (separation theorem).
  2. Multi-user information theory: noiseless source coding; channel coding.
  3. Hypothesis testing.
  4. Large deviation theory.

Last revised: 08-02-11, PM, ARP.