Announcement

  • 2010/02/22 - The ITCT course starts.
  • 2010/03/15 - Homework 1 announced (due:2010/03/29)
  • Course Information

  • Lecturer: Prof. Ja-Ling Wu (wjl [at] csie.ntu.edu.tw).
  • TA: Yun-Chung Shen(cazindo [at] cmlab.csie.ntu.edu.tw).
    Min-Chun Hu (trimy [at] cmlab.csie.ntu.edu.tw).
  • 程式作業繳交信箱:itct [at] cmlab.csie.ntu.edu.tw
  • Outline

  • Basics of Information Theory
         - Entropy Function, Source Coding Theory.
  • Lossless Compression Techniques
         - Huffman Coding, Arithmetic Coding, LZ-Coding, Predictive Coding.
  • Lossy Compression Techniques
         - Quantization, Transform-coding, Vector-Quantization, Subband coding, Multi-resolution, Perceptual coding.
  • Multimedia Data Compression Techniques
         - Image Compression, Audio Compression, Video Compression.
  • Overview of Coding Standards
         - JPEG, MPEG-1, MPEG-2, MPEG-4, H.26X.
  • Lecture Notes

  • Information Theory
    - What is Information Theory?. (Updated: 2010/02/22)
    - Introduction. (Updated: 2010/02/22)
    - Entropy, Relative Entropy and Mutual Information. (Updated: 2010/02/22)
    - Source Encoder. (Updated: 2010/03/08)
    - Differential Entropy. (Updated: 2010/02/22)
    - The Asymptotic Equipartition Property. (Updated: 2010/02/22)
    - References of Information Theory. (Updated: 2010/02/22)
    - Channel and Channel Capacity - Part 1. (Updated: 2010/02/22)
    - Channel and Channel Capacity - Part 2. (Updated: 2010/02/22)
  • Reference Data
    - An Introduction to MPEG Video Compression. (Updated: 2002/04/09)
    - DCT reference - 1. (Updated: 2002/05/16)
    - DCT reference - 2. (Updated: 2002/05/16)
    - DCT reference - 3. (Updated: 2002/05/16)
    - Search Algorithms for Block-Matching in Motion Estimation. (Updated: 2002/05/16)
    - Reference at the course of 2006/03/06. (Updated: 2006/03/06)
    - An Overview of Video Compression Algorithms. (Updated: 2006/06/05)
    - Quality Measures for Gray Scale Image Compresion. (Updated: 2006/06/05)
    - Rate Distortion Function and Optimal Bit-allocation. (Updated: 2007/06/04)
    - Integer DCTs and Fast Algorithms. (Updated: 2006/06/05)
    - Video Coding (MPEG-1). (Updated: 2007/05/21)
    - Motion Estimation and Compensation. (Updated: 2008/05/19)
    - Video Coding. (Updated: 2008/06/02)
  • Homework

  • 2010/03/15 - Homework-1 .(Last modified: 2010/03/15)
  • Grades

    Resource & Reference

  • Thomas M. Cover and Joy A. Thomas, Elements of Information Theory, Second Edition, Wiley & Sons, 2006.
  • Khalid Sayood, Introduction to data compression 2ed, Morgan Kaufmann, 2000.
  • JPEG Standard.
  • MPEG-1 Standard.
  • Darrel Hankerson, Greg A. Harris, and Peter D. Johnson Jr., Introduction to information theory and data compression, CRC, 1998.
  • Home