Important News

  • Midterm: 2010/04/26
  • Slide Updated: Implementign the LZ-index: Theory versus Pratice
  • Slide Updated: Some Research topics about Huffman Codes

Announcement

  • 2010/02/22 - The ITCT course starts.
  • 2010/03/15 - Homework 1 announced (due:2010/03/29)
  • 2010/04/01 - Homework 2 announced (due:2010/04/19)
  • 2010/04/01 - Midterm: 2010/04/26 "Closed Book"
  • 2010/05/24 - JPEG Homework announced (due:2010/06/07)
  • 2010/06/01 - MPEG Homework announced (due:2010/06/21)

    • Course Information

  • Lecturer: Prof. Ja-Ling Wu (wjl [at] csie.ntu.edu.tw).
  • TA: Yun-Chung Shen(cazindo [at] cmlab.csie.ntu.edu.tw).
  • 程式作業繳交信箱：itct [at] cmlab.csie.ntu.edu.tw

    • Outline

  • Basics of Information Theory
         - Entropy Function, Source Coding Theory.
  • Lossless Compression Techniques
         - Huffman Coding, Arithmetic Coding, LZ-Coding, Predictive Coding.
  • Lossy Compression Techniques
         - Quantization, Transform-coding, Vector-Quantization, Subband coding, Multi-resolution, Perceptual coding.
  • Multimedia Data Compression Techniques
         - Image Compression, Audio Compression, Video Compression.
  • Overview of Coding Standards
         - JPEG, MPEG-1, MPEG-2, MPEG-4, H.26X.

    • Lecture Notes

  • Information Theory
    - What is Information Theory?. (Updated: 2010/02/22)
    - Introduction. (Updated: 2010/02/22)
    - Entropy, Relative Entropy and Mutual Information. (Updated: 2010/02/22)
    - Source Encoder. (Updated: 2010/03/08)
    - Differential Entropy. (Updated: 2010/02/22)
    - The Asymptotic Equipartition Property. (Updated: 2010/02/22)
    - References of Information Theory. (Updated: 2010/02/22)
    - Channel and Channel Capacity - Part 1. (Updated: 2010/02/22)
    - Channel and Channel Capacity - Part 2. (Updated: 2010/02/22)
  • Data Compression
    - Introduction. (Updated: 2008/03/28)
    - Source Coding. (Updated: 2008/03/24)
    - Huffman Codes. (Updated: 2008/04/09)
    - Some Research topics about Huffman Codes. (Updated: 2010/04/19)
    - Arithmetic Coding. (Updated: 2008/04/09)
    - Dictionary Codes and Lempel-Ziv Coding. (Updated: 2006/04/24)
    - Lempel-Ziv Coding. (Updated: 2006/04/17)
    - Implementign the LZ-index: Theory versus Pratice. (Updated: 2010/04/12)
    - Lempel-Ziv Coding: Adaptive Dictionary Compression Algorithm. (Updated: 2008/04/11)
    - Transform Coding. (Updated: 2008/04/22)
    - Discrete Cosine Transform. (Updated: 2007/05/07)
    - Image Data Compression. (Updated: 2006/05/22)
    - Fast Algorithms for the DCT. (Updated: 2002/04/13)
    - Motion Estimation for Video Coding Standards. (Updated: 2006/05/29)
    - An Overview of Video Coding Algorithms. (Updated: 2007/05/14)
  • Reference Data
    - An Introduction to MPEG Video Compression. (Updated: 2002/04/09)
    - DCT reference - 1. (Updated: 2002/05/16)
    - DCT reference - 2. (Updated: 2002/05/16)
    - DCT reference - 3. (Updated: 2002/05/16)
    - Search Algorithms for Block-Matching in Motion Estimation. (Updated: 2002/05/16)
    - Reference at the course of 2006/03/06. (Updated: 2006/03/06)
    - An Overview of Video Compression Algorithms. (Updated: 2006/06/05)
    - Quality Measures for Gray Scale Image Compresion. (Updated: 2006/06/05)
    - Rate Distortion Function and Optimal Bit-allocation. (Updated: 2007/06/04)
    - Integer DCTs and Fast Algorithms. (Updated: 2006/06/05)
    - Video Coding (MPEG-1). (Updated: 2007/05/21)
    - Motion Estimation and Compensation. (Updated: 2008/05/19)
    - Video Coding. (Updated: 2008/06/02)

    • Homework

  • 2010/03/15 - Homework-1 .(Last modified: 2010/03/15)
  • 2010/04/01 - Homework-2 .(Last modified: 2010/04/01)
  • 2010/05/24 - Programming Homework-1, JPEG Baseline Sequential DCT-based Syntax Overview, Testing data, SPEC, Parser.(Last modified: 2010/05/24)
  • 2010/06/01 - Programming Homework-2, MPEG-1 Tutorial Guide, Testing data, SPEC, Parser.(Last modified: 2010/06/01)

    • Grades

    Resource & Reference

  • Thomas M. Cover and Joy A. Thomas, Elements of Information Theory, Second Edition, Wiley & Sons, 2006.
  • Khalid Sayood, Introduction to data compression 2ed, Morgan Kaufmann, 2000.
  • JPEG Standard.
  • MPEG-1 Standard.
  • Darrel Hankerson, Greg A. Harris, and Peter D. Johnson Jr., Introduction to information theory and data compression, CRC, 1998.

    • Home