Semester I, 2008-2009 (Thursdays 6.30 pm - 8.30 pm, SR3 (COM1 02-12))

Last update: Tuesday, 28-Jul-2009 10:55:45 +08

Table of Contents

• Announcements (last updated 04-11-2008)
• General Information
• Brief Course Outline
• Course Material
• Assignment Information
• Project Information
• Class Schedule
• Frequently Asked Questions

General Information

Lecturer: Mohan S Kankanhalli

Aims and Objectives:

This course aims to develop a critical appreciation of the theoretical background as well as the practical issues of multimedia systems.

Brief Description:

This course lays the foundation for graduate students to do research in multimedia: images, videos, speech, graphics and documents. The module covers the main topics common to various multimedia applications, i.e., multimedia representation, processing, and analysis. By teaching the topics together with the computational tools commonly used in multimedia research, it aims to strike a balance between theoretical considerations and practical applications. Upon completion, the students should be able to understand the theoretical foundation of multimedia processing and analysis, and apply computational tools such as Matlab to the processing and analysis of multimedia data.

Grading information:

Midterm Exam: 15% [open book]
Three Assignments: 45%
Project: 40%

Pre-requisites:

• CS1102 or CS1102C or CS1102S or equivalent
• MA1505 or MA1505C or MA1102R or equivalent
• MA1101R or equivalent
• ST2131 or equivalent

Office consultation hours:

• Mohan Kankanhalli Thu 4pm - 6pm (AS6 #05-06)

<-- Table of Contents

Brief Course Outline

* Introduction to Multimedia Systems (2 hrs)
   Motivation; Fundamentals of Multimedia Signal Processing;
* Multimedia Compression (8 hrs)
    Image Compression (3 hrs): Lossless Compression Principles; Lossy Compression;
    Video Compression (3 hrs): Motion Compensation; Object Coding;
    Audio Compression (2 hrs): Differential Coding; Psycho-acoustics;
* Wireless Multimedia (2 hrs)
   Wireless Transmission Losses; Error Concealment;
* Content-based Retrieval (6 hrs)
   Features; Similarity Measures; Image Retrieval; Video Retrieval; Audio retrieval
* Multimedia Summarization (2 hrs)
   Video Summarization; Multimedia Simplification
* Multimedia Surveillance (2 hrs)
   Background Modeling; Object Tracking; Use of Multiple Sensors
* Multimedia Security (2 hrs)
   Watermarking; Forensics;
* Current Issues & Trends (2 hrs)

<-- Table of Contents

Course Material

For each lecture, I will email the slides to the whole class a few days before the day of that lecture. So please do subscribe to the class mailing list. In order to subscribe to the class mailing list, please send an email to "cs5240-l-request@comp.nus.edu.sg" with the word "subscribe" in the subject line and with no message. Please do this after the semester starts.

<-- Table of Contents

Assignment Information

• Assignment 1 is due on Monday, September 8, 2008.
• Assignment 2 is due on Monday, September 29, 2008.
• Assignment 3 is due on Monday, October 27, 2008.

<-- Table of Contents

Project Information

The details of the project will be posted here:

• Project proposal is due on Monday, August 25, 2008.
• List of Projects. Please check here to see whether your project has been approved. It is considered approved if there is no comment in red.
• The interim project report is due on Monday, October 6, 2008.
• The final project submission is due on Monday, November 17, 2008.

<-- Table of Contents

Class Schedule

7^th Aug (Week 0): Lecture 0: Course Organization and Logistics   Note: No class so please read the online material (in one slide on one page and four slides on one page formats)

• Reading: Lecture 0 slides

14^th Aug (Week 1): Lecture 1: Introduction to Multimedia Systems

• Reading: Quantization; Sampling; Fourier Transform.

21^st Aug (Week 2): Lecture 2: Multimedia Compression I

• Reading: Arithmetic Coding; Wallace's JPEG Tutorial

28^th Aug (Week 3): Lecture 3: Multimedia Compression II

• Reading: JPEG2000 Introduction; Haar Wavelets; MPEG Overview.

30^th Aug (Week 4): Lecture 4: Multimedia Compression III

• Reading: MPEG Paper. 10.00am - 12.00nn @ SR3 (COM1 02-12)   Note: make-up class for September 11^th

4^th Sep (Week 5): Lecture 5: Multimedia Compression IV

• Reading: MP3 Tutorial. It can be obtained from here as well.

18^th Sep (Week 6): Lecture 6: Wireless Multimedia

• Reading:

25^th Sep Semester Break

2^nd Oct (Week 7): Lecture 7: Content-Based Retrieval I

• Reading: Content-based Image Retrieval at the End of the Early Years.

9^th Oct (Week 8): Lecture 8: Content-Based Retrieval II Note: Mid-Term Exam will be conducted just before the class   5.00pm - 6.00pm @ SR1 (COM1 02-06)

• Reading: Applications of Video Content-Analysis and Retrieval.

16^th Oct (Week 9): Lecture 9: Content-Based Retrieval III

• Reading: Melody Curve Processing for Music Retrieval.

18^th Oct (Week 10): Lecture 10: Multimedia Summarization 10.00am - 12.00nn @ SR3 (COM1 02-12)   Note: make-up class for October 30^th

• Reading: Video Summarization using R-Sequences; Compressed Domain Video Summarization; Semantic Video Summarization; Multimedia Simplification.

23^rd Oct (Week 11): Lecture 11: Multimedia Surveillance

• Reading: Tracking Paper, Tracking with Kalman Filtering

6^th Nov (Week 12): Lecture 12: Multimedia Security

• Reading: Content-based Watermarking of Images

13^th Nov (Week 13): Lecture 13: Current Issues & Trends  

<-- Table of Contents

Frequently Asked Questions

Course FAQ

<-- Table of Contents