This course covers basic and advanced topics related to using computers to support audio and video over a network. Topics specific to multimedia will be selected from areas such as: compression, network protocols, operating systems and human computer interaction. Students will be expected to read assigned research papers and complete several programming intensive projects that illustrate different aspects of multimedia computing. (Prerequisites: CS 502 and CS 513 or the equivalent, and strong programming skills.)
There will be no formal text-book for the course. Instead, chapters selected from several text books and research papers will be copied and made available. Details will be given out on the first day of class.
Some good references for multimedia, network and Windows programming:
Final grades will be computed as follows:
The grading policy for each project will be provided at the time of the assignment. In general, each assignment will have a basic objective for the majority of the assignment points. There may be an extended objective for demonstrating additional work and understanding.
Final grades will reflect the extent to which you have demonstrated understanding of the material, and completed the assigned projects. The base level grade will be a "B" which indicates that the basic objectives on assignments and exams have been met. A grade of "A" will indicate significant achievement beyond the basic objectives and a grade of "C" will indicate not all basic objectives were met, but work was satisfactory for credit. No incomplete grades will be assigned unless there exist exceptional, extenuating circumstances. Similarly, no makeup exams will be given unless there exist exceptional, extenuating circumstances.
Late programs will be be penalized 10% of total assignment value per day (with the weekend counting as one day) or partial day, and no assignments will be accepted after seven days beyond the due date. All programs are due at midnight due date. Programs turned in after that time will be counted late. Projects will be submitted as directed in class. Exceptions to these rules can be made only beforehand.
Cheating ... don't do it. Cheating, either by taking credit for work you did not do or getting unauthorized help on projects or exams, is a serious offense. Punishment is in an automatic F for the course. Note, discussion among students and even sanctioned group work is encouraged, but blatant copying of code is not allowed. When in doubt, ask!
Here is the list of Multimedia topics covered in this course:
Slides from the in-class lectures will be available shortly after they are presented, depending upon how things go. Here is what we have so far:
Admin | ppt | |
Introduction | ppt | |
[RS75] | ppt | |
[Le91] | ppt | |
Experiments | ppt | |
[LHPT95] | ppt | |
[WS00] | ppt | |
[CT99] | ppt | |
[MH00] | ppt | |
[BID02] | ppt | |
[WCZ01] | ppt | |
[SJ95] | ppt | |
[PFOC00] | ppt | |
[FHPW00] | ppt | |
[CZC02] | ppt | |
[PHH98] | ppt | |
[PCM00] | ppt | |
[FB02] | ppt | |
[HKBT01] | ppt | |
[NT02] | ppt | |
[MJV96] | ppt | |
[XMZY97] | ppt | |
Project 1 | ppt | |
Project 1b | ppt | |
Project 2 | ppt | |
Project 2b | ppt | |
Project 3 | ppt | |
Sockets | ppt | |
Review | - | ppt |
The projects (I often call them labs) are the programming assignments you will have for the course. The implementation part of the projects will be done individually. For evaluation, I encourage you to work in groups of 2 for the projects. I'd prefer to limit the groups to only 2, but if you really want a larger group, come talk to me. Working in groups will give you valuable ``real-world'' experience as well as provide you with a ``built-in'' source for help. Do remember, however, that all exams will be taken alone. Make sure each group member understands the programs completely!
You will need to turn in your assignments on-line using turnin.
Project 1: Speech Detection, (Feb 03), (Slides: ppt, pdf), (Grading guide) (playback.exe)
Project 1b: Evaluation of Speech Detection, (Feb 14), (Slides: ppt, pdf), (Grading guide)
Project 2: Speak, (Mar 13), (Slides: ppt, pdf), (Grading guide)
Project 2b: Evaluation of Speak, (Mar 24), (Slides: ppt, pdf), (Grading guide)
In this section are any code samples discussed in class, practice exams or any other demonstration-type class materials. Samples will be updated soon after the discussion in class begins.
You might check out a comparison of Internet audio compression formats for some details on the various compression formats. Includes some sound samples, too.
The SIGMM Home Page, the Special Interest Group for Multimedia from the ACM.
RealNetworks, makers of RealPlayer.
MPEG Tools from the University of California, Berkeley.
Yahoo! Broadcast, audio and video trailers.
mmdump - A Tool for Monitoring Multimedia Usage on the Internet
Tired of Window Media Player and RealNetwork's Real Player? You might try MPlayer, a movie player for LINUX. It plays most MPEG videos, as well as Quicktime, Windows Media, and more.
The Adaptive Video Streaming at MIT.