EECS 290T: Multimedia Signal Processing, Communications and Networking

Spring 2004

University of California at Berkeley
Dept of Electrical Engineering & Computer Sciences

Announcements   | Administrative Info   | Lecture Notes | Additional Lecture Material | Outline | Materials | Course Reader |
Homework | Papers to read and review


Announcements

Handouts not picked up during lectures can be found with the academic assistant.


Administrative Info

Instructor:   A. Zakhor, Room 507 Cory Hall, 643-6777, avz@eecs.berkeley.edu

Office hours:   Friday, 12:00-1:00pm

Academic Assistant:   Rosita Alvarez, Room 253 Cory Hall, 643-4976, rosita@eecs.berkeley.edu

Course web site:   http://inst.EECS.Berkeley.EDU/~ee290t

Lectures:   Friday, 10:00-12:00.


Lecture Notes and Presentations

Lecture 1:

Overview

Lecture 2:

What is multimedia?
Why compression?

Lecture 3:

Basics of DPCM
Overview of image compression

Lecture 4:

Still Image Compression

Lecture 5:

Multiresolution, Subband, and Wavelet Coding

Lecture 6:

Motion Estimation
Motion Compensation
Basics of Video Coding

Lecture 7:

Video Coding Standards (1)
Video Coding Standards (2)

Lecture 8:

Audio Compression

Lecture 9:

Review of Network Basics
Networking

Lecture 10:

Wavelet Video Coding - Principles, Applications and Standardization

Lecture 11:

Multimedia Networking

Lecture 12:

Rate Control for Streaming Video - from Wired to Wireless

Lecture 13:

Live Streaming and Overlay Multicast


Additional Lecture Material

Quantization, VQ and Entropy Coding

Dictionary Techniques

DPCM, DCT KLT

Pyramid Coding

Fractal, VQ

VQ, Video

Motion Estimation


Outline

Introduction:

What is Multimedia, text, graphics, images, video, animations, sound, 3D, enabling technologies, applications.

Compression:

Quantization theory, Huffman coding, Arithmetic coding, bit allocation, transform coding, sub-band coding, fractal coding, vector quantization, motion estimation, basics of image, video and speech compression algorithms, visual standards JBIG, JPEG, MPEG 1,2,4, audio/speech coding. Advanced compression topics: layered coding, wavelets, zero tree coding, 3D wavelet coding and lifting, multiple description coding; error concealment techniques, error resilient compression techniques.

Networking:

Introduction to IP networks, internt, and networking principles: foundation, layering and protocols, physically connecting hosts, packet switching, internetworking, end to end protocols, end to end data, congestion control; overview of multimedia networking: requirements and performance issues, throughput, error rate, delay, round trip delay, delay variation or jitter, throughput variation; TCP friendly rate control, forward error correction , Automatic Repeat request (ARQ), Quality of Service (QoS), INTegrated SERVices (intserv), RSVP, DIFFerentiated SERVices (difffserv), MPLS, traffic engineering, routing, multipath streaming, distributed streaming, edge architecture, overlay networks, unicast vs. multicast, application level multicast, peer to peer streaming.

Wireless and mobile multimedia networking:

Wireless channel models and streaming protocols; channel adaptation; ad hoc networks and routing; wireless LANs, 802.11


Materials

Y. Wang, J. Ostermann, Y. Zhang, "Video Procesing and Communications", Prentice Hall, 2001

M. Sun and A. Reibman, "Compressed Video over Networks", Marcel Dekker, 2001.

Z. Wang, "Internet QoS", Morgan Kaufman, 2001.

L. Hanzo, P. Cheriman, J. Streit, "Wireless Video Communications", IEEE Press, 2001

K. Ngan, C. Yap, K. Tan, "Video Coding for Wireless Communication Systems", Marcel Dekker, 2001

D. Bull, N. Canagarajah, and A. Nix, "Mobile Multimedia Communications" Academic Press, 1999.

D. Goodman, and D. Raychaudhuri, "Mobile Multimedia Communications", Plenum, 1997.

Khalid Sayood, "Introduction to Data Compression", Morgan Kaufmann Publishers, 1996

A. N. Netravali and Barry G. Haskell, \fIDigital Pictures\fR, Plenum Press, 1995.

J. Gibson, T. Berger, T. Lookabaugh, D. Lindbergh and R. Baker, "Digital Compression for Multimedia" Morgan Kaufman, 1998.

Brad Perry et.al. "Content-Based Access To Multimedia Information From Technology Trends to State of the Art," Kluwer Academic Publishers 1999.

V.S. Subrahmanian. "Principles of Multimedia Database Systems," Morgan Kaufmann Publishers, Inc. 1998.

C. Faloutsos, "Searching Multimedia Databases by Content" Kluwer Academic Publishers, 1996.

P. Schauble, "Multimedia Information Retrieval", Kluwer Academic Publishers, 1997.

F. Fluckiger, "Understanding Networked Multimedia", Prentice Hall, 1995.

R. Steinmetz and K. Nahrstedt, "Multimedia: computing communications and applications" Prentice Hall, 1995.

F. Kuo, W. Effelsberg, and J. J. Garcia-Luna-Aceves, "Multimedia Communications", Prentice Hall, 1998.


Course Reader

EE290T reader


Homework

Each student will choose to do a class project on a mutually agreed upon topic related to multimedia signal processing, communication, or networking. Each class project can have anywhere from 1 to 3 participants. Proposals are due on Friday March 5th Final Project presentations will be on Friday April 30th and May 7th . The report on the final project is due on May 14th. Project will count for 70% of the grade. There will also be in class discussions led by students on papers assigned by the instructor. Participation in class discussions will count 30% towards the grade.


Papers to Read and Review

Streaming Video over the Internet: Approaches and Directions;
Dapeng Wu, Yiwei Thomas Hou, Wenwu Zhu, Ya-Qin Zhang and Jon M. Phea; IEEE CSVT, March 2001, pp. 282-300.

Error Control and Concealment for Video Communication: a Review;
Yao Wang and Qin Fan Zhu; Proceedings of the IEEE, Vol. 86, No. 5, May 1998, pp. 974-997.

Resource Allocation for Multimedia Streaming Over the Internet;
Qian Zhang, Wenwu Zhu and Ya-Qin Zhang; IEEE Transactions on Multimedia, Vol. 3, No. 3, September 2001, pp. 339-355.

QoS-Adaptive Proxy Caching for Multimedia Streaming Over the Internet;
Fang Yu, Qian Zhang Wenwu Zhu, and Ya-Qin Zhang; IEEE Transactions on Circuits and Systems for Video Technology, Vol. 13, No. 3, March 2003, pp. 257-269.

An End to End Adaptable Architecture for Streaming Media over IP Networks;
Kevin Curran and Gerard Parr; Multimedia Tools and Applications, 20, 225-236, 2003.

MPEG-4 and H.263 Video Traces for Network Performance Evaluation;
F.H.P. Fitzek, and M. Reisslein; IEEE Network, Nov./Dec. 2001, pp. 40-53.

Packet Loss Resilient MPEG-4 Compliant Video Coding for the Internet;
F. Le Leannec, F. Toutain, and C. Guillemot; Signal Processing: Image Communication, 15, 1999, pp. 35-56.

Scalable Internet Video Using MPEG-4;
H. Radha, Y. Chen, K. Parthasarathy, and R. Cohen; Ibid., pp. 95-126.

The Internet: A Tutorial;
J. Crowcroft; Electronics &Communication Engineering Journal, June 1996, pp. 113-22.

A Survey on TCP-Friendly Congestion Control;
J. Widmer, R. Denda, and M. Mauve; Ibid. May/June 2001, pp. 28-37.

Congestion Control Mechanisms and the Best Effort Service Model;
P. Gevros, J. Crowcroft, P. Kirstein, and S. Bhatti; IEEE Network, May/June 2001, pp. 16-26.

Adaptive FEC-Based Error Control for Internet Telephony;
Jean-Chrysostome Bolot, Sacha Fosser-Parisis, Don Towsley; IEEE INFOCOM '99', vol. 3, pp. 1453-1460.

A Survey of Packet Loss Recovery Techniques for Streaming Audio;
C. Perkins, O. Hodson, and V. Hardman; IEEE Network, Sept./Oct. 1998, pp. 40-48.

Quality Adaptation for Congestion Controlled Video Playback over the Internet;
Reza Rejaie, Deborah Estrin and Mark Handley; DARPA, Feb. 15, 1999.

RAP: An End-to-end Rate-based Congestion Control Mechanism for Realtime Streams in the Internet;
Reza Rejaie, Mark Handley, Deborah Estrin; DARPA.

Architectural Considerations for Playback of Quality Adaptive Video over the Internet;
Reza Rejaie, Mark Handley, Deborah Estrin; DARPA.

Real-Time Voice Over Packet-Switched Networks;
T.J. Kostas, M.S. Borella, I. Sidhu, G.M. Schuster, J. Grabiec, and J. Mahler; IEEE Network, Jan./Feb. 1998, vol. 12, Issue no. 1, pp. 18-27.

User-Oriented QoS in Packet Video Delivery;
O. Verscheure, X. Garcia, G. Karlsson, and J.-P. Hubaux; IEEE Network, Nov./Dec. 1998, vol. 12, issue 6, pp. 12-21.

Internet QoS: A Big Picture;
X. Xiao, and L.M. Ni, Ibid; Mar./Apr. 1999, vol. 13, Issue 2, pp. 8-18.

QoS-Sensitive Flows: Issues in IP Packet Handling;
S.N. Bhatti, and J. Crowcroft; IEEE Internet Computing, Jul./Aug. 2000, pp. 48-57.

Pricing, Provisioning and Peering: Dynamic Markets for Differentiated Internet Services and Implications for Network Interconnections;
N. Semret, R. R.-F. Liao, A.T. Campbell, and A.A. Lazar; IEEE Journal on Selected Areas in Communications, Vol. 18, No. 12, Dec. 2000.

Quality-of-Service Mapping Mechanism for Packet Video in Differentiated Services Network;
J. Shin, J. Kim, and C.-C.J. Kuo; IEEE Transactions on Multimedia, Vol. 3, No. 2, June 2001.

Aggregation and Conformance in Differentiated Service Networks: A Case Study;
R.A. Guerin and V. Pla; Computer Communication Review, vol.31, no.1, Jan. 2001, pp.21-32. Publisher: ACM, USA.

NetScope: Traffic Engineering for IP Networks;
A. Feldmann, A. Greenberg, C. Lund, N. Reingold, and J. Rexford, IEEE Network, Mar./Apr. 2000, vol. 14, Issue: 2, pp. 11-19.

Capacity Management and Routing Policies for Voice over IP Traffic;
P.P. Mishra, and H. Saran, IEEE Network, Mar/ Apr. 2000, vol. 14, no. 2, pp. 20-27.

Quality-of-Service Routing for Supporting Multimedia Applications;
Z. Wang, and J. Crowcroft, IEEE Journal on Selected Areas in Communications, Vol. 14, No. 7, Sept. 1996.

An Overview of Quality of Service Routing for Next-Generation High-Speed Networks: Problems and Solutions;
S. Chen and K. Nahrstedt, IEEE Network, Nov./Dec. 1998, pp. 64-79.

Video Multicast over the Internet;
X. Li, M.H. Ammar, and S. Paul, IEEE Network, vol. 13, Issue 2, Mar./Apr. 1999, pp. 46-60.

Deployment Issues for the IP Multicast Service and Architecture;
C. Diot, B.N. Levine, B. Lyles, H. Kassem, and D. Balensiefen, IEEE Network, Jan/Feb. 2000, vol. 14, no. 1, pp. 78-88.

Informed Content Delivery Across Adaptive Overlay Networks;
John Byers, Jeffrey Considine, Michael Mitzenmacher, and Stanislav Rost, SIGCOMM ‘02’, Aug. 19-13, 2002, Pittsburgh, PA, copyright 2002 ACM, pp. 1-14. 78-88.

Enabling Conferencing Applications on the Internet using an Overlay Multicast Architecture;
Yang-hua Chu, Sanjay G. Rao, Srinivasan Seshan and Hui Zhang, SIGCOMM ‘01’, August 27-31, 2001, San Diego, CA, copyright 2001 ACM , pp 55-67.

Last Updated 04/19/04