ADSP 404T - Multimedia Codec Development  
 

Indicative contents

  • Audio processing
    Fundamentals of Speech processing, speech representation
    Role of standards, performance measures to evaluate coded speech
    Speech coding fundamentals,
    Waveform based speech coding, G.711 standard, Scalar and vector quantisation, ADPCM ITU G.726, IMA-ADPCM, adaptive transform coding
    Sub-band Transform and Transform coding – ITU G.722 sub-band coder
    Fundamentals of digital audio: Sampling; Dithering; Quantization; psychoacoustic model.
    Basic digital audio processing techniques: Anti-aliasing filtering; Oversampling; Analog-to-digital converion; Dithering; Noise shaping; Digital-to-analog Conversion; Equalisation.
    Digital Audio compression: Critical bands; threshold of hearing; Amplitude masking; Temporal masking; Waveform coding; Perceptual coding; Coding techniques: Subband coding and Transform coding; Codec examples.
    Case Studies: MPEG-1 Layer 3(MP3), AAC, Dolby audio codecs
  • Video processing
    Fundamentals of digital video: Basics of digital video; Digital video formats.
    Basic digital video processing techniques: Motion estimation; Interframe filtering; Motion-compensated filtering; Error concealment.
  • Video coding techniques: Temporal redundancy; Spatial redundancy; Block-based motion estimation and compensation; Coding techniques: Model-based coding, Motion-compensated waveform coding; MPEG-1/2/4, H.264, etc
     

Module Resources

  • Essential reading
    1. Course notes
  • Recommended Reading
    1. Mark Nelson and Jean-Loup Gailly, The Data Compression Book, 2nd edition, M&T Books, New York, 1995.
    2. M. Tekalp, “Digital Video Processing” , Prentice Hall, 1995
    3. Yao Wang, Joern Ostermann, and Ya-Qin Zhang, “Video Processing and Communications” , Prentice Hall, 2002,
    4. B.G. Haskell, A. Puri, and A.N. Netravali,"Digital Video: An Introduction to MPEG-2", Chapman & Hall, 1997
    5. M. Bosi and R. Goldberg, "Introduction to Digital Audio Coding and Standards", Kluwer Academic Publishers 2003