Skip to main content
EURASIP Journal on Advances in Signal Processing
Download PDF
  • Research Article
  • Open access
  • Published:

Distributed Coding of Highly Correlated Image Sequences with Motion-Compensated Temporal Wavelets

EURASIP Journal on Advances in Signal Processing volume 2006, Article number: 046747 (2006) Cite this article

Abstract

This paper discusses robust coding of visual content for a distributed multimedia system. The system encodes independently two correlated video signals and reconstructs them jointly at a central decoder. The video signals are captured from a dynamic scene, where each signal is robustly coded by a motion-compensated Haar wavelet. The efficiency of the decoder is improved by a disparity analysis of the first image pair of the sequences, followed by disparity compensation of the remaining images of one sequence. We investigate how this scene analysis at the decoder can improve the coding efficiency. At the decoder, one video signal is used as side information to decode efficiently the second video signal. Additional bitrate savings can be obtained with disparity compensation at the decoder. Further, we address the theoretical problem of distributed coding of video signals in the presence of correlated video side information. We utilize a motion-compensated spatiotemporal transform to decorrelate each video signal. For certain assumptions, the optimal motion-compensated spatiotemporal transform for video coding with video side information at high rates is derived. It is shown that the motion-compensated Haar wavelet belongs to this class of transforms. Given the correlation of the video side information, the theoretical bitrate reduction for the distributed coding scheme is investigated. Interestingly, the efficiency of multiview side information is dependent on the level of temporal decorrelation: for a given correlation SNR of the side information, bitrate savings due to side information are decreasing with improved temporal decorrelation.

References

  1. Wyner AD, Ziv J: The rate-distortion function for source coding with side information at the decoder. IEEE Transactions on Information Theory 1976, 22(1):1–10. 10.1109/TIT.1976.1055508

    Article  MathSciNet  Google Scholar 

  2. Flierl M, Vandergheynst P: Distributed coding of dynamic scenes with motion-compensated wavelets. Proceedings of IEEE 6th Workshop on Multimedia Signal Processing (MMSP '04), September 2004, Siena, Italy 315–318.

    Google Scholar 

  3. Pesquet-Popescu B, Bottreau V: Three-dimensional lifting schemes for motion compensated video compression. Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '01), May 2001, Salt Lake City, Utah, USA 3: 1793–1796.

    Google Scholar 

  4. Secker A, Taubman D: Lifting-based invertible motion adaptive transform (LIMAT) framework for highly scalable video compression. IEEE Transactions on Image Processing 2003, 12(12):1530–1542. 10.1109/TIP.2003.819433

    Article  Google Scholar 

  5. Flierl M, Girod B: Video coding with motion-compensated lifted wavelet transforms. Signal Processing: Image Communication 2004, 19(7):561–575. 10.1016/j.image.2004.05.002

    Google Scholar 

  6. Pradhan SS, Ramchandran K: Distributed source coding using syndromes (DISCUS): design and construction. Proceedings of Data Compression Conference (DCC '99), March 1999, Snowbird, Utah, USA 158–167.

    Chapter  Google Scholar 

  7. Pradhan SS, Kusuma J, Ramchandran K: Distributed compression in a dense microsensor network. IEEE Signal Processing Magazine 2002, 19(2):51–60. 10.1109/79.985684

    Article  Google Scholar 

  8. Pradhan SS, Ramchandran K: Distributed source coding using syndromes (DISCUS): design and construction. IEEE Transactions on Information Theory 2003, 49(3):626–643. 10.1109/TIT.2002.808103

    Article  MathSciNet  Google Scholar 

  9. Zamir R, Shamai S, Erez U: Nested linear/lattice codes for structured multiterminal binning. IEEE Transactions on Information Theory 2002, 48(6):1250–1276. 10.1109/TIT.2002.1003821

    Article  MathSciNet  Google Scholar 

  10. Garcia-Frias J: Compression of correlated binary sources using turbo codes. IEEE Communications Letters 2001, 5(10):417–419. 10.1109/4234.957380

    Article  Google Scholar 

  11. Liveris AD, Xiong Z, Georghiades CN: Compression of binary sources with side information at the decoder using LDPC codes. IEEE Communications Letters 2002, 6(10):440–442. 10.1109/LCOMM.2002.804244

    Article  Google Scholar 

  12. Aaron A, Girod B: Compression with side information using turbo codes. Proceedings of Data Compression Conference (DCC '02), April 2002, Snowbird, Utah, USA 252–261.

    Google Scholar 

  13. Zhao Y, Garcia-Frias J: Data compression of correlated non-binary sources using punctured turbo codes. Proceedings of Data Compression Conference (DCC '02), April 2002, Snowbird, Utah, USA 242–251.

    Google Scholar 

  14. Xiong Z, Liveris AD, Cheng S: Distributed source coding for sensor networks. IEEE Signal Processing Magazine 2004, 21(5):80–94. 10.1109/MSP.2004.1328091

    Article  Google Scholar 

  15. Gastpar M, Dragotti PL, Vetterli M: The distributed Karhunen-Loève transform. Proceedings of IEEE Workshop on Multimedia Signal Processing (MMSP '02), December 2002, St.Thomas, Virgin Islands, USA 57–60.

    Google Scholar 

  16. Gastpar M, Dragotti PL, Vetterli M: The distributed, partial, and conditional Karhunen-Loève transforms. Proceedings of Data Compression Conference (DCC '03), March 2003, Snowbird, Utah, USA 283–292.

    Google Scholar 

  17. Gastpar M, Dragotti PL, Vetterli M: On compression using the distributed Karhunen-Loève transform. Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '04), May 2004, Montreal, Quebec, Canada 3: 901–904.

    MATH  Google Scholar 

  18. Gastpar M, Dragotti PL, Vetterli M: The distributed Karhunen-Loève transform. submitted to IEEE Transactions on Information Theory

  19. Rebollo-Monedero D, Aaron A, Girod B: Transforms for high-rate distributed source coding. Proceedings of the 37th Asilomar Conference on Signals, Systems and Computers (ACSSC '03), November 2003, Pacific Grove, Calif, USA 1: 850–854.

    Google Scholar 

  20. Rebollo-Monedero D, Rane SD, Girod B: Wyner-Ziv quantization and transform coding of noisy sources at high rates. Proceedings of the 38th Asilomar Conference on Signals, Systems and Computers (ACSSC '04), November 2004, Pacific Grove, Calif, USA 2: 2084–2088.

    Google Scholar 

  21. Aaron A, Rane SD, Setton E, Girod B: Transform-domain Wyner-Ziv codec for video. Visual Communications and Image Processing (VCIP '04), January 2004, San Jose, Calif, USA, Proceedings of the SPIE 5308: 520–528.

    Google Scholar 

  22. Flierl M: Distributed coding of dynamic scenes. In Tech. Rep. EPFL-ITS-2004.015. Swiss Federal Institute of Technology, Lausanne, Switzerland; January 2004. https://doi.org/lts1pc19.epfl.ch/repository/Flierl2004_780.pdf

    Google Scholar 

  23. Flierl M, Vandergheynst P: Video coding with motion-compensated temporal transforms and side information. Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '05), March 2005, Philadelphia, Pa, USA 5: 921–924. invited paper

    Google Scholar 

  24. Adelson EH, Bergen JR: The plenoptic function and the elements of early vision. In Computational Models of Visual Processing. Edited by: Landy M, Movshon JA. MIT Press, Cambridge, Mass, USA; 1991:3–20.

    Google Scholar 

  25. Gehrig N, Dragotti PL: Distributed compression in camera sensor networks. Proceedings of IEEE 6th Workshop on Multimedia Signal Processing (MMSP '04), September 2004, Siena, Italy 311–314.

    Google Scholar 

  26. Gehrig N, Dragotti PL: Distributed compression of the plenoptic function. Proceedings of IEEE International Conference on Image Processing (ICIP '04), October 2004, Singapor 1: 529–532.

    MATH  Google Scholar 

  27. Pradhan SS, Ramchandran K: Enhancing analog image transmission systems using digital side information: a new wavelet-based image coding paradigm. Proceedings of the Data Compression Conference (DCC '01), March 2001, Snowbird, Utah, USA 63–72.

    Google Scholar 

  28. Girod B, Aaron A, Rane SD, Rebollo-Monedero D: Distributed video coding. Proceedings of the IEEE 2005, 93(1):71–83. invited paper

    Article  Google Scholar 

  29. Zhu X, Aaron A, Girod B: Distributed compression for large camera arrays. Proceedings of IEEE Workshop on Statistical Signal Processing (SSP '03), September 2003, St. Louis, Mo, USA 30–33.

    Google Scholar 

  30. Puri R, Ramchandran K: PRISM: an uplink-friendly multimedia coding paradigm. Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '03), April 2003, Hong Kong, China 4: 856–859.

    Google Scholar 

  31. Aaron A, Zhang R, Girod B: Wyner-Ziv coding of motion video. Proceedings of the 36th Asilomar Conference on Signals, Systems and Computers (ACSSC '02), November 2002, Pacific Grove, Calif, USA 1: 240–244.

    Google Scholar 

  32. Flierl M, Girod B: Video coding with motion compensation for groups of pictures. Proceedings of IEEE International Conference on Image Processing (ICIP '02), September 2002, Rochester, NY, USA 1: 69–72.

    Article  Google Scholar 

  33. Flierl M, Girod B: Video Coding with Superimposed Motion-Compensated Signals: Applications to H.264 and Beyond. Kluwer Academic, Boston, Mass, USA; 2004.

    Google Scholar 

  34. Berger T: Rate Distortion Theory: A Mathematical Basis for Data Compression. Prentice-Hall, Englewood Cliffs, NJ, USA; 1971.

    MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Max Planck Center for Visual Computing and Communication, Stanford University, Stanford, CA, 94305, USA

    Markus Flierl

  2. Signal Processing Institute, Swiss Federal Institute of Technology Lausanne, Lausanne, 1015, Switzerland

    Pierre Vandergheynst

Authors
  1. Markus Flierl
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Pierre Vandergheynst
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Markus Flierl.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 2.0 International License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Flierl, M., Vandergheynst, P. Distributed Coding of Highly Correlated Image Sequences with Motion-Compensated Temporal Wavelets. EURASIP J. Adv. Signal Process. 2006, 046747 (2006). https://doi.org/10.1155/ASP/2006/46747

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1155/ASP/2006/46747

Keywords