Skip to main content
  • Research Article
  • Open access
  • Published:

End-to-End Rate-Distortion Optimized MD Mode Selection for Multiple Description Video Coding

Abstract

Multiple description (MD) video coding can be used to reduce the detrimental effects caused by transmission over lossy packet networks. A number of approaches have been proposed for MD coding, where each provides a different tradeoff between compression efficiency and error resilience. How effectively each method achieves this tradeoff depends on the network conditions as well as on the characteristics of the video itself. This paper proposes an adaptive MD coding approach which adapts to these conditions through the use of adaptive MD mode selection. The encoder in this system is able to accurately estimate the expected end-to-end distortion, accounting for both compression and packet loss-induced distortions, as well as for the bursty nature of channel losses and the effective use of multiple transmission paths. With this model of the expected end-to-end distortion, the encoder selects between MD coding modes in a rate-distortion (R-D) optimized manner to most effectively tradeoff compression efficiency for error resilience. We show how this approach adapts to both the local characteristics of the video and network conditions and demonstrates the resulting gains in performance using an H.264-based adaptive MD video coder.

References

  1. Apostolopoulos JG: Error-resilient video compression through the use of multiple states. Proceedings of IEEE International Conference on Image Processing (ICIP '00) , September 2000, Vancouver, BC, Canada 3: 352–355.

    Article  Google Scholar 

  2. Kim C-S, Lee S-U: Multiple description coding of motion fields for robust video transmission. IEEE Transactions on Circuits and Systems for Video Technology 2001, 11(9):999–1010. 10.1109/76.946517

    Article  Google Scholar 

  3. Reibman AR, Jafarkhani H, Wang Y, Orchard MT: Multiple description video using rate-distortion splitting. Proceedings of IEEE International Conference on Image Processing (ICIP '01), October 2001, Thessaloniki, Greece 1: 978–981.

    Google Scholar 

  4. Reibman AR, Jafarkhani H, Wang Y, Orchard MT, Puri R: Multiple-description video coding using motion-compensated temporal prediction. IEEE Transactions on Circuits and Systems for Video Technology 2002, 12(3):193–204. 10.1109/76.993440

    Article  Google Scholar 

  5. Vaishampayan VA, John S: Balanced interframe multiple description video compression. Proceedings of IEEE International Conference on Image Processing (ICIP '99) , October 1999, Kobe, Japan 3: 812–816.

    Article  Google Scholar 

  6. Wang Y, Lin S: Error-resilient video coding using multiple description motion compensation. IEEE Transactions on Circuits and Systems for Video Technology 2002, 12(6):438–452. 10.1109/TCSVT.2002.800320

    Article  Google Scholar 

  7. Wenger S, Knorr GD, Ott J, Kossentini F: Error resilience support in H.263+. IEEE Transactions on Circuits and Systems for Video Technology 1998, 8(7):867–877. 10.1109/76.735382

    Article  Google Scholar 

  8. Wang Y, Reibman AR, Lin S: Multiple description coding for video delivery. Proceedings of the IEEE 2005, 93(1):57–70.

    Article  Google Scholar 

  9. Heng BA, Lim JS: Multiple-description video coding through adaptive segmentation. Applications of Digital Image Processing XXVII, August 2004, Denver, Colo, USA, Proceedings of SPIE 5558: 105–115.

    Article  Google Scholar 

  10. Heng BA, Apostolopoulos JG, Lim JS: End-to-end rate-distortion optimized mode selection for multiple description video coding. Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP~'05), March 2005, Philadelphia, Pa, USA

    Google Scholar 

  11. Apostolopoulos JG: Reliable video communication over lossy packet networks using multiple state encoding and path diversity. Visual Communications and Image Processing (VCIP '01), January 2001, San Jose, Calif, USA, Proceedings of SPIE 4310: 392–409.

    Google Scholar 

  12. Sullivan GJ, Wiegand T: Rate-distortion optimization for video compression. IEEE Signal Processing Magazine 1998, 15(6):74–90. 10.1109/79.733497

    Article  Google Scholar 

  13. Zhang R, Regunathan SL, Rose K: Video coding with optimal inter/intra-mode switching for packet loss resilience. IEEE Journal on Selected Areas in Communications 2000, 18(6):966–976. 10.1109/49.848250

    Article  Google Scholar 

  14. Côté G, Kossentini F: Optimal intra coding of blocks for robust video communication over the Internet. Signal Processing: Image Communication 1999, 15(1–2):25–34. 10.1016/S0923-5965(99)00022-3

    Google Scholar 

  15. Hinds RO, Pappas TN, Lim JS: Joint block-based video source/channel coding for packet-switched networks. Visual Communications and Image Processing (VCIP '98), January 1998, San Jose, Calif, USA, Proceedings of SPIE 3309: 124–133.

    Article  Google Scholar 

  16. Reibman AR: Optimizing multiple description video coders in a packet loss environment. Proceedings of 12th International Packet Video Workshop (PV '02), April 2002, Pittsburgh, Pa, USA

    Google Scholar 

  17. Apostolopoulos JG, Tan W-T, Wee S, Wornell GW: Modeling path diversity for multiple description video communication. Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '02), May 2002, Orlando, Fla, USA 3: 2161–2164.

    Google Scholar 

  18. Liang YJ, Apostolopoulos JG, Girod B: Analysis of packet loss for compressed video: does burst-length matter? Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP '03), April 2003, Hong Kong 5: 684–687.

    Google Scholar 

  19. Yang H, Rose K: Recursive end-to-end distortion estimation with model-based cross-correlation approximation. Proceeding of IEEE International Conference on Image Processing (ICIP '03) , September 2003, Barcelona, Spain 3: 469–472.

    Google Scholar 

  20. ITU-T Rec. H.264 : Advanced video coding for generic audiovisual services. March 2003.

  21. Stuhlmüller K, Färber N, Link M, Girod B: Analysis of video transmission over lossy channels. IEEE Journal on Selected Areas in Communications 2000, 18(6):1012–1032. 10.1109/49.848253

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Brian A Heng.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 2.0 International License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Heng, B.A., Apostolopoulos, J.G. & Lim, J.S. End-to-End Rate-Distortion Optimized MD Mode Selection for Multiple Description Video Coding. EURASIP J. Adv. Signal Process. 2006, 032592 (2006). https://doi.org/10.1155/ASP/2006/32592

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1155/ASP/2006/32592

Keywords