- Research Article
- Open access
- Published:
A Method for Single-Stimulus Quality Assessment of Segmented Video
EURASIP Journal on Advances in Signal Processing volume 2006, Article number: 039482 (2006)
Abstract
We present a unified method for single-stimulus quality assessment of segmented video. This method takes into consideration colour and motion features of a moving sequence and monitors their changes across segment boundaries. Features are estimated using a local neighbourhood which preserves the topological integrity of segment boundaries. Furthermore the proposed method addresses the problem of unreliable and/or unavailable feature estimates by applying normalized differential convolution (NDC). Our experimental results suggest that the proposed method outperforms competing methods in terms of sensitivity as well as noise immunity for a variety of standard test sequences.
References
Salembier P, Marques F: Region-based representations of image and video: segmentation tools for multimedia services. IEEE Trans. Circuits Syst. Video Technol. 1999, 9(8):1147–1169. 10.1109/76.809153
Zhang D, Lu G: Segmentation of moving objects in image sequence: a review. Circuits Systems and Signal Processing 2001, 20(2):143–183. 10.1007/BF01201137
Zhang YJ: A survey on evaluation methods for image segmentation. Pattern Recognition 1996, 29(8):1335–1346. 10.1016/0031-3203(95)00169-7
Borsotti M, Campadelli P, Schettini R: Quantitative evaluation of color image segmentation results. Pattern Recognition Letters 1998, 19(8):741–747. 10.1016/S0167-8655(98)00052-X
Zhang X, Wandell BA: Color image fidelity metrics evaluated using image distortion maps. Signal Processing 1998, 70(3):201–214. 10.1016/S0165-1684(98)00125-X
van Dijk AM, Martens J-B: Subjective quality assessment of compressed images. Signal Processing 1997, 58(3):235–252. 10.1016/S0165-1684(97)00026-1
Meesters LMJ, IJsselsteijn WA, Seuntiens PJH: A survey of perceptual quality issues in three-dimensional television systems. Stereoscopic Displays and Virtual Reality Systems X, January 2003, Santa Clara, Calif, USA, Proceedings of SPIE 5006: 313–326.
International Telecommunication Union ITU.R BT.500-11: Methodology for the subjective assessment of the quality of television pictures, 2002
International Telecommunication Union. ITU.R BT.710-4: Subjective assessment methods for image quality in high-definition television, 1998
Pinson MH, Wolf S: Comparing subjective video quality testing methodologies. Visual Communications and Image Processing (VCIP '03), July 2003, Lugano, Switzerland, Proceedings of SPIE 5150: 573–582.
Meesters LMJ, IJsselsteijn WA, Seuntiens PJH: A survey of perceptual evaluations and requirements of three-dimensional TV. IEEE Trans. Circuits Syst. Video Technol. 2004, 14(3):381–391. 10.1109/TCSVT.2004.823398
Cavallaro A, Ebrahimi T: Object-based video: extraction tools, evaluation metrics, and applications. Visual Communications and Image Processing (VCIP '03), July 2003, Lugano, Switzerland, Proceedings of SPIE 5150: 1–8.
Erdem CE, Sankur B, Tekalp AM: Performance measures for video object segmentation and tracking. IEEE Trans. Image Processing 2004, 13(7):937–951. 10.1109/TIP.2004.828427
Erdem CE, Sankur B: Performance evaluation metrics for object-based video segmentation. Proc. 11th European Signal Processing Conference (EUSIPCO '02), September 2002, Toulouse, France 2: 917–920.
Correia P, Pereira F: Objective evaluation of relative segmentation quality. Proc. IEEE International Conference on Image Processing (ICIP '00), September 2000, Vancouver, BC, Canada 1: 308–311.
Cavallaro A, Gelasca ED, Ebrahimi T: Objective evaluation of segmentation quality using spatio-temporal context. Proc. IEEE International Conference on Image Processing (ICIP '02), September 2002, Rochester, NY, USA 3: 301–304.
Villegas P, Marichal X: Perceptually-weighted evaluation criteria for segmentation masks in video sequences. IEEE Trans. Image Processing 2004, 13(8):1092–1103. 10.1109/TIP.2004.828433
Correia PL, Pereira F: Objective evaluation of video segmentation quality. IEEE Trans. Image Processing 2003, 12(2):186–200. 10.1109/TIP.2002.807355
Correia PL, Pereira F: Classification of video segmentation application scenarios. IEEE Trans. Circuits Syst. Video Technol. 2004, 14(5):735–741. 10.1109/TCSVT.2004.826778
Erdem CE, Tekalp AM, Sankur B: Metrics for performance evaluation of video object segmentation and tracking without ground-truth. Proc. IEEE International Conference on Image Processing (ICIP '01), October 2001, Thessaloniki, Greece 2: 69–72.
Knutsson H, Westin C-F: Normalized and differential convolution: methods for interpolation and filtering of incomplete and uncertain data. Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR '93), June 1993, New York, NY, USA 515–523.
Westin C-F, Nordberg K, Knutsson H: On the equivalence of normalized convolution and normalized differential convolution. Proc. IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP '94), April 1994, Adelaide, SA, Australia 5: 457–460.
Westin C-F, Knutsson H: Processing incomplete and uncertain data using subspace methods. Proc. 12th IAPR International Conference on Pattern Recognition, October 1994, Jerusalem, Israel 3: 171–173.
Piroddi R, Petrou M: Dealing with irregular samples. In Advances in Imaging and Electron Physics. Volume 132. Edited by: Hawkes PW. Elsevier, Amsterdam, The Netherlands; 2004:109–165.
Petrou M, Piroddi R, Chandra S: Irregularly Sampled Scenes. Image and Signal Processing for Remote Sensing X, September 2004, Maspalomas, Gran Canaria, Spain, Proceedings of SPIE 5573: 319–333.
Pham TQ, van Vliet LJ: Normalized averaging using adaptive applicability functions with applications in image reconstruction from sparsely and randomly sampled data. Proc. 13th Scandinavian Conference on Image Analysis (SCIA '03), June–July 2003, Halmstad, Sweden, Lecture Notes in Computer Science 2749: 485–492.
Rieger B, van Vliet LJ:Curvature of -dimensional space curves in grey-value images. IEEE Trans. Image Processing 2002, 11(7):738–745. 10.1109/TIP.2002.800885
Black MJ, Fleet DJ, Yacoob Y: Robustly estimating changes in image appearance. Computer Vision and Image Understanding 2000, 78(1):8–31. 10.1006/cviu.1999.0825
Piroddi R: Multiple-feature object-based segmentation of video sequences. Centre for Vision, Speech and Signal Processing, University of Surrey, 2004
Koenen R: From MPEG-1 to MPEG-21: creating an interoperable multimedia infrastructure. International Organisation for Standardisation—Organisation Internationale de Normalisation ISO/IEC JTC1/SC29/WG11 (Coding of Moving Pictures and audio), 2001
Piroddi R, Vlachos T: Multiple-feature segmentation of moving sequences using a rule-based approach. Proc. 13th British Machine Vision Conference (BMVC '02), September 2002, Cardiff , UK 1: 353–362.
Alatan AA, Tuncel E, Onural L: A rule-based method for object segmentation in video sequences. Proc. IEEE International Conference on Image Processing (ICIP '97), October 1997, Santa Barbara, Calif, USA 2: 522–525.
Choi JG, Lee S-W, Kim S-D: Spatio-temporal video segmentation using a joint similarity measure. IEEE Trans. Circuits Syst. Video Technol. 1997, 7(2):279–286. 10.1109/76.564107
Alatan AA, Onural, L, Wollborn M, Mech R, Tuncel E, Sikora T: Image sequence analysis for emerging interactive multimedia services-the European COST 211 framework. IEEE Trans. Circuits Syst. Video Technol. 1998, 8(7):802–813. 10.1109/76.735378
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 2.0 International License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
About this article
Cite this article
Piroddi, R., Vlachos, T. A Method for Single-Stimulus Quality Assessment of Segmented Video. EURASIP J. Adv. Signal Process. 2006, 039482 (2006). https://doi.org/10.1155/ASP/2006/39482
Received:
Revised:
Accepted:
Published:
DOI: https://doi.org/10.1155/ASP/2006/39482