Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Video Quality Experts Group: The Quest for Valid Objective Methods

Published

Author(s)

P. Corriveau, A. Webster, A. M. Rohaly, John M. Libert

Abstract

Subjective assessment methods have been used reliably for many years to evaluate video quality. They continue to provide the most reliable assessments compared to objective methods. Some issues that arise with subjective assessment include the cost of conducting the evaluations and the fact that these methods cannot easily be used to monitor video quality in real time. Furthermore, traditional, analog objective measurements, while still necessary, are not sufficient to measure the quality of digitally compressed video systems. Thus, there is a need to develop new objective methods utilizing the characteristics of the human visual system. While several new objective methods have been developed, there is to date no internationally standardized method. The Video Quality Experts Group (VQEG) was formed in October 1997 to address video quality issues. The group is composed of experts from various backgrounds and affiliations, including participants from several internationally recognized organizations working in the field of video quality assessment. The majority of participants are active in the International Telecommunications Union (ITU) and VQEG combines the expertise and resources found in several ITU Study Groups to work towards a common goal. The first task undertaken by VQEG was to provide a validation of objective video quality measurement methods leading to Recommendations in both the Telecommunications (ITU-T) and Radiocommunication (ITU-R) sectors of the ITU. To this end, VQEG designed and executed a test program to compare subjective video quality evaluations to the predictions of a number of proposed objective measurement methods for video quality in the bit rate range of 768 kb/s to 50 Mb/s. The results of this test show that there is no objective measurement system that is currently able to replace subjective testing. Depending on the metric used for evaluation, the performance of eight or nine models was found to be statistically equivalent, leading to
Proceedings Title
Proc. Intl. Soc. for Optical Engineering (SPIE) Conf. on Human Vision and Electronic Imaging V
Volume
3959
Conference Dates
January 24-27, 2000
Conference Location
San Jose, CA

Keywords

objective measurement, subjective assessment, video quality experts group, International Telecommunications Union, double stimulus continuous quality scale, standards, video quality assessment, quality metrics

Citation

Corriveau, P. , Webster, A. , Rohaly, A. and Libert, J. (2000), Video Quality Experts Group: The Quest for Valid Objective Methods, Proc. Intl. Soc. for Optical Engineering (SPIE) Conf. on Human Vision and Electronic Imaging V, San Jose, CA, [online], https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=21436 (Accessed April 18, 2024)
Created December 31, 1999, Updated October 12, 2021