Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Video Quality Experts Group: Current Results and Future Directions

Published

Author(s)

A. M. Rohaly, P. Corriveau, John M. Libert, A. Webster, V. Baroncini, J. Beerends, J. L. Blin, L. Contin, T. Hamada, Diane Harrison, A. Hekstra, Jack Lubin, Y. Nishida, R. Ishihara, J Pearson, A. F. Pessoa, N. Pickford, A. Schertz, M. Visca, A. B. Watson, S. Winkler

Abstract

Subjective assessment methods have been used reliably for many years to evaluate video quality. They continue to provide the most reliable assessments compared to objective methods. Some issues that arise with subjective assessment include the cost of conducting the evaluations and the fact that these methods cannot easily be used to monitor video quality in real time. Furthermore, traditional, analog objective methods, while still necessary, are not sufficient to measure the quality of digitally compressed video systems. Thus, there is a need to develop new objective methods utilizing the characteristics of the human visual system. While several new objective methods have been developed, there is to date no internationally standardized method. The Video Quality Experts Group (VQEG) was formed in October 1997 to address video quality issues. The group is composed of experts from various backgrounds and affiliations, including participants from several internationally recognized organizations working in the field of video quality assessment. The majority of participants are active in the International Telecommunications Union (ITU) and VQEG combines the expertise and resources found in several ITU Study Groups to work towards a common goal. The first task undertaken by VQEG was to provide a validation of objective video quality measurement methods leading to Recommendations in both the Telecommunications (ITU-T) and Radiocommunication (ITU-R) sectors of the ITU. To this end, VQEG designed and executed a test program to compare subjective video quality evaluations to the predictions of a number of proposed objective measurement methods for video quality in the bit rate range of 768 kb/s to 50 Mb/s. The results of this test show that there is no objective measurement system that is currently able to replace subjective testing. Depending on the metric used for evaluation, the performance of eight or nine models was found to be statistically equivalent, leading to the c
Proceedings Title
Proc. Intl. Soc. for Optical Engineering (SPIE) 2000 Conference on Visual Communications and Image Processing
Volume
4067
Conference Dates
June 20-23, 2000
Conference Location
Perth, 1, AS

Keywords

double stimulus continuous quality scale, evaluation, International Telecommunications Union, objective measurement, standards, subjective measurement, video quality assessment, video quality experts group, quality metrics

Citation

Rohaly, A. , Corriveau, P. , Libert, J. , Webster, A. , Baroncini, V. , Beerends, J. , Blin, J. , Contin, L. , Hamada, T. , Harrison, D. , Hekstra, A. , Lubin, J. , Nishida, Y. , Ishihara, R. , Pearson, J. , Pessoa, A. , Pickford, N. , Schertz, A. , Visca, M. , Watson, A. and Winkler, S. (2000), Video Quality Experts Group: Current Results and Future Directions, Proc. Intl. Soc. for Optical Engineering (SPIE) 2000 Conference on Visual Communications and Image Processing, Perth, 1, AS, [online], https://tsapps.nist.gov/publication/get_pdf.cfm?pub_id=11847 (Accessed March 28, 2024)
Created December 31, 1999, Updated October 12, 2021