Institute for Telecommunication Sciences
the research laboratory of the National Telecommunications and Information Administration

Institute for Telecommunication Sciences / Resources / Video Quality Research / Data

Video Quality Research Data


The subjective dataset NTIAcolor is available for download in Microsoft Excel® format or as comma-separated values (CSV) files for Colordatapool1 and Colordatapool2. This dataset is described in conference paper "A missing factor in objective video quality models: a study of color" by Margaret H. Pinson presented at the Ninth International Workshop on Video Processing and Quality Metrics for Consumer Electronics - VPQM 2015, Chandler, AZ, February 5-6, 2015.

Disclaimer: The commercial software program Microsoft Excel® was used to create the spreadsheet containing this dataset for the convenience of the author; such use does not imply recommendation or endorsement by the National Telecommunications and Information Administration, nor does it imply that the software used is necessarily the best available for the particular application or uses.

T1A1 Dataset

The T1A1 subjective dataset was created in 1993-1994 by a subcommittee of the American National Standards Association (ANSI) accredited Alliance for Telecommunications Industry Solutions (ATIS). This dataset contains 625 standard definition, NTSC video sequences. The videos and mean opinion scores (MOS) are available on the Consumer Digital Video Library (CDVL).

See also Margaret H. Pinson and Arthur Webster, "T1A1 Validation Test Database," VQEG eLetter, vol. 1, no. 2, 2015. Available: VQEG_eLetter_vol01_issue2.pdf

its4s Dataset

Its4s is the first in a series of subjective video and image quality experiments designed specifically for no-reference metric development. Its4s was designed as a proof of concept for many novel design choices, including 4 second video sequences, the "skip" rating option, unrepeated scenes, and a few videos where the original production quality is poor or worse. The experiment design and a link to the dataset can be found here.

AGH/NTIA Dataset

Subjective experiment AGH/NTIA includes multiple instances of the same stimuli rated three or six times by the same subject. The goal is to provide insights into the suitability of subject screening methods, the impact of source video reuse on subjective data, and the behavior of subjects when repeatedly rating the same stimuli. The AGH/NTIA dataset was the starting point for innovation into experiments designed around unrepeated scenes (i.e., designs that avoid scene reuse). The experiment design and a link to the dataset can be found here.