Institute for Telecommunication Sciences
the research laboratory of the National Telecommunications and Information Administration

Margaret H. Pinson

Abstract: This paper analyzes the performance of eight no-reference (NR) metrics. Seven assess image quality (BRISQUE, CurveletQA, IL-NIQE, NIQE, OG-IQA, QAC and SSEQ) and one assesses video quality (VIIDEO). The challenge we address in this paper is moving from research silos to a broadly applicable metric. Our analyses use six new subjective datasets that characterize modern cameras and high performing networks. Five datasets were designed around consumer applications and no-reference metric development. The sixth dataset was designed for full-reference metric analyses; we present a technique to modify older datasets for NR metric development. Our analyses show a need for more research and development. The NR metrics were inaccurate for consumer applications.

Keywords: video quality; image quality; no reference (NR); no reference (NR) metric; BRISQUE; CurveletQA; IL-NIQE; NIQE; OG-IQA; QAC; SSEQ; VIIDEO


To request a reprint of this report, contact:

Lilli Segre, Publications Officer
Institute for Telecommunication Sciences
(303) 497-3572
LSegre@ntia.gov

For technical information concerning this report, contact:

Margaret H. Pinson
Institute for Telecommunication Sciences
(303) 497-3579
mpinson@ntia.doc.gov


Disclaimer: Certain commercial equipment, components, and software may be identified in this report to specify adequately the technical aspects of the reported results. In no case does such identification imply recommendation or endorsement by the National Telecommunications and Information Administration, nor does it imply that the equipment or software identified is necessarily the best available for the particular application or uses.

Back to Search Results