Video Quality Experts Group (VQEG)

No Reference Metrics (NORM)

Mission:

The No Reference (NR) Metrics group (NORM) is an open collaborative for developing NR metrics for monitoring visual service quality. NORM encourages knowledge sharing on all aspects of NR metric research and development. Current projects include:

  1. Open source NR metric
  2. SI and TI clarification and improvement
  3. Video quality metadata standard

Working Methods:

Conference Calls

August 9, 17 CET: SI and TI

Join on your computer or mobile app Click here to join the meeting
Or call in (audio only) +1 719-283-1497,,762517240#   United States, Pueblo, Phone Conference ID: 762 517 240#

August 23, 17 CET: video standard metadata

Click here to join the meeting Or call in (audio only) +1 719-283-1497,,920523031#   United States, Pueblo
Phone Conference ID: 920 523 031#
Find a local number | Reset PIN

September 13, 17 CET: SI and TI

Join on your computer or mobile appClick here to join the meeting
Or call in (audio only) +1 719-283-1497,,366414581#   United States, Pueblo, Phone Conference ID: 366 414 581#
Find a local number | Reset PIN

 

 

#1) NR Metric Development—What Is Our Design Goal?

NR metrics use the decoded video at the point of measurement to estimate:

We seek a broad scope:

Users must be able to modify the scope to ignore specific impairments. For example, broadcasters want MOS to ignore artistic intent and aesthetics. The omitted factors should not influence MOS.

The performance goals are robust accuracy with a minimum of operational restriction. Use cases include Video on Demand (VoD), live broadcast services, social media, first responder video, medical, and AI vision systems (autonomous vehicles). Access to the bitstream is beneficial, but not required.

NORM is an open collaborative group that intends to make all of its work public, royalty free.

Additional Design Specifications

#2) SI and TI Clarification

The ITU-T Rec. P.910 definitions of SI and TI contains ambiguities. Our goal is to eliminate implementation specific inconsistencies. A revised definition would ideally ensure:

Once agreement has been reached, our proposal will be submitted to ITU-T Study Group 12, to revise P.910.

This group is also interest in developing an improved version of SI/TI that assesses the coding complexity of videos. Design specifications include:

Working Documents:

#3) Video Quality Metadata Standard

Audio call minutes here.

Working document is here.

Full reference video quality metrics are readily available in most
modern transcoding pipelines. Including full-reference video quality metrics as metadata in compressed bitstreams would take very little space and provides a more accurate and “green” way of estimating source video quality.

To realize this vision, we must establish a standard format to save such metadata at both elementary video bitstream level and system layer. Both hardware (device) makers and service providers have a lot to gain by offering such metadata in their compressed bitstreams.

NR metrics would still be needed in situations like the following:

 

VQEG is Co-Chaired by: Margaret Pinson, NTIA/ITS and Kjell Brunnström, RISE Research Institute of Sweden AB
The VQEG website is hosted by ITS