NTIA logo Institute for Telecommunication Sciences (ITS)
spacer
ITS Home Search ITS
spacer
spacer
spacer

NTIA Report TR-10-462

Low Rate Speech Coding and Random Bit Errors: A Subjective Speech Quality Matching Experiment

October 2009

Andrew A. Catellier and Stephen D. Voran

spacer
spacer

Abstract: When bit errors are introduced between a speech encoder and a speech decoder, the quality of the received speech is reduced. The specific relationship between speech quality and bit error rate (BER) can be different for each speech coding and channel coding scheme.

This report describes a subjective experiment concerning the relationships between BER and perceived speech quality for the TIA Project 25 Full Rate (FR), Enhanced Full Rate (EFR), and Enhanced Half Rate (EHR) speech codecs. Using the FR codec with 2 % random bit errors as a reference, we sought to characterize the BER values for which the EFR (or EHR) codec produces speech quality that is equivalent to the reference. We used an adaptive paired-comparison subjective testing algorithm to efficiently adapt BER values for the EFR and EHR codecs to quickly locate the BER values where listeners found the speech quality to be the same as the reference.

The results from sixteen listeners reveal ranges of BER values that were judged to produce speech quality equivalent to the reference. When these ranges are reduced to central values, those values indicate that on average, the EFR and EHR codecs are more robust to bit errors than the FR codec. We provide a set of additional results from a popular objective speech quality estimator for comparison purposes.

Keywords: bit errors, listening tests, speech coding, speech quality, subjective testing

Disclaimer: Certain commercial equipment, components, and software are identified in this report to specify adequately the technical aspects of the reported results. In no case does such identification imply recommendation or endorsement by the National Telecommunications and Information Administration, nor does it imply that the equipment or software identified is necessarily the best available for the particular application or uses.

To request a reprint of this report, contact:
Lilli Segre, Publications Officer
Institute for Telecommunication Sciences
Voice: (303) 497-3572
info@its.bldrdoc.gov

For technical information concerning this report, contact:
Andrew Catellier, Electronics Engineer
Institute for Telecommunication Sciences
Voice: (303) 497-4951
Andrew Catellier@its.bldrdoc.gov

spacer
spacer

ITS Home