Effect of experimental design on the results of clarity-index just-noticeable-difference listening tests

Michelle Celine Vigeant, Robert D. Celmer

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

The just noticeable differences (JND) of room acoustics parameters are useful quantities in design and research, as these values provide a guideline as to when a design change will result in a subjectively noticeable difference. The clarity index for music (C80) JND has been studied previously by Cox et al (1993) and Bradley et al (1999), who found C80 JNDs of 0.7 dB and 0.9 dB, respectively. These studies had limitations in that Cox et al had a relatively small subject pool and Bradley et al's study used speech signals rather than music, as the focus was C50. Two new studies have been conducted to further investigate the C80 JND. In Study 1, 51 musically trained subjects were exposed to a total of 54 AB paired comparisons producing results suggesting a higher JND of 1.6 dB. A pilot study, Study 2, was conducted to compare two testing methods: Test Method 1, which was used in Study 1, required the 11 subjects to listen to all of signal A and then all of signal B before giving a response, while Test Method 2 allowed subjects to switch in real-time between the two signals, as it was hypothesized that Test Method 2 would yield a lower JND similar to previous work. However, this study yielded an even higher C80 JND of 3.8 dB averaged over both test methods. In particular, an interaction effect was found with test method and the order in which the subjects received each test method. The results that most closely matched the predicted trendline were obtained when the subjects completed the first half of the test using Test Method 1 and the second half using Test Method 2. If the first half of the test was considered a training period, then the results in this case from only Test Method 2 gave a C80 JND of 4.4 dB, which was much higher than found in previous work.

Original languageEnglish (US)
Title of host publication20th International Congress on Acoustics 2010, ICA 2010 - Incorporating Proceedings of the 2010 Annual Conference of the Australian Acoustical Society
Pages2567-2573
Number of pages7
Volume4
StatePublished - 2010
Event20th International Congress on Acoustics 2010, ICA 2010 - Incorporating the 2010 Annual Conference of the Australian Acoustical Society - Sydney, NSW, Australia
Duration: Aug 23 2010Aug 27 2010

Other

Other20th International Congress on Acoustics 2010, ICA 2010 - Incorporating the 2010 Annual Conference of the Australian Acoustical Society
CountryAustralia
CitySydney, NSW
Period8/23/108/27/10

Fingerprint

clarity
music
rooms
education
switches

All Science Journal Classification (ASJC) codes

  • Acoustics and Ultrasonics

Cite this

Vigeant, M. C., & Celmer, R. D. (2010). Effect of experimental design on the results of clarity-index just-noticeable-difference listening tests. In 20th International Congress on Acoustics 2010, ICA 2010 - Incorporating Proceedings of the 2010 Annual Conference of the Australian Acoustical Society (Vol. 4, pp. 2567-2573)
Vigeant, Michelle Celine ; Celmer, Robert D. / Effect of experimental design on the results of clarity-index just-noticeable-difference listening tests. 20th International Congress on Acoustics 2010, ICA 2010 - Incorporating Proceedings of the 2010 Annual Conference of the Australian Acoustical Society. Vol. 4 2010. pp. 2567-2573
@inproceedings{cc3ed6bcad8248b7a53880f7250b6f47,
title = "Effect of experimental design on the results of clarity-index just-noticeable-difference listening tests",
abstract = "The just noticeable differences (JND) of room acoustics parameters are useful quantities in design and research, as these values provide a guideline as to when a design change will result in a subjectively noticeable difference. The clarity index for music (C80) JND has been studied previously by Cox et al (1993) and Bradley et al (1999), who found C80 JNDs of 0.7 dB and 0.9 dB, respectively. These studies had limitations in that Cox et al had a relatively small subject pool and Bradley et al's study used speech signals rather than music, as the focus was C50. Two new studies have been conducted to further investigate the C80 JND. In Study 1, 51 musically trained subjects were exposed to a total of 54 AB paired comparisons producing results suggesting a higher JND of 1.6 dB. A pilot study, Study 2, was conducted to compare two testing methods: Test Method 1, which was used in Study 1, required the 11 subjects to listen to all of signal A and then all of signal B before giving a response, while Test Method 2 allowed subjects to switch in real-time between the two signals, as it was hypothesized that Test Method 2 would yield a lower JND similar to previous work. However, this study yielded an even higher C80 JND of 3.8 dB averaged over both test methods. In particular, an interaction effect was found with test method and the order in which the subjects received each test method. The results that most closely matched the predicted trendline were obtained when the subjects completed the first half of the test using Test Method 1 and the second half using Test Method 2. If the first half of the test was considered a training period, then the results in this case from only Test Method 2 gave a C80 JND of 4.4 dB, which was much higher than found in previous work.",
author = "Vigeant, {Michelle Celine} and Celmer, {Robert D.}",
year = "2010",
language = "English (US)",
isbn = "9781617827457",
volume = "4",
pages = "2567--2573",
booktitle = "20th International Congress on Acoustics 2010, ICA 2010 - Incorporating Proceedings of the 2010 Annual Conference of the Australian Acoustical Society",

}

Vigeant, MC & Celmer, RD 2010, Effect of experimental design on the results of clarity-index just-noticeable-difference listening tests. in 20th International Congress on Acoustics 2010, ICA 2010 - Incorporating Proceedings of the 2010 Annual Conference of the Australian Acoustical Society. vol. 4, pp. 2567-2573, 20th International Congress on Acoustics 2010, ICA 2010 - Incorporating the 2010 Annual Conference of the Australian Acoustical Society, Sydney, NSW, Australia, 8/23/10.

Effect of experimental design on the results of clarity-index just-noticeable-difference listening tests. / Vigeant, Michelle Celine; Celmer, Robert D.

20th International Congress on Acoustics 2010, ICA 2010 - Incorporating Proceedings of the 2010 Annual Conference of the Australian Acoustical Society. Vol. 4 2010. p. 2567-2573.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Effect of experimental design on the results of clarity-index just-noticeable-difference listening tests

AU - Vigeant, Michelle Celine

AU - Celmer, Robert D.

PY - 2010

Y1 - 2010

N2 - The just noticeable differences (JND) of room acoustics parameters are useful quantities in design and research, as these values provide a guideline as to when a design change will result in a subjectively noticeable difference. The clarity index for music (C80) JND has been studied previously by Cox et al (1993) and Bradley et al (1999), who found C80 JNDs of 0.7 dB and 0.9 dB, respectively. These studies had limitations in that Cox et al had a relatively small subject pool and Bradley et al's study used speech signals rather than music, as the focus was C50. Two new studies have been conducted to further investigate the C80 JND. In Study 1, 51 musically trained subjects were exposed to a total of 54 AB paired comparisons producing results suggesting a higher JND of 1.6 dB. A pilot study, Study 2, was conducted to compare two testing methods: Test Method 1, which was used in Study 1, required the 11 subjects to listen to all of signal A and then all of signal B before giving a response, while Test Method 2 allowed subjects to switch in real-time between the two signals, as it was hypothesized that Test Method 2 would yield a lower JND similar to previous work. However, this study yielded an even higher C80 JND of 3.8 dB averaged over both test methods. In particular, an interaction effect was found with test method and the order in which the subjects received each test method. The results that most closely matched the predicted trendline were obtained when the subjects completed the first half of the test using Test Method 1 and the second half using Test Method 2. If the first half of the test was considered a training period, then the results in this case from only Test Method 2 gave a C80 JND of 4.4 dB, which was much higher than found in previous work.

AB - The just noticeable differences (JND) of room acoustics parameters are useful quantities in design and research, as these values provide a guideline as to when a design change will result in a subjectively noticeable difference. The clarity index for music (C80) JND has been studied previously by Cox et al (1993) and Bradley et al (1999), who found C80 JNDs of 0.7 dB and 0.9 dB, respectively. These studies had limitations in that Cox et al had a relatively small subject pool and Bradley et al's study used speech signals rather than music, as the focus was C50. Two new studies have been conducted to further investigate the C80 JND. In Study 1, 51 musically trained subjects were exposed to a total of 54 AB paired comparisons producing results suggesting a higher JND of 1.6 dB. A pilot study, Study 2, was conducted to compare two testing methods: Test Method 1, which was used in Study 1, required the 11 subjects to listen to all of signal A and then all of signal B before giving a response, while Test Method 2 allowed subjects to switch in real-time between the two signals, as it was hypothesized that Test Method 2 would yield a lower JND similar to previous work. However, this study yielded an even higher C80 JND of 3.8 dB averaged over both test methods. In particular, an interaction effect was found with test method and the order in which the subjects received each test method. The results that most closely matched the predicted trendline were obtained when the subjects completed the first half of the test using Test Method 1 and the second half using Test Method 2. If the first half of the test was considered a training period, then the results in this case from only Test Method 2 gave a C80 JND of 4.4 dB, which was much higher than found in previous work.

UR - http://www.scopus.com/inward/record.url?scp=84869104982&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84869104982&partnerID=8YFLogxK

M3 - Conference contribution

SN - 9781617827457

VL - 4

SP - 2567

EP - 2573

BT - 20th International Congress on Acoustics 2010, ICA 2010 - Incorporating Proceedings of the 2010 Annual Conference of the Australian Acoustical Society

ER -

Vigeant MC, Celmer RD. Effect of experimental design on the results of clarity-index just-noticeable-difference listening tests. In 20th International Congress on Acoustics 2010, ICA 2010 - Incorporating Proceedings of the 2010 Annual Conference of the Australian Acoustical Society. Vol. 4. 2010. p. 2567-2573