A critical review of the S/L reliability index

Hoi K. Suen, Patrick S C Lee, Jane E. Prochnow-LaGrow

Research output: Contribution to journalArticlepeer-review

Abstract

The meaning and properties of a commonly used index of reliability, S/L, were examined critically. It was found that the index does not reflect any conventional concept of reliability. When used for an identical behavioral observation session, it is not statistically correlated with other reliability indices. Within an observation session, the standardizing measure of L is beyond the control of the investigator. Furthermore, the reason for the choice of L as the standard is unclear. The role of chance agreement in S/L is not known. The exact interpretation of the index depends on which observer reports L. Overall the conceptual and mathematical meaning of S/L is dubious. It is suggested that the S/L index should not be used until its nature is shown to be a measure of reliability. Other approaches such as the intraclass correlations and generalizability coefficients should be used instead.

Original languageEnglish (US)
Pages (from-to)277-287
Number of pages11
JournalJournal of Psychopathology and Behavioral Assessment
Volume7
Issue number3
DOIs
StatePublished - Sep 1985

All Science Journal Classification (ASJC) codes

  • Clinical Psychology
  • Psychology(all)

Fingerprint Dive into the research topics of 'A critical review of the S/L reliability index'. Together they form a unique fingerprint.

Cite this