Fidelity issues in secondhand smoking interventions for children

Marilyn Johnson-Kozlow, Melbourne F. Hovell, Liza Rovniak, Laura Sirikulvadhana, Dennis R. Wahlgren, Joy M. Zakarian

Research output: Contribution to journalReview article

17 Scopus citations

Abstract

This paper reviews methodological and theoretical fidelity of secondhand smoking (SHS) intervention studies (n=29) that target protection of children in their home. In 2005, interventions were evaluated in terms of treatment fidelity according to guidelines provided by Borrelli et al. of the National Institutes of Health Behavior Change Consortium. The degree of fidelity was evaluated based on the percentage of criteria met; the inter-rater reliability based on percent agreement across independent raters was 0.78. Analysis indicated that studies with higher treatment fidelity were more likely to obtain statistically significant results (p=.003) with the average fidelity rating of 0.74 for statistically significant studies vs. 0.50 for statistically non-significant studies. Higher treatment fidelity was also significantly associated with being a more recent investigation (year 2000 or later), an efficacy as compared to effectiveness trial, more intensive as compared to less intensive intervention, a trial in the U.S. as compared to foreign nations, and having a theoretical basis. After taking all other variables into account, only treatment fidelity was significantly related to study outcome (p=.052). Ratings of treatment fidelity were ranked and compared to previous rankings based on 342 behavioral change interventions; the rank-ordered correlation between previous and current ratings was 0.84, although median fidelity ratings were 0.10 points lower in the previous than in the present study (0.52 vs. 0.62; intraclass correlation=0.79). Improvements to the treatment fidelity evaluation guidelines were suggested, including the consideration of theoretical fidelity. Enhancing methodological and theoretical fidelity will speed identification of valid theoretical precepts that will, in turn, guide effective public health prevention programs.

Original languageEnglish (US)
Pages (from-to)1677-1690
Number of pages14
JournalNicotine and Tobacco Research
Volume10
Issue number12
DOIs
StatePublished - Dec 5 2008

    Fingerprint

All Science Journal Classification (ASJC) codes

  • Public Health, Environmental and Occupational Health

Cite this

Johnson-Kozlow, M., Hovell, M. F., Rovniak, L., Sirikulvadhana, L., Wahlgren, D. R., & Zakarian, J. M. (2008). Fidelity issues in secondhand smoking interventions for children. Nicotine and Tobacco Research, 10(12), 1677-1690. https://doi.org/10.1080/14622200802443429