TY - JOUR

T1 - Appropriate Moderated Regression and Inappropriate Research Strategy

T2 - A Demonstration of Information Loss Due to Scale Coarseness

AU - Russell, Craig J.

AU - Pinto, Jeffrey K.

AU - Bobko, Philip

PY - 1991/9

Y1 - 1991/9

N2 - Paunonen and Jackson (1988) demonstrated that stepwise moderated regression provides a test of interaction effects that protects the nominal Type I error rate. However, the stepwise procedure has also been characterized as failing to detect interaction effects in empirical studies. This issue has led to questions regarding the method's statistical power (Bobko, 1986; Zedeck, 1971) in applied research. It is demonstrated that, because of a research strategy frequently used in empirical investigations, the probability of Type II error in detecting a true interaction effect is unknown. Specifically, the number of scale steps used in measuring the dependent variable is shown to result in a form of systematic error that can spuriously increase or decrease the expected effect size of the interaction. The problem is also discussed in the context of testing more complex models. Recommendations for eliminating this problem in future research designs are provided. Index terms: information loss, interaction effects, Likert scales, moderated regression, response transformation.

AB - Paunonen and Jackson (1988) demonstrated that stepwise moderated regression provides a test of interaction effects that protects the nominal Type I error rate. However, the stepwise procedure has also been characterized as failing to detect interaction effects in empirical studies. This issue has led to questions regarding the method's statistical power (Bobko, 1986; Zedeck, 1971) in applied research. It is demonstrated that, because of a research strategy frequently used in empirical investigations, the probability of Type II error in detecting a true interaction effect is unknown. Specifically, the number of scale steps used in measuring the dependent variable is shown to result in a form of systematic error that can spuriously increase or decrease the expected effect size of the interaction. The problem is also discussed in the context of testing more complex models. Recommendations for eliminating this problem in future research designs are provided. Index terms: information loss, interaction effects, Likert scales, moderated regression, response transformation.

UR - http://www.scopus.com/inward/record.url?scp=84970473575&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84970473575&partnerID=8YFLogxK

U2 - 10.1177/014662169101500305

DO - 10.1177/014662169101500305

M3 - Article

AN - SCOPUS:84970473575

SN - 0146-6216

VL - 15

SP - 257

EP - 266

JO - Applied Psychological Measurement

JF - Applied Psychological Measurement

IS - 3

ER -