Selection testing via the Internet: Practical considerations and exploratory empirical findings

Denise Potosky, Philip Bobko

Research output: Contribution to journalArticle

53 Citations (Scopus)

Abstract

Despite a growing body of applied research on using the Internet for some human resource management practices, few studies have provided equivalence information or practical lessons concerning selection testing via the Internet. We identify several issues associated with measurement and validity, the role of several individual characteristics, respondents' reactions and behaviors, and other considerations concerning Internet test administration. We also report results from an exploratory study of the correlation between paper-and-pencil and Internet-administered cognitively oriented selection tests (including timed and untimed, proctored tests). Our empirical results suggest modest degrees of cross-mode equivalence for an untimed situational judgment test (r =.84) and for a timed cognitive ability test (r =.60). Further, some types of items (math, verbal, spatial) in the timed cognitive ability test seem to play a differential role in the reduced cross-mode equivalence. New issues regarding the perception of, and reaction to, items presented via the Internet are presented, and a variety of practical issues are derived and discussed.

Original languageEnglish (US)
Pages (from-to)1003-1034
Number of pages32
JournalPersonnel Psychology
Volume57
Issue number4
DOIs
StatePublished - Dec 1 2004

Fingerprint

Internet
Aptitude
Practice Management
World Wide Web
Testing
Research
Equivalence
Cognitive ability

All Science Journal Classification (ASJC) codes

  • Applied Psychology
  • Organizational Behavior and Human Resource Management

Cite this

@article{a8c92ab30fa247b3b93b9518f65260ff,
title = "Selection testing via the Internet: Practical considerations and exploratory empirical findings",
abstract = "Despite a growing body of applied research on using the Internet for some human resource management practices, few studies have provided equivalence information or practical lessons concerning selection testing via the Internet. We identify several issues associated with measurement and validity, the role of several individual characteristics, respondents' reactions and behaviors, and other considerations concerning Internet test administration. We also report results from an exploratory study of the correlation between paper-and-pencil and Internet-administered cognitively oriented selection tests (including timed and untimed, proctored tests). Our empirical results suggest modest degrees of cross-mode equivalence for an untimed situational judgment test (r =.84) and for a timed cognitive ability test (r =.60). Further, some types of items (math, verbal, spatial) in the timed cognitive ability test seem to play a differential role in the reduced cross-mode equivalence. New issues regarding the perception of, and reaction to, items presented via the Internet are presented, and a variety of practical issues are derived and discussed.",
author = "Denise Potosky and Philip Bobko",
year = "2004",
month = "12",
day = "1",
doi = "10.1111/j.1744-6570.2004.00013.x",
language = "English (US)",
volume = "57",
pages = "1003--1034",
journal = "Personnel Psychology",
issn = "0031-5826",
publisher = "Wiley-Blackwell",
number = "4",

}

Selection testing via the Internet : Practical considerations and exploratory empirical findings. / Potosky, Denise; Bobko, Philip.

In: Personnel Psychology, Vol. 57, No. 4, 01.12.2004, p. 1003-1034.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Selection testing via the Internet

T2 - Practical considerations and exploratory empirical findings

AU - Potosky, Denise

AU - Bobko, Philip

PY - 2004/12/1

Y1 - 2004/12/1

N2 - Despite a growing body of applied research on using the Internet for some human resource management practices, few studies have provided equivalence information or practical lessons concerning selection testing via the Internet. We identify several issues associated with measurement and validity, the role of several individual characteristics, respondents' reactions and behaviors, and other considerations concerning Internet test administration. We also report results from an exploratory study of the correlation between paper-and-pencil and Internet-administered cognitively oriented selection tests (including timed and untimed, proctored tests). Our empirical results suggest modest degrees of cross-mode equivalence for an untimed situational judgment test (r =.84) and for a timed cognitive ability test (r =.60). Further, some types of items (math, verbal, spatial) in the timed cognitive ability test seem to play a differential role in the reduced cross-mode equivalence. New issues regarding the perception of, and reaction to, items presented via the Internet are presented, and a variety of practical issues are derived and discussed.

AB - Despite a growing body of applied research on using the Internet for some human resource management practices, few studies have provided equivalence information or practical lessons concerning selection testing via the Internet. We identify several issues associated with measurement and validity, the role of several individual characteristics, respondents' reactions and behaviors, and other considerations concerning Internet test administration. We also report results from an exploratory study of the correlation between paper-and-pencil and Internet-administered cognitively oriented selection tests (including timed and untimed, proctored tests). Our empirical results suggest modest degrees of cross-mode equivalence for an untimed situational judgment test (r =.84) and for a timed cognitive ability test (r =.60). Further, some types of items (math, verbal, spatial) in the timed cognitive ability test seem to play a differential role in the reduced cross-mode equivalence. New issues regarding the perception of, and reaction to, items presented via the Internet are presented, and a variety of practical issues are derived and discussed.

UR - http://www.scopus.com/inward/record.url?scp=11244292434&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=11244292434&partnerID=8YFLogxK

U2 - 10.1111/j.1744-6570.2004.00013.x

DO - 10.1111/j.1744-6570.2004.00013.x

M3 - Article

AN - SCOPUS:11244292434

VL - 57

SP - 1003

EP - 1034

JO - Personnel Psychology

JF - Personnel Psychology

SN - 0031-5826

IS - 4

ER -