Psychometric properties of virtual reality vignette performance measures

A novel approach for assessing adolescents' social competency skills

Mallie J. Paschall, Diana H Fishbein, Robert C. Hubal, Diana Eldreth

Research output: Contribution to journalArticle

17 Citations (Scopus)

Abstract

This study examined the psychometric properties of performance measures for three novel, interactive virtual reality vignette exercises developed to assess social competency skills of at-risk adolescents. Performance data were collected from 117 African-American male 15-17 year olds. Data for 18 performance measures were obtained, based on adolescents' interaction with a provocative virtual teenage character. Twelve of the 18 performance measures loaded on two factors corresponding to emotional control and interpersonal communication skills, providing support for their factorial validity. The internal reliability coefficients for the two multi-item measures were 0.88 and 0.91, respectively. Additional analyses with established measures of three psychosocial factors (beliefs supporting aggression, aggressive conflict-resolution style and hostility) and behavioral criteria (e.g., self-reported behavioral misconduct and drug use) provided limited support for the construct and criterion-related validity of the performance measures. Study findings suggest that the virtual reality vignette exercises may represent a promising approach for assessing adolescents' social competency skills.

Original languageEnglish (US)
Pages (from-to)61-70
Number of pages10
JournalHealth Education Research
Volume20
Issue number1
DOIs
StatePublished - Feb 1 2005

Fingerprint

virtual reality
Psychometrics
psychometrics
adolescent
Exercise
performance
Hostility
Negotiating
Aggression
African Americans
Communication
interpersonal communication
psychosocial factors
Psychology
conflict resolution
communication skills
aggression
drug use
Pharmaceutical Preparations
Social Skills

All Science Journal Classification (ASJC) codes

  • Education
  • Public Health, Environmental and Occupational Health

Cite this

@article{2550ef3d1b424808b8c3fb44f26e4d49,
title = "Psychometric properties of virtual reality vignette performance measures: A novel approach for assessing adolescents' social competency skills",
abstract = "This study examined the psychometric properties of performance measures for three novel, interactive virtual reality vignette exercises developed to assess social competency skills of at-risk adolescents. Performance data were collected from 117 African-American male 15-17 year olds. Data for 18 performance measures were obtained, based on adolescents' interaction with a provocative virtual teenage character. Twelve of the 18 performance measures loaded on two factors corresponding to emotional control and interpersonal communication skills, providing support for their factorial validity. The internal reliability coefficients for the two multi-item measures were 0.88 and 0.91, respectively. Additional analyses with established measures of three psychosocial factors (beliefs supporting aggression, aggressive conflict-resolution style and hostility) and behavioral criteria (e.g., self-reported behavioral misconduct and drug use) provided limited support for the construct and criterion-related validity of the performance measures. Study findings suggest that the virtual reality vignette exercises may represent a promising approach for assessing adolescents' social competency skills.",
author = "Paschall, {Mallie J.} and Fishbein, {Diana H} and Hubal, {Robert C.} and Diana Eldreth",
year = "2005",
month = "2",
day = "1",
doi = "10.1093/her/cyg103",
language = "English (US)",
volume = "20",
pages = "61--70",
journal = "Health Education Research",
issn = "0268-1153",
publisher = "Oxford University Press",
number = "1",

}

Psychometric properties of virtual reality vignette performance measures : A novel approach for assessing adolescents' social competency skills. / Paschall, Mallie J.; Fishbein, Diana H; Hubal, Robert C.; Eldreth, Diana.

In: Health Education Research, Vol. 20, No. 1, 01.02.2005, p. 61-70.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Psychometric properties of virtual reality vignette performance measures

T2 - A novel approach for assessing adolescents' social competency skills

AU - Paschall, Mallie J.

AU - Fishbein, Diana H

AU - Hubal, Robert C.

AU - Eldreth, Diana

PY - 2005/2/1

Y1 - 2005/2/1

N2 - This study examined the psychometric properties of performance measures for three novel, interactive virtual reality vignette exercises developed to assess social competency skills of at-risk adolescents. Performance data were collected from 117 African-American male 15-17 year olds. Data for 18 performance measures were obtained, based on adolescents' interaction with a provocative virtual teenage character. Twelve of the 18 performance measures loaded on two factors corresponding to emotional control and interpersonal communication skills, providing support for their factorial validity. The internal reliability coefficients for the two multi-item measures were 0.88 and 0.91, respectively. Additional analyses with established measures of three psychosocial factors (beliefs supporting aggression, aggressive conflict-resolution style and hostility) and behavioral criteria (e.g., self-reported behavioral misconduct and drug use) provided limited support for the construct and criterion-related validity of the performance measures. Study findings suggest that the virtual reality vignette exercises may represent a promising approach for assessing adolescents' social competency skills.

AB - This study examined the psychometric properties of performance measures for three novel, interactive virtual reality vignette exercises developed to assess social competency skills of at-risk adolescents. Performance data were collected from 117 African-American male 15-17 year olds. Data for 18 performance measures were obtained, based on adolescents' interaction with a provocative virtual teenage character. Twelve of the 18 performance measures loaded on two factors corresponding to emotional control and interpersonal communication skills, providing support for their factorial validity. The internal reliability coefficients for the two multi-item measures were 0.88 and 0.91, respectively. Additional analyses with established measures of three psychosocial factors (beliefs supporting aggression, aggressive conflict-resolution style and hostility) and behavioral criteria (e.g., self-reported behavioral misconduct and drug use) provided limited support for the construct and criterion-related validity of the performance measures. Study findings suggest that the virtual reality vignette exercises may represent a promising approach for assessing adolescents' social competency skills.

UR - http://www.scopus.com/inward/record.url?scp=13144268558&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=13144268558&partnerID=8YFLogxK

U2 - 10.1093/her/cyg103

DO - 10.1093/her/cyg103

M3 - Article

VL - 20

SP - 61

EP - 70

JO - Health Education Research

JF - Health Education Research

SN - 0268-1153

IS - 1

ER -