An Innovative Approach to Assessing Depth of Knowledge of Academic Words

Amy C. Crosson, Margaret G. McKeown, Arthur K. Ward

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

The purpose of this research is to develop a vocabulary assessment, Evaluation of Academic Vocabulary or “EAV,” that gauges students’ depth of knowledge of academic words and is sensitive to vocabulary growth in the context of literacy interventions. We report results from two studies with native English-speaking middle school students designed to inform the development and pilot test the utility and technical qualities of an innovative vocabulary assessment that is sensitive to students’ level of understanding of general academic words. Across the two studies, we employed a mixed methods research approach. In the first study, we drew on classic psychometric assessment methods, Bayesian network methods, signal detection theory to evaluate the validity and technical qualities of the assessment. In the latter study, we conducted cognitive interviews to further validate the assessment. Results suggest that: 1) the assessment captures growth in knowledge of general academic words, i.e., words that are important for the comprehension of academic texts; and 2) it is sensitive to treatment effects academic vocabulary intervention for adolescents.

Original languageEnglish (US)
Pages (from-to)196-216
Number of pages21
JournalLanguage Assessment Quarterly
Volume16
Issue number2
DOIs
StatePublished - Mar 15 2019

Fingerprint

vocabulary
student
research approach
psychometrics
speaking
comprehension
literacy
adolescent
interview
evaluation
Vocabulary
Academic Vocabulary

All Science Journal Classification (ASJC) codes

  • Language and Linguistics
  • Linguistics and Language

Cite this

Crosson, Amy C. ; McKeown, Margaret G. ; Ward, Arthur K. / An Innovative Approach to Assessing Depth of Knowledge of Academic Words. In: Language Assessment Quarterly. 2019 ; Vol. 16, No. 2. pp. 196-216.
@article{0d59de7d5db94b9680ad6efc613bd2b7,
title = "An Innovative Approach to Assessing Depth of Knowledge of Academic Words",
abstract = "The purpose of this research is to develop a vocabulary assessment, Evaluation of Academic Vocabulary or “EAV,” that gauges students’ depth of knowledge of academic words and is sensitive to vocabulary growth in the context of literacy interventions. We report results from two studies with native English-speaking middle school students designed to inform the development and pilot test the utility and technical qualities of an innovative vocabulary assessment that is sensitive to students’ level of understanding of general academic words. Across the two studies, we employed a mixed methods research approach. In the first study, we drew on classic psychometric assessment methods, Bayesian network methods, signal detection theory to evaluate the validity and technical qualities of the assessment. In the latter study, we conducted cognitive interviews to further validate the assessment. Results suggest that: 1) the assessment captures growth in knowledge of general academic words, i.e., words that are important for the comprehension of academic texts; and 2) it is sensitive to treatment effects academic vocabulary intervention for adolescents.",
author = "Crosson, {Amy C.} and McKeown, {Margaret G.} and Ward, {Arthur K.}",
year = "2019",
month = "3",
day = "15",
doi = "10.1080/15434303.2019.1612899",
language = "English (US)",
volume = "16",
pages = "196--216",
journal = "Language Assessment Quarterly",
issn = "1543-4303",
publisher = "Routledge",
number = "2",

}

An Innovative Approach to Assessing Depth of Knowledge of Academic Words. / Crosson, Amy C.; McKeown, Margaret G.; Ward, Arthur K.

In: Language Assessment Quarterly, Vol. 16, No. 2, 15.03.2019, p. 196-216.

Research output: Contribution to journalArticle

TY - JOUR

T1 - An Innovative Approach to Assessing Depth of Knowledge of Academic Words

AU - Crosson, Amy C.

AU - McKeown, Margaret G.

AU - Ward, Arthur K.

PY - 2019/3/15

Y1 - 2019/3/15

N2 - The purpose of this research is to develop a vocabulary assessment, Evaluation of Academic Vocabulary or “EAV,” that gauges students’ depth of knowledge of academic words and is sensitive to vocabulary growth in the context of literacy interventions. We report results from two studies with native English-speaking middle school students designed to inform the development and pilot test the utility and technical qualities of an innovative vocabulary assessment that is sensitive to students’ level of understanding of general academic words. Across the two studies, we employed a mixed methods research approach. In the first study, we drew on classic psychometric assessment methods, Bayesian network methods, signal detection theory to evaluate the validity and technical qualities of the assessment. In the latter study, we conducted cognitive interviews to further validate the assessment. Results suggest that: 1) the assessment captures growth in knowledge of general academic words, i.e., words that are important for the comprehension of academic texts; and 2) it is sensitive to treatment effects academic vocabulary intervention for adolescents.

AB - The purpose of this research is to develop a vocabulary assessment, Evaluation of Academic Vocabulary or “EAV,” that gauges students’ depth of knowledge of academic words and is sensitive to vocabulary growth in the context of literacy interventions. We report results from two studies with native English-speaking middle school students designed to inform the development and pilot test the utility and technical qualities of an innovative vocabulary assessment that is sensitive to students’ level of understanding of general academic words. Across the two studies, we employed a mixed methods research approach. In the first study, we drew on classic psychometric assessment methods, Bayesian network methods, signal detection theory to evaluate the validity and technical qualities of the assessment. In the latter study, we conducted cognitive interviews to further validate the assessment. Results suggest that: 1) the assessment captures growth in knowledge of general academic words, i.e., words that are important for the comprehension of academic texts; and 2) it is sensitive to treatment effects academic vocabulary intervention for adolescents.

UR - http://www.scopus.com/inward/record.url?scp=85068757937&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85068757937&partnerID=8YFLogxK

U2 - 10.1080/15434303.2019.1612899

DO - 10.1080/15434303.2019.1612899

M3 - Article

AN - SCOPUS:85068757937

VL - 16

SP - 196

EP - 216

JO - Language Assessment Quarterly

JF - Language Assessment Quarterly

SN - 1543-4303

IS - 2

ER -