Development and validation of the academic competence evaluation scales

James Clyde Diperna, Stephen N. Elliott

Research output: Contribution to journalArticle

39 Citations (Scopus)

Abstract

The purpose of this study was to clarify the construct of academic competence and develop a valid teacher rating instrument to assess this construct. A 95-item pilot scale, the Academic Competence Evaluation Scales (ACES), was developed to assess the theoretical components (i.e., academic skills, study skills, academic motivation, interpersonal skills, and academic self-concept) hypothesized to contribute to the construct of academic competence. The ACES was administered to 56 teachers who rated 300 students in Grades 1 through 6. To explore convergent and discriminant validity, 13 teachers completed ratings of social skills, problem behaviors, and academic competence (as measured by the Social Skills Rating System; SSRS) for 60 students. In addition, 32 students completed the Iowa Test of Basic Skills (ITBS), a popular measure of academic achievement. Teacher feedback, item Importance ratings, item-ITBS correlations, and the results of an exploratory factor analysis were used to eliminate 35 items from the pilot scale. The resulting 60-item version of the ACES consists of five related scales: Academic Skills, Interpersonal Skills, Academic Motivation, Participation, and Study Skills. Internal consistency (median α = .95) and test-retest stability (median r = .83) were high for the ACES, and correlational analyses indicated that scores from the ACES are valid indicators of student academic competence. Implications for using the ACES are discussed, and suggestions are offered for research necessary to advance the development of the ACES as a reliable and valid clinical tool.

Original languageEnglish (US)
Pages (from-to)207-225
Number of pages19
JournalSchool Effectiveness and School Improvement
Volume17
Issue number3
StatePublished - Sep 1 1999

Fingerprint

evaluation
teacher rating
student
rating
teacher
self-concept
academic achievement
factor analysis
school grade
participation

All Science Journal Classification (ASJC) codes

  • Education

Cite this

@article{c51cc90a0d7b4f9798113620dcf3d72d,
title = "Development and validation of the academic competence evaluation scales",
abstract = "The purpose of this study was to clarify the construct of academic competence and develop a valid teacher rating instrument to assess this construct. A 95-item pilot scale, the Academic Competence Evaluation Scales (ACES), was developed to assess the theoretical components (i.e., academic skills, study skills, academic motivation, interpersonal skills, and academic self-concept) hypothesized to contribute to the construct of academic competence. The ACES was administered to 56 teachers who rated 300 students in Grades 1 through 6. To explore convergent and discriminant validity, 13 teachers completed ratings of social skills, problem behaviors, and academic competence (as measured by the Social Skills Rating System; SSRS) for 60 students. In addition, 32 students completed the Iowa Test of Basic Skills (ITBS), a popular measure of academic achievement. Teacher feedback, item Importance ratings, item-ITBS correlations, and the results of an exploratory factor analysis were used to eliminate 35 items from the pilot scale. The resulting 60-item version of the ACES consists of five related scales: Academic Skills, Interpersonal Skills, Academic Motivation, Participation, and Study Skills. Internal consistency (median α = .95) and test-retest stability (median r = .83) were high for the ACES, and correlational analyses indicated that scores from the ACES are valid indicators of student academic competence. Implications for using the ACES are discussed, and suggestions are offered for research necessary to advance the development of the ACES as a reliable and valid clinical tool.",
author = "Diperna, {James Clyde} and Elliott, {Stephen N.}",
year = "1999",
month = "9",
day = "1",
language = "English (US)",
volume = "17",
pages = "207--225",
journal = "School Effectiveness and School Improvement",
issn = "0924-3453",
publisher = "Routledge",
number = "3",

}

Development and validation of the academic competence evaluation scales. / Diperna, James Clyde; Elliott, Stephen N.

In: School Effectiveness and School Improvement, Vol. 17, No. 3, 01.09.1999, p. 207-225.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Development and validation of the academic competence evaluation scales

AU - Diperna, James Clyde

AU - Elliott, Stephen N.

PY - 1999/9/1

Y1 - 1999/9/1

N2 - The purpose of this study was to clarify the construct of academic competence and develop a valid teacher rating instrument to assess this construct. A 95-item pilot scale, the Academic Competence Evaluation Scales (ACES), was developed to assess the theoretical components (i.e., academic skills, study skills, academic motivation, interpersonal skills, and academic self-concept) hypothesized to contribute to the construct of academic competence. The ACES was administered to 56 teachers who rated 300 students in Grades 1 through 6. To explore convergent and discriminant validity, 13 teachers completed ratings of social skills, problem behaviors, and academic competence (as measured by the Social Skills Rating System; SSRS) for 60 students. In addition, 32 students completed the Iowa Test of Basic Skills (ITBS), a popular measure of academic achievement. Teacher feedback, item Importance ratings, item-ITBS correlations, and the results of an exploratory factor analysis were used to eliminate 35 items from the pilot scale. The resulting 60-item version of the ACES consists of five related scales: Academic Skills, Interpersonal Skills, Academic Motivation, Participation, and Study Skills. Internal consistency (median α = .95) and test-retest stability (median r = .83) were high for the ACES, and correlational analyses indicated that scores from the ACES are valid indicators of student academic competence. Implications for using the ACES are discussed, and suggestions are offered for research necessary to advance the development of the ACES as a reliable and valid clinical tool.

AB - The purpose of this study was to clarify the construct of academic competence and develop a valid teacher rating instrument to assess this construct. A 95-item pilot scale, the Academic Competence Evaluation Scales (ACES), was developed to assess the theoretical components (i.e., academic skills, study skills, academic motivation, interpersonal skills, and academic self-concept) hypothesized to contribute to the construct of academic competence. The ACES was administered to 56 teachers who rated 300 students in Grades 1 through 6. To explore convergent and discriminant validity, 13 teachers completed ratings of social skills, problem behaviors, and academic competence (as measured by the Social Skills Rating System; SSRS) for 60 students. In addition, 32 students completed the Iowa Test of Basic Skills (ITBS), a popular measure of academic achievement. Teacher feedback, item Importance ratings, item-ITBS correlations, and the results of an exploratory factor analysis were used to eliminate 35 items from the pilot scale. The resulting 60-item version of the ACES consists of five related scales: Academic Skills, Interpersonal Skills, Academic Motivation, Participation, and Study Skills. Internal consistency (median α = .95) and test-retest stability (median r = .83) were high for the ACES, and correlational analyses indicated that scores from the ACES are valid indicators of student academic competence. Implications for using the ACES are discussed, and suggestions are offered for research necessary to advance the development of the ACES as a reliable and valid clinical tool.

UR - http://www.scopus.com/inward/record.url?scp=0042208695&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0042208695&partnerID=8YFLogxK

M3 - Article

VL - 17

SP - 207

EP - 225

JO - School Effectiveness and School Improvement

JF - School Effectiveness and School Improvement

SN - 0924-3453

IS - 3

ER -