Identifying inaccuracies on emergency medicine residency applications

Eric D. Katz, Lee Shockley, Lawrence Kass, David Howes, Janis P. Tupesis, Christopher Weaver, Osman R. Sayan, Victoria Hogan, Jason Begue, Diamond Vrocher, Jackie Frazer, Timothy Evans, Gene Hern, Ralph Riviello, Antonio Rivera, Keith Kinoshita, Edward Ferguson

Research output: Contribution to journalReview article

13 Citations (Scopus)

Abstract

Background: Previous trials have showed a 10-30% rate of inaccuracies on applications to individual residency programs. No studies have attempted to corroborate this on a national level. Attempts by residency programs to diminish the frequency of inaccuracies on applications have not been reported. We seek to clarify the national incidence of inaccuracies on applications to emergency medicine residency programs. Methods: This is a multi-center, single-blinded, randomized, cohort study of all applicants from LCME accredited schools to involved EM residency programs. Applications were randomly selected to investigate claims of AOA election, advanced degrees and publications. Errors were reported to applicants' deans and the NRMP. Results: Nine residencies reviewed 493 applications (28.6% of all applicants who applied to any EM program). 56 applications (11.4%, 95% CI 8.6-14.2%) contained at least one error. Excluding "benign" errors, 9.8% (95% CI 7.2-12.4%), contained at least one error. 41% (95% CI 35.0-47.0%) of all publications contained an error. All AOA membership claims were verified, but 13.7% (95% CI 4.4-23.1%) of claimed advanced degrees were inaccurate. Inter-rater reliability of evaluations was good. Investigators were reluctant to notify applicants' dean's offices and the NRMP. Conclusion: This is the largest study to date of accuracy on application for residency and the first such multi-centered trial. High rates of incorrect data were found on applications. This data will serve as a baseline for future years of the project, with emphasis on reporting inaccuracies and warning applicants of the project's goals.

Original languageEnglish (US)
JournalBMC medical education
Volume5
DOIs
StatePublished - Aug 16 2005

Fingerprint

applicant
medicine
incidence
election
evaluation
school

All Science Journal Classification (ASJC) codes

  • Education

Cite this

Katz, E. D., Shockley, L., Kass, L., Howes, D., Tupesis, J. P., Weaver, C., ... Ferguson, E. (2005). Identifying inaccuracies on emergency medicine residency applications. BMC medical education, 5. https://doi.org/10.1186/1472-6920-5-30
Katz, Eric D. ; Shockley, Lee ; Kass, Lawrence ; Howes, David ; Tupesis, Janis P. ; Weaver, Christopher ; Sayan, Osman R. ; Hogan, Victoria ; Begue, Jason ; Vrocher, Diamond ; Frazer, Jackie ; Evans, Timothy ; Hern, Gene ; Riviello, Ralph ; Rivera, Antonio ; Kinoshita, Keith ; Ferguson, Edward. / Identifying inaccuracies on emergency medicine residency applications. In: BMC medical education. 2005 ; Vol. 5.
@article{0847db6ad40a44628294e5745359f669,
title = "Identifying inaccuracies on emergency medicine residency applications",
abstract = "Background: Previous trials have showed a 10-30{\%} rate of inaccuracies on applications to individual residency programs. No studies have attempted to corroborate this on a national level. Attempts by residency programs to diminish the frequency of inaccuracies on applications have not been reported. We seek to clarify the national incidence of inaccuracies on applications to emergency medicine residency programs. Methods: This is a multi-center, single-blinded, randomized, cohort study of all applicants from LCME accredited schools to involved EM residency programs. Applications were randomly selected to investigate claims of AOA election, advanced degrees and publications. Errors were reported to applicants' deans and the NRMP. Results: Nine residencies reviewed 493 applications (28.6{\%} of all applicants who applied to any EM program). 56 applications (11.4{\%}, 95{\%} CI 8.6-14.2{\%}) contained at least one error. Excluding {"}benign{"} errors, 9.8{\%} (95{\%} CI 7.2-12.4{\%}), contained at least one error. 41{\%} (95{\%} CI 35.0-47.0{\%}) of all publications contained an error. All AOA membership claims were verified, but 13.7{\%} (95{\%} CI 4.4-23.1{\%}) of claimed advanced degrees were inaccurate. Inter-rater reliability of evaluations was good. Investigators were reluctant to notify applicants' dean's offices and the NRMP. Conclusion: This is the largest study to date of accuracy on application for residency and the first such multi-centered trial. High rates of incorrect data were found on applications. This data will serve as a baseline for future years of the project, with emphasis on reporting inaccuracies and warning applicants of the project's goals.",
author = "Katz, {Eric D.} and Lee Shockley and Lawrence Kass and David Howes and Tupesis, {Janis P.} and Christopher Weaver and Sayan, {Osman R.} and Victoria Hogan and Jason Begue and Diamond Vrocher and Jackie Frazer and Timothy Evans and Gene Hern and Ralph Riviello and Antonio Rivera and Keith Kinoshita and Edward Ferguson",
year = "2005",
month = "8",
day = "16",
doi = "10.1186/1472-6920-5-30",
language = "English (US)",
volume = "5",
journal = "BMC Medical Education",
issn = "1472-6920",
publisher = "BioMed Central",

}

Katz, ED, Shockley, L, Kass, L, Howes, D, Tupesis, JP, Weaver, C, Sayan, OR, Hogan, V, Begue, J, Vrocher, D, Frazer, J, Evans, T, Hern, G, Riviello, R, Rivera, A, Kinoshita, K & Ferguson, E 2005, 'Identifying inaccuracies on emergency medicine residency applications', BMC medical education, vol. 5. https://doi.org/10.1186/1472-6920-5-30

Identifying inaccuracies on emergency medicine residency applications. / Katz, Eric D.; Shockley, Lee; Kass, Lawrence; Howes, David; Tupesis, Janis P.; Weaver, Christopher; Sayan, Osman R.; Hogan, Victoria; Begue, Jason; Vrocher, Diamond; Frazer, Jackie; Evans, Timothy; Hern, Gene; Riviello, Ralph; Rivera, Antonio; Kinoshita, Keith; Ferguson, Edward.

In: BMC medical education, Vol. 5, 16.08.2005.

Research output: Contribution to journalReview article

TY - JOUR

T1 - Identifying inaccuracies on emergency medicine residency applications

AU - Katz, Eric D.

AU - Shockley, Lee

AU - Kass, Lawrence

AU - Howes, David

AU - Tupesis, Janis P.

AU - Weaver, Christopher

AU - Sayan, Osman R.

AU - Hogan, Victoria

AU - Begue, Jason

AU - Vrocher, Diamond

AU - Frazer, Jackie

AU - Evans, Timothy

AU - Hern, Gene

AU - Riviello, Ralph

AU - Rivera, Antonio

AU - Kinoshita, Keith

AU - Ferguson, Edward

PY - 2005/8/16

Y1 - 2005/8/16

N2 - Background: Previous trials have showed a 10-30% rate of inaccuracies on applications to individual residency programs. No studies have attempted to corroborate this on a national level. Attempts by residency programs to diminish the frequency of inaccuracies on applications have not been reported. We seek to clarify the national incidence of inaccuracies on applications to emergency medicine residency programs. Methods: This is a multi-center, single-blinded, randomized, cohort study of all applicants from LCME accredited schools to involved EM residency programs. Applications were randomly selected to investigate claims of AOA election, advanced degrees and publications. Errors were reported to applicants' deans and the NRMP. Results: Nine residencies reviewed 493 applications (28.6% of all applicants who applied to any EM program). 56 applications (11.4%, 95% CI 8.6-14.2%) contained at least one error. Excluding "benign" errors, 9.8% (95% CI 7.2-12.4%), contained at least one error. 41% (95% CI 35.0-47.0%) of all publications contained an error. All AOA membership claims were verified, but 13.7% (95% CI 4.4-23.1%) of claimed advanced degrees were inaccurate. Inter-rater reliability of evaluations was good. Investigators were reluctant to notify applicants' dean's offices and the NRMP. Conclusion: This is the largest study to date of accuracy on application for residency and the first such multi-centered trial. High rates of incorrect data were found on applications. This data will serve as a baseline for future years of the project, with emphasis on reporting inaccuracies and warning applicants of the project's goals.

AB - Background: Previous trials have showed a 10-30% rate of inaccuracies on applications to individual residency programs. No studies have attempted to corroborate this on a national level. Attempts by residency programs to diminish the frequency of inaccuracies on applications have not been reported. We seek to clarify the national incidence of inaccuracies on applications to emergency medicine residency programs. Methods: This is a multi-center, single-blinded, randomized, cohort study of all applicants from LCME accredited schools to involved EM residency programs. Applications were randomly selected to investigate claims of AOA election, advanced degrees and publications. Errors were reported to applicants' deans and the NRMP. Results: Nine residencies reviewed 493 applications (28.6% of all applicants who applied to any EM program). 56 applications (11.4%, 95% CI 8.6-14.2%) contained at least one error. Excluding "benign" errors, 9.8% (95% CI 7.2-12.4%), contained at least one error. 41% (95% CI 35.0-47.0%) of all publications contained an error. All AOA membership claims were verified, but 13.7% (95% CI 4.4-23.1%) of claimed advanced degrees were inaccurate. Inter-rater reliability of evaluations was good. Investigators were reluctant to notify applicants' dean's offices and the NRMP. Conclusion: This is the largest study to date of accuracy on application for residency and the first such multi-centered trial. High rates of incorrect data were found on applications. This data will serve as a baseline for future years of the project, with emphasis on reporting inaccuracies and warning applicants of the project's goals.

UR - http://www.scopus.com/inward/record.url?scp=24944591306&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=24944591306&partnerID=8YFLogxK

U2 - 10.1186/1472-6920-5-30

DO - 10.1186/1472-6920-5-30

M3 - Review article

C2 - 16105178

AN - SCOPUS:24944591306

VL - 5

JO - BMC Medical Education

JF - BMC Medical Education

SN - 1472-6920

ER -