Verification Bias. An Under-Recognized Source of Error in Assessing the Efficacy of MRI of the Meniscii.

Michael L. Richardson, Jonelle Thomas

Research output: Contribution to journalArticle

11 Citations (Scopus)

Abstract

Rationale and Objectives: The sensitivity and specificity of magnetic resonance imaging (MRI) for diagnosis of meniscal tears has been studied extensively, with tears usually verified by surgery. However, surgically unverified cases are often not considered in these studies, leading to verification bias, which can falsely increase the sensitivity and decrease the specificity estimates. Our study suggests that such bias may be very common in the meniscal MRI literature, and illustrates techniques to detect and correct for such bias. Materials and Methods: PubMed was searched for articles estimating sensitivity and specificity of MRI for meniscal tears. These were assessed for verification bias, deemed potentially present if a study included any patients whose MRI findings were not surgically verified. Retrospective global sensitivity analysis (GSA) was performed when possible. Results: Thirty-nine of the 314 studies retrieved from PubMed specifically dealt with meniscal tears. All 39 included unverified patients, and hence, potential verification bias. Only seven articles included sufficient information to perform GSA. Of these, one showed definite verification bias, two showed no bias, and four others showed bias within certain ranges of disease prevalence. Only 9 of 39 acknowledged the possibility of verification bias. Conclusion: Verification bias is underrecognized and potentially common in published estimates of the sensitivity and specificity of MRI for the diagnosis of meniscal tears. When possible, it should be avoided by proper study design. If unavoidable, it should be acknowledged. Investigators should tabulate unverified as well as verified data. Finally, verification bias should be estimated; if present, corrected estimates of sensitivity and specificity should be used. Our online web-based calculator makes this process relatively easy.

Original languageEnglish (US)
Pages (from-to)1376-1381
Number of pages6
JournalAcademic Radiology
Volume18
Issue number11
DOIs
StatePublished - Nov 1 2011

Fingerprint

Tears
Research Design
Magnetic Resonance Imaging
Sensitivity and Specificity
PubMed
Research Personnel

All Science Journal Classification (ASJC) codes

  • Radiology Nuclear Medicine and imaging

Cite this

@article{f413af7370b645d0a7487317c4405eaf,
title = "Verification Bias. An Under-Recognized Source of Error in Assessing the Efficacy of MRI of the Meniscii.",
abstract = "Rationale and Objectives: The sensitivity and specificity of magnetic resonance imaging (MRI) for diagnosis of meniscal tears has been studied extensively, with tears usually verified by surgery. However, surgically unverified cases are often not considered in these studies, leading to verification bias, which can falsely increase the sensitivity and decrease the specificity estimates. Our study suggests that such bias may be very common in the meniscal MRI literature, and illustrates techniques to detect and correct for such bias. Materials and Methods: PubMed was searched for articles estimating sensitivity and specificity of MRI for meniscal tears. These were assessed for verification bias, deemed potentially present if a study included any patients whose MRI findings were not surgically verified. Retrospective global sensitivity analysis (GSA) was performed when possible. Results: Thirty-nine of the 314 studies retrieved from PubMed specifically dealt with meniscal tears. All 39 included unverified patients, and hence, potential verification bias. Only seven articles included sufficient information to perform GSA. Of these, one showed definite verification bias, two showed no bias, and four others showed bias within certain ranges of disease prevalence. Only 9 of 39 acknowledged the possibility of verification bias. Conclusion: Verification bias is underrecognized and potentially common in published estimates of the sensitivity and specificity of MRI for the diagnosis of meniscal tears. When possible, it should be avoided by proper study design. If unavoidable, it should be acknowledged. Investigators should tabulate unverified as well as verified data. Finally, verification bias should be estimated; if present, corrected estimates of sensitivity and specificity should be used. Our online web-based calculator makes this process relatively easy.",
author = "Richardson, {Michael L.} and Jonelle Thomas",
year = "2011",
month = "11",
day = "1",
doi = "10.1016/j.acra.2011.06.014",
language = "English (US)",
volume = "18",
pages = "1376--1381",
journal = "Academic Radiology",
issn = "1076-6332",
publisher = "Elsevier USA",
number = "11",

}

Verification Bias. An Under-Recognized Source of Error in Assessing the Efficacy of MRI of the Meniscii. / Richardson, Michael L.; Thomas, Jonelle.

In: Academic Radiology, Vol. 18, No. 11, 01.11.2011, p. 1376-1381.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Verification Bias. An Under-Recognized Source of Error in Assessing the Efficacy of MRI of the Meniscii.

AU - Richardson, Michael L.

AU - Thomas, Jonelle

PY - 2011/11/1

Y1 - 2011/11/1

N2 - Rationale and Objectives: The sensitivity and specificity of magnetic resonance imaging (MRI) for diagnosis of meniscal tears has been studied extensively, with tears usually verified by surgery. However, surgically unverified cases are often not considered in these studies, leading to verification bias, which can falsely increase the sensitivity and decrease the specificity estimates. Our study suggests that such bias may be very common in the meniscal MRI literature, and illustrates techniques to detect and correct for such bias. Materials and Methods: PubMed was searched for articles estimating sensitivity and specificity of MRI for meniscal tears. These were assessed for verification bias, deemed potentially present if a study included any patients whose MRI findings were not surgically verified. Retrospective global sensitivity analysis (GSA) was performed when possible. Results: Thirty-nine of the 314 studies retrieved from PubMed specifically dealt with meniscal tears. All 39 included unverified patients, and hence, potential verification bias. Only seven articles included sufficient information to perform GSA. Of these, one showed definite verification bias, two showed no bias, and four others showed bias within certain ranges of disease prevalence. Only 9 of 39 acknowledged the possibility of verification bias. Conclusion: Verification bias is underrecognized and potentially common in published estimates of the sensitivity and specificity of MRI for the diagnosis of meniscal tears. When possible, it should be avoided by proper study design. If unavoidable, it should be acknowledged. Investigators should tabulate unverified as well as verified data. Finally, verification bias should be estimated; if present, corrected estimates of sensitivity and specificity should be used. Our online web-based calculator makes this process relatively easy.

AB - Rationale and Objectives: The sensitivity and specificity of magnetic resonance imaging (MRI) for diagnosis of meniscal tears has been studied extensively, with tears usually verified by surgery. However, surgically unverified cases are often not considered in these studies, leading to verification bias, which can falsely increase the sensitivity and decrease the specificity estimates. Our study suggests that such bias may be very common in the meniscal MRI literature, and illustrates techniques to detect and correct for such bias. Materials and Methods: PubMed was searched for articles estimating sensitivity and specificity of MRI for meniscal tears. These were assessed for verification bias, deemed potentially present if a study included any patients whose MRI findings were not surgically verified. Retrospective global sensitivity analysis (GSA) was performed when possible. Results: Thirty-nine of the 314 studies retrieved from PubMed specifically dealt with meniscal tears. All 39 included unverified patients, and hence, potential verification bias. Only seven articles included sufficient information to perform GSA. Of these, one showed definite verification bias, two showed no bias, and four others showed bias within certain ranges of disease prevalence. Only 9 of 39 acknowledged the possibility of verification bias. Conclusion: Verification bias is underrecognized and potentially common in published estimates of the sensitivity and specificity of MRI for the diagnosis of meniscal tears. When possible, it should be avoided by proper study design. If unavoidable, it should be acknowledged. Investigators should tabulate unverified as well as verified data. Finally, verification bias should be estimated; if present, corrected estimates of sensitivity and specificity should be used. Our online web-based calculator makes this process relatively easy.

UR - http://www.scopus.com/inward/record.url?scp=80053609372&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=80053609372&partnerID=8YFLogxK

U2 - 10.1016/j.acra.2011.06.014

DO - 10.1016/j.acra.2011.06.014

M3 - Article

C2 - 21852159

AN - SCOPUS:80053609372

VL - 18

SP - 1376

EP - 1381

JO - Academic Radiology

JF - Academic Radiology

SN - 1076-6332

IS - 11

ER -