TY - JOUR

T1 - Assessing the agreement of biomarker data in the presence of left-censoring

AU - Domthong, Uthumporn

AU - Parikh, Chirag R.

AU - Kimmel, Paul L.

AU - Chinchilli, Vernon

N1 - Funding Information:
UD and VMC are supported by research grant U01DK082183 from the National Institute of Digestive, Diabetes and Kidney Diseases of the National Institutes of Health, U.S. Department of Health and Human Services. CRP is supported by the NIH grant K24DK090203. CRP is also member of the NIH-sponsored Assess, Serial Evaluation, and Subsequent Sequelae in Acute Kidney Injury Consortium (U01DK082185). The views expressed do not necessarily represent the views of the Department of Health and Human Services, the National Institutes of Health, the National Institute of Diabetes, Digestive and Kidney Diseases, or the United States Government. The computing programs from this paper are available from Uthumporn Domthong upon request.
Publisher Copyright:
© 2014Domthong et al.; licensee BioMed Central Ltd.

PY - 2014/9/3

Y1 - 2014/9/3

N2 - Background: In many clinical biomarker studies, Lin's concordance correlation coefficient (CCC) is commonly used to assess the level of agreement of a biomarker measured under two different conditions. However, measurement of a specific biomarker typically cannot provide accurate numerical values below the lower limit of detection (LLD) of the assay, which results in left-censored data. Most researchers discard the data below the LLD or apply simple data imputation methods in the presence of left-censored data, such as replacing values below the LLD with a fixed number less than or equal to the LLD. This is not statistically optimal, because it often leads to biased estimates and overestimates the precision. Methods. We describe a simple method using a bivariate normal distribution in this situation and apply SAS statistical software to arrive at the maximum likelihood (ML) estimate of the parameters and construct the estimate of the CCC. We conduct a computer simulation study to investigate the statistical properties of the ML method versus the data deletion and simple data imputation method. We also contrast the methods with real data using two urine biomarkers, Interleukin 18 and Cystatin C. Results: The computer simulation studies confirm that the ML procedure is superior to the data deletion and simple data imputation procedures. In all of the simulated scenarios, the ML method yields the smallest relative bias and the highest percentage of the 95% confidence intervals that include the true value of the CCC. In the first simulation scenario (sample size of 100 paired data points, 25% left-censoring for both members of the pair, true CCC of 0.238), the relative bias is -1.43% for the ML method, -40.97% for the data deletion method, and it ranges between -12.94% and -21.72% for the simple data imputation methods. Similarly, when the left-censoring for one of the members of the data pairs increases from 25% to 40%, the relative bias displays the same pattern for all methods. Conclusions: When estimating the CCC from paired biomarker data in the presence of left-censored values, the ML method works better than data deletion and simple data imputation methods.

AB - Background: In many clinical biomarker studies, Lin's concordance correlation coefficient (CCC) is commonly used to assess the level of agreement of a biomarker measured under two different conditions. However, measurement of a specific biomarker typically cannot provide accurate numerical values below the lower limit of detection (LLD) of the assay, which results in left-censored data. Most researchers discard the data below the LLD or apply simple data imputation methods in the presence of left-censored data, such as replacing values below the LLD with a fixed number less than or equal to the LLD. This is not statistically optimal, because it often leads to biased estimates and overestimates the precision. Methods. We describe a simple method using a bivariate normal distribution in this situation and apply SAS statistical software to arrive at the maximum likelihood (ML) estimate of the parameters and construct the estimate of the CCC. We conduct a computer simulation study to investigate the statistical properties of the ML method versus the data deletion and simple data imputation method. We also contrast the methods with real data using two urine biomarkers, Interleukin 18 and Cystatin C. Results: The computer simulation studies confirm that the ML procedure is superior to the data deletion and simple data imputation procedures. In all of the simulated scenarios, the ML method yields the smallest relative bias and the highest percentage of the 95% confidence intervals that include the true value of the CCC. In the first simulation scenario (sample size of 100 paired data points, 25% left-censoring for both members of the pair, true CCC of 0.238), the relative bias is -1.43% for the ML method, -40.97% for the data deletion method, and it ranges between -12.94% and -21.72% for the simple data imputation methods. Similarly, when the left-censoring for one of the members of the data pairs increases from 25% to 40%, the relative bias displays the same pattern for all methods. Conclusions: When estimating the CCC from paired biomarker data in the presence of left-censored values, the ML method works better than data deletion and simple data imputation methods.

UR - http://www.scopus.com/inward/record.url?scp=84908394697&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84908394697&partnerID=8YFLogxK

U2 - 10.1186/1471-2369-15-144

DO - 10.1186/1471-2369-15-144

M3 - Article

C2 - 25186769

AN - SCOPUS:84908394697

VL - 15

JO - BMC Nephrology

JF - BMC Nephrology

SN - 1471-2369

IS - 1

M1 - 144

ER -