Nonparametric bootstrap methods for interval estimation of the area under the ROC curve for correlated diagnostic test data

dc.contributor.author Pang, Jinji
dc.contributor.committeeMember Liu, Peng
dc.contributor.committeeMember Zhang, Qijing
dc.contributor.majorProfessor Wang, Chong
dc.date.accessioned 2023-01-19T15:25:29Z
dc.date.available 2023-01-19T15:25:29Z
dc.date.copyright 2022
dc.date.issued 2022-12
dc.description.abstract An essential part of contemporary diagnostic research is the development of new diagnostic assays and their performance evaluation. The receiver operating characteristic curve (ROC) and the area under the ROC curve (AUC) are frequently used in evaluating the performance of diagnostic assays. The variation in AUC estimation can be quantified non-parametrically using resampling methods, and then used to construct interval estimation for the AUC. For example, the pROC package is a widely used open-source tool that can calculate interval estimates of the AUC by performing nonparametric bootstrapping. However, when multiple observations are observed from the same subject, which is very common in diagnostic tests evaluation experiments, traditional bootstrap-based methods, such as the one in the pROC package, may fail to provide valid interval estimation of AUC. In particular, the traditional method does not account for the correlation among data observations and would result in interval estimation that does not cover the true AUC at the desired level of confidence. In this paper, we propose two novel methods to calculate the confidence interval of the AUC for correlated diagnostic test data, based on cluster bootstrapping and hierarchical bootstrapping, respectively. Our simulation studies showed that both proposed methods have higher coverage probabilities compared with the existing method when there are intra-subject correlations. We also discuss an application of the proposed methods to the evaluation of a novel whole-virus ELISA diagnostic essay in detection of porcine parainfluenza virus type-1 antibody in swine serum.
dc.identifier.uri https://dr.lib.iastate.edu/handle/20.500.12876/105470
dc.language.iso en_US
dc.rights.holder Jinji Pang
dc.rights.uri https://creativecommons.org/licenses/by/4.0/
dc.subject.disciplines DegreeDisciplines::Physical Sciences and Mathematics::Statistics and Probability
dc.subject.keywords ROC curve
dc.subject.keywords AUC
dc.subject.keywords nonparametric bootstrap methods
dc.subject.keywords correlated data analysis
dc.subject.keywords diagnostic test
dc.subject.keywords pROC package
dc.title Nonparametric bootstrap methods for interval estimation of the area under the ROC curve for correlated diagnostic test data
dc.type Text
dc.type.genre creativecomponent
dspace.entity.type Publication
thesis.degree.department Statistics
thesis.degree.discipline Statistics
thesis.degree.level Masters
thesis.degree.name Master of Science
File
Original bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
ISU-STAT-CC-Jinji Pang.docx
Size:
128.22 KB
Format:
Microsoft Word XML
Description: