Estimation of the ROC curve under verification bias

Ronen Fluss, Benjamin Reiser, David Faraggi, Andrea Rotnitzky

Research output: Contribution to journalArticlepeer-review


The ROC (receiver operating characteristic) curve is the most commonly used statistical tool for describing the discriminatory accuracy of a diagnostic test. Classical estimation of the ROC curve relies on data from a simple random sample from the target population. In practice, estimation is often complicated due to not all subjects undergoing a definitive assessment of disease status (verification). Estimation of the ROC curve based on data only from subjects with verified disease status may be badly biased. In this work we investigate the properties of the doubly robust (DR) method for estimating the ROC curve under verification bias originally developed by Rotnitzky, Faraggi and Schisterman (2006) for estimating the area under the ROC curve. The DR method can be applied for continuous scaled tests and allows for a non-ignorable process of selection to verification. We develop the estimator's asymptotic distribution and examine its finite sample properties via a simulation study. We exemplify the DR procedure for estimation of ROC curves with data collected on patients undergoing electron beam computer tomography, a diagnostic test for calcification of the arteries.

Original languageEnglish
Pages (from-to)475-490
Number of pages16
JournalBiometrical Journal
Issue number3
StatePublished - Jul 2009


  • Non-ignorable
  • Semi-parametric model
  • Sensitivity
  • Sensitivity analysis
  • Specificity

ASJC Scopus subject areas

  • Statistics and Probability
  • Statistics, Probability and Uncertainty


Dive into the research topics of 'Estimation of the ROC curve under verification bias'. Together they form a unique fingerprint.

Cite this