|
Sign In to gain access to subscriptions and/or personal tools.
|
Statistical Comparison of Two ROC-curve Estimates Obtained from Partially-paired Datasets
Charles E. Metz, PhD
Benjamin A. Herman
Cheryl A. Roe, MS
The authors propose a new generalized method for ROC-curve fitting and statistical testing that allows researchers to utilize all of the data collected in an experimental comparison of two diagnostic modalities, even if some patients have not been studied with both modalities. Their new algorithm, ROCKIT, subsumes previous algorithms as special cases. It conducts all analyses available from previous ROC software and provides 95% confidence intervals for all estimates. ROCKIT was tested on more than half a million computer-simulated datasets of various sizes and configurations repre senting a range of population ROC curves. The algorithm successfully converged for more than 99.8% of all datasets studied. The type I error rates of the new algorithm's statistical test for differences in Az estimates were excellent for datasets typically en countered in practice, but diverged from alpha for datasets arising from some extreme situations. Key words. receiver operating characteristic (ROC) analysis, maximum-like lihood estimation; partially-paired data; missing data. (Med Decis Making 1998;18: 110-121)
Medical Decision Making, Vol. 18, No. 1,
110-121 (1998)
DOI: 10.1177/0272989X9801800118

CiteULike Complore Connotea Del.icio.us Digg Reddit Technorati Twitter What's this?
This article has been cited by other articles:

|
 |

|
 |
 
J. Vikgren, S. Zachrisson, A. Svalkvist, A. A. Johnsson, M. Boijsen, A. Flinck, S. Kheddache, and M. Bath
Comparison of Chest Tomosynthesis and Chest Radiography for Detection of Pulmonary Nodules: Human Observer Study of Clinical Cases
Radiology,
December 1, 2008;
249(3):
1034 - 1041.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
K. Drukker, N. P. Gruszauskas, C. A. Sennett, and M. L. Giger
Breast US Computer-aided Diagnosis Workstation: Performance with a Large Clinical Diagnostic Population
Radiology,
August 1, 2008;
248(2):
392 - 397.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
J. Aittokallio, O. Polo, J. Hiissa, A. Virkki, J. Toikka, O. Raitakari, T. Saaresranta, and T. Aittokallio
Overnight variability in transcutaneous carbon dioxide predicts vascular impairment in women
Exp Physiol,
July 1, 2008;
93(7):
880 - 891.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
E. S. Burnside, T. J. Hall, A. M. Sommer, G. K. Hesley, G. A. Sisney, W. E. Svensson, J. P. Fine, J. Jiang, and N. J. Hangiandreou
Differentiating Benign from Malignant Solid Breast Masses with US Strain Imaging
Radiology,
November 1, 2007;
245(2):
401 - 410.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
O. Matveeva, Y. Nechipurenko, L. Rossi, B. Moore, P. Saetrom, A. Y. Ogurtsov, J. F. Atkins, and S. A. Shabalina
Comparison of approaches for rational siRNA design leading to a new efficient and transparent method
Nucleic Acids Res.,
April 10, 2007;
(2007)
gkm088v1.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
H. Matsuda, S. Mizumura, T. Nagao, T. Ota, T. Iizuka, K. Nemoto, N. Takemura, H. Arai, and A. Homma
Automated Discrimination Between Very Early Alzheimer Disease and Controls Using an Easy Z-Score Imaging System for Multicenter Brain Perfusion Single-Photon Emission Tomography
AJNR Am. J. Neuroradiol.,
April 1, 2007;
28(4):
731 - 736.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
E. S. Burnside, D. L. Rubin, J. P. Fine, R. D. Shachter, G. A. Sisney, and W. K. Leung
Bayesian Network to Predict Breast Cancer Risk of Mammographic Microcalcifications and Reduce Number of Benign Biopsy Results: Initial Experience
Radiology,
September 1, 2006;
240(3):
666 - 673.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
H. J. Lee, K. G. Kim, S. E. Lee, S.-S. Byun, S. I. Hwang, S. I. Jung, S. K. Hong, and S. H. Kim
Role of transrectal ultrasonography in the prediction of prostate cancer: artificial neural network analysis.
J. Ultrasound Med.,
July 1, 2006;
25(7):
815 - 821.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
I. Klem, J. F. Heitner, D. J. Shah, M. H. Sketch Jr, V. Behar, J. Weinsaft, P. Cawley, M. Parker, M. Elliott, R. M. Judd, et al.
Improved Detection of Coronary Artery Disease by Stress Perfusion Cardiovascular Magnetic Resonance With the Use of Delayed Enhancement Infarction Imaging
J. Am. Coll. Cardiol.,
April 18, 2006;
47(8):
1630 - 1638.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
H. Hricak, C. Gatsonis, D. S. Chi, M. A. Amendola, K. Brandt, L. H. Schwartz, S. Koelliker, E. S. Siegelman, J. J. Brown, R. B. McGhee Jr, et al.
Role of Imaging in Pretreatment Evaluation of Early Invasive Cervical Cancer: Results of the Intergroup Study American College of Radiology Imaging Network 6651-Gynecologic Oncology Group 183
J. Clin. Oncol.,
December 20, 2005;
23(36):
9329 - 9337.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
S Kurokawa, Y Arimura, H Yamamoto, Y Adachi, T Endo, T Sato, T Suga, M Hosokawa, Y Shinomura, and K Imai
Tumour matrilysin expression predicts metastatic potential of stage I (pT1) colon and rectal cancers
Gut,
December 1, 2005;
54(12):
1751 - 1758.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
K. Drukker, M. L. Giger, and C. E. Metz
Robustness of Computerized Lesion Detection and Classification Scheme across Different Breast US Platforms
Radiology,
December 1, 2005;
237(3):
834 - 840.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
W. P. Chen, I. Matsunari, A. Noda, D. Yanase, K. Yajima, N. Takeda, M. Yamada, S. Minoshima, and S. Nishimura
Rapid Scanning Protocol for Brain 18F-FDG PET: A Validation Study
J. Nucl. Med.,
October 1, 2005;
46(10):
1633 - 1641.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
O. SAeTROM, O. SNOVE JR., and P. SAeTROM
Weighted sequence motifs as an improved seeding step in microRNA target prediction algorithms
RNA,
July 1, 2005;
11(7):
995 - 1003.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
J. Junger, D. Schellberg, T. Muller-Tasch, G. Raupp, C. Zugck, A. Haunstetter, S. Zipfel, W. Herzog, and M. Haass
Depression increasingly predicts mortality in the course of congestive heart failure
Eur J Heart Fail,
March 2, 2005;
7(2):
261 - 267.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
G. El Fakhri, M. F. Kijewski, M. S. Albert, K. A. Johnson, and S. C. Moore
Quantitative SPECT Leads to Improved Performance in Discrimination Tasks Related to Prodromal Alzheimer's Disease
J. Nucl. Med.,
December 1, 2004;
45(12):
2026 - 2031.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
C. Xiong, D. W. McKeel Jr, J. P. Miller, and J. C. Morris
Combining Correlated Diagnostic Tests: Application to Neuropathologic Diagnosis of Alzheimer's Disease
Med Decis Making,
November 1, 2004;
24(6):
659 - 669.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
S. Graf, M. Gyongyosi, A. Khorsand, S. G. Nekolla, C. Pirich, K. Kletter, R. Dudczak, D. Glogar, G. Porenta, and H. Sochor
Electromechanical Properties of Perfusion/Metabolism Mismatch: Comparison of Nonfluoroscopic Electroanatomic Mapping with 18F-FDG PET
J. Nucl. Med.,
October 1, 2004;
45(10):
1611 - 1618.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
E. Imabayashi, H. Matsuda, T. Asada, T. Ohnishi, S. Sakamoto, S. Nakano, and T. Inoue
Superiority of 3-Dimensional Stereotactic Surface Projection Analysis over Visual Inspection in Discrimination of Patients with Very Early Alzheimer's Disease from Controls Using Brain Perfusion SPECT
J. Nucl. Med.,
September 1, 2004;
45(9):
1450 - 1457.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
G. E. Ross, F. N. Bever, Z. Uddin, L. Devireddy, and J. M. Gardin
Common Scenarios to Clarify the Interpretation of Cardiac Markers
J Am Osteopath Assoc,
April 1, 2004;
104(4):
165 - 176.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
R. L. Wahl, B. A. Siegel, R. E. Coleman, and C. G. Gatsonis
Prospective Multicenter Study of Axillary Nodal Staging by Positron Emission Tomography in Breast Cancer: A Report of the Staging Breast Cancer With PET Study Group
J. Clin. Oncol.,
January 15, 2004;
22(2):
277 - 285.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
T. A. Bley, E. Kotter, U. Saueressig, O. S. Springer, D. Fisch, N. A. Ghanem, and M. Langer
Using Receiver Operating Characteristic Methodology to Evaluate the Diagnostic Quality of Radiography on Paper Prints Versus Film
Am. J. Roentgenol.,
December 1, 2003;
181(6):
1487 - 1490.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
J. M. Miller, V. Dobson, E. M. Harvey, and D. L. Sherrill
Cost-Efficient Vision Screening for Astigmatism in Native American Preschool Children
Invest. Ophthalmol. Vis. Sci.,
September 1, 2003;
44(9):
3756 - 3763.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
R. I. Dorin, C. R. Qualls, and L. M. Crapo
Diagnosis of Adrenal Insufficiency
Ann Intern Med,
August 5, 2003;
139(3):
194 - 204.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
G. Buccheri, P. Torchio, and D. Ferrigno
Clinical Equivalence of Two Cytokeratin Markers in Non-small Cell Lung Cancer: A Study of Tissue Polypeptide Antigen and Cytokeratin 19 Fragments
Chest,
August 1, 2003;
124(2):
622 - 632.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
T. Masui, M. Katayama, S. Kobayashi, S. Shimizu, A. Nozaki, and H. Sakahara
Pseudolesions Related to Uterine Contraction: Characterization with Multiphase-Multisection T2-weighted MR Imaging
Radiology,
May 1, 2003;
227(2):
345 - 352.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
B. Y. Reis, M. Pagano, and K. D. Mandl
Using temporal context to improve biosurveillance
PNAS,
February 18, 2003;
100(4):
1961 - 1965.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
Z. Huo, M. L. Giger, O. I. Olopade, D. E. Wolverton, B. L. Weber, C. E. Metz, W. Zhong, and S. A. Cummings
Computerized Analysis of Digitized Mammograms of BRCA1 and BRCA2 Gene Mutation Carriers
Radiology,
November 1, 2002;
225(2):
519 - 526.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
J. G. Jarvik, E. Yuen, D. R. Haynor, C. M. Bradley, D. Fulton-Kehoe, T. Smith-Weller, R. Wu, M. Kliot, G. Kraft, L. Wang, et al.
MR nerve imaging in a prospective cohort of patients with suspected carpal tunnel syndrome
Neurology,
June 11, 2002;
58(11):
1597 - 1602.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
A. S. Arbab, S. Aoki, K. Toyama, N. Miyazawa, H. Kumagai, T. Umeda, T. Arai, T. Araki, H. Kabasawa, and Y. Takahashi
Quantitative Measurement of Regional Cerebral Blood Flow with Flow-Sensitive Alternating Inversion Recovery Imaging: Comparison with [Iodine 123]-Iodoamphetamin Single Photon Emission CT
AJNR Am. J. Neuroradiol.,
March 1, 2002;
23(3):
381 - 388.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
N. Okamura, H. Arai, M. Maruyama, M. Higuchi, T. Matsui, H. Tanji, T. Seki, H. Hirai, H. Chiba, M. Itoh, et al.
Combined Analysis of CSF Tau Levels and [123I]Iodoamphetamine SPECT in Mild Cognitive Impairment: Implications for a Novel Predictor of Alzheimer's Disease
Am J Psychiatry,
March 1, 2002;
159(3):
474 - 476.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
R. Kell, A. Haunstetter, T.J. Dengler, C. Zugck, W. Kubler, and M. Haass
Do cytokines enable risk stratification to be improved in NYHA functional class III patients?. Comparison with other potential predictors of prognosis
Eur. Heart J.,
January 1, 2002;
23(1):
70 - 78.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
J. L. Corchero, E.-C. Mar, T. J. Spira, P. E. Pellett, and N. Inoue
Comparison of Serologic Assays for Detection of Antibodies against Human Herpesvirus 8
Clin. Vaccine Immunol.,
September 1, 2001;
8(5):
913 - 921.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
M. Gyongyosi, H. Sochor, A. Khorsand, L. Gepstein, and D. Glogar
Online Myocardial Viability Assessment in the Catheterization Laboratory via NOGA Electroanatomic Mapping: Quantitative Comparison With Thallium-201 Uptake
Circulation,
August 28, 2001;
104(9):
1005 - 1011.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
J. M. Miller, V. Dobson, E. M. Harvey, and D. L. Sherrill
Comparison of Preschool Vision Screening Methods in a Population with a High Prevalence of Astigmatism
Invest. Ophthalmol. Vis. Sci.,
April 1, 2001;
42(5):
917 - 924.
[Abstract]
[Full Text]
|
 |
|

|
 |

|
 |
 
C. A. Santana, E. V. Garcia, J. P. Vansant, E. G. Krawczynska, R. D. Folks, C. D. Cooke, and T. L. Faber
Three-Dimensional Color-Modulated Display of Myocardial SPECT Perfusion Distributions Accurately Assesses Coronary Artery Disease
J. Nucl. Med.,
December 1, 2000;
41(12):
1941 - 1946.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
W. F. Good, J. H. Sumkin, M. Ganott, L. Hardesty, B. Holbert, C. M. Johns, and A. H. Klym
Detection of Masses and Clustered Microcalcifications on Data Compressed Mammograms: An Observer Performance Study
Am. J. Roentgenol.,
December 1, 2000;
175(6):
1573 - 1576.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
S. Dreiseitl, L. Ohno-Machado, and M. Binder
Comparing Three-class Diagnostic Tests by Three-way ROC Analysis
Med Decis Making,
July 1, 2000;
20(3):
323 - 331.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
M. Gyongyosi, P. Yang, A. Khorsand, D. Glogar, on behalf of the Austrian Wiktor Stent Study Group, and European Paragon Stent Investigators
Longitudinal straightening effect of stents is an additional predictor for major adverse cardiac events
J. Am. Coll. Cardiol.,
May 1, 2000;
35(6):
1580 - 1589.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
J. E. Heffner, P. J. Nietert, and C. Barbieri
Pleural Fluid pH as a Predictor of Pleurodesis Failure* : Analysis of Primary Data
Chest,
January 1, 2000;
117(1):
87 - 95.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
M. Zarkovic, J. Ciric, M. Stojanovic, Z. Penezic, B. Trbojevic, M. Drezgic, and M. Nesovic
Optimizing the Diagnostic Criteria for Standard (250-{micro}g) and low Dose (1-{micro}g) Adrenocorticotropin Tests in the Assessment of Adrenal Function
J. Clin. Endocrinol. Metab.,
September 1, 1999;
84(9):
3170 - 3173.
[Abstract]
[Full Text]
|
 |
|

|
 |

|
 |
 
D. E Shapiro
The interpretation of diagnostic tests
Statistical Methods in Medical Research,
April 1, 1999;
8(2):
113 - 134.
[Abstract]
[PDF]
|
 |
|
|
|