|
Sign In to gain access to subscriptions and/or personal tools.
|
Gains in Accuracy from Replicated Readings of Diagnostic Images
Prediction and Assessment in Terms of ROC Analysis
Charles E. Metz, PhD
Jong-Her Shen, MS
From the perspective of signal detection theory, human variation in image reading degrades diagnostic accuracy by broadening the statistical distributions of perceived evidence upon which decisions were based. A new multivariate "random-effects" model formulates the total variation in a diagnostic decision variable as a sum of three uncorrelated components that represent differences among cases, readers, and repeated readings by a given reader. This model provides a basis for quantitative predictions concerning the amount by which diagnostic accuracy, as specified by ROC analysis, can be enhanced by the replication of image readings. Although these predictions apply exactly only to the hypothetical situation in which normally distributed decision variables from equivalent readers are averaged, computer- simulation studies and an analysis of mammographic image-reading data from five radiol ogists show that similar gains in accuracy can be achieved by averaging discrete confidence ratings. Key words diagnostic accuracy, random-effects model; image interpretation; ROC analysis. (Med Decis Making 1992;12:60-75)
Medical Decision Making, Vol. 12, No. 1,
60-75 (1992)
DOI: 10.1177/0272989X9201200110

CiteULike Complore Connotea Del.icio.us Digg Reddit Technorati Twitter What's this?
This article has been cited by other articles:

|
 |

|
 |
 
M. Sadatsafavi, A. Moayyeri, H. Bahrami, and A. Soltani
The Value of Bayes Theorem in the Interpretation of Subjective Diagnostic Findings: What Can We Learn from Agreement Studies?
Med Decis Making,
December 1, 2007;
27(6):
735 - 743.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
C. Xiong, D. W. McKeel Jr, J. P. Miller, and J. C. Morris
Combining Correlated Diagnostic Tests: Application to Neuropathologic Diagnosis of Alzheimer's Disease
Med Decis Making,
November 1, 2004;
24(6):
659 - 669.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
T.-C. Yen, K.-K. Ng, S.-Y. Ma, H.-H. Chou, C.-S. Tsai, S. Hsueh, T.-C. Chang, J.-H. Hong, L.-C. See, W.-J. Lin, et al.
Value of Dual-Phase 2-Fluoro-2-Deoxy-D-Glucose Positron Emission Tomography in Cervical Cancer
J. Clin. Oncol.,
October 1, 2003;
21(19):
3651 - 3658.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
J. M. Boone, K. K. Lindfors, and J. A. Seibert
Determining Sensitivity of Mammography from Screening Data, Cancer Incidence, and Receiver-Operating Characteristic Curve Parameters
Med Decis Making,
June 1, 2002;
22(3):
228 - 237.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
N. A Obuchowski
Sample size calculations in studies of test accuracy
Statistical Methods in Medical Research,
August 1, 1998;
7(4):
371 - 392.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
S. C. Weller and N. C. Mann
Assessing Rater Performance without a "Gold Standard" Using Consensus Theory
Med Decis Making,
February 1, 1997;
17(1):
71 - 79.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
S. J. Jacobsen, E. J. Bergstralh, H. A. Guess, S. K. Katusic, G. G. Klee, J. E. Oesterling, and M. M. Lieber
Predictive Properties of Serum Prostate-Specific Antigen Testing in a Community-Based Setting
Arch Intern Med,
November 25, 1996;
156(21):
2462 - 2468.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
W. Maguire
Modeling Boolean Decision Rules Applied to Multiple-observer Decision Strategies
Med Decis Making,
February 1, 1996;
16(1):
51 - 57.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
L. V. Philosophov
Bayesian Decision Making Based on Measurements Containing Errors
Med Decis Making,
August 1, 1995;
15(3):
264 - 275.
[Abstract]
[PDF]
|
 |
|
|
|