| Sign In to gain access to subscriptions and/or personal tools. |
Relation of Observer Agreement to Accuracy According to a Two-receiver Signal Detection Model of DiagnosisA long-standing problem of medical diagnosis is why rates of observer disagreement are so high. To study this question a model of test interpretation is defined which accounts for disagreement when observers use identical diagnostic strategies. Test subjects are assigned to one of two disease classes on the basis of two parameters: the test score and A, the diagnostic certainty, a parameter analogous to signal-to-noise ratio. The rate of disagreement and the mean error rate of independent ideal observers are derived as a function of diagnostic strategy. It follows from the model that: 1) Maximization of the ratio of disagreement to error defines an optimal diagnostic strategy with advantages over maximum likelihood and Bayes diagnostic strategies. 2) Disagreement exceeds error if the sensitivity and specificity of in dependent observers exceed one-half for all A. 3) The ratio of disagreement to error can be no greater than two if test interpretation is dichotomous but can approach infinity for tricho tomous interpretation, i.e., if observers are allowed to interpret cases as indeterminate.
Key Words: Key words: Bayesian statistics • maximum likelihood • signal-to-noise ratio. (Med Decis Making 1989;9:196-206)
Medical Decision Making, Vol. 9, No. 3,
196-206 (1989) This article has been cited by other articles:
|
|
||||||||||||||||||||||||||
 |
|
|
 |
|
Sign In to gain access to subscriptions and/or personal tools.
