|
Sign In to gain access to subscriptions and/or personal tools.
|
An Eualuation of Clinicians' Subjective Prior Probability Estimates
James G. Dolan, MD
Donald R. Bordley, MD
Alvin I. Mushlin, MD
The degree of consensus and the accuracy of subjective prior probability estimates made by 104 clinicians were examined. The clinicians' estimates were compared with objective prior probabilities obtained from published sources and actual patient outcomes. Each cli nician made seven estimates based upon written case summaries abstracted from patient records. Consensus was measured by calculating estimate ranges and standard deviations. The clinicians' estimates varied widely: the smallest range was 80 (2%-82%); four of the seven probability ranges were greater than 90. The average standard deviation was 19.5. Using these prior probabilities and Bayes' theorem, widely varying posttest probabilities would result after many common diagnostic tests. Accuracy was measured using the Brier score, which ranges from 0 to 1; a score of 0 indicates perfect accuracy. The clinicians' Brier scores ranged from 0.05 to 0.57. The objectively determined probabilities achieved a Brier score of 0.11, better than that of 96% of the clinicians. Clinical experience did not consistently affect estimate accuracy or consensus. The clinicians' subjective estimates were inaccurate measures of the prior probability of disease. There was little consensus regarding disease likelihood among the clinicians. Objective prior probabilities were more accurate and less variable. Key words: diagnosis; decision making; probability. (Med Decis Making 6:216- 223, 1986)
Medical Decision Making, Vol. 6, No. 4,
216-223 (1986)
DOI: 10.1177/0272989X8600600406
 CiteULike  Complore  Connotea  Del.icio.us  Digg  Reddit  Technorati  Twitter What's this?
This article has been cited by other articles:
|
|
|
|
 
F Kee, T Owen, and R Leathem
Offering a prognosis in lung cancer: when is a team of experts an expert team?
J Epidemiol Community Health,
April 1, 2007;
61(4):
308 - 313.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
M. T Bianchi and B. M Alexander
Evidence based diagnosis: does the language reflect the theory?
BMJ,
August 26, 2006;
333(7565):
442 - 445.
[Full Text]
[PDF]
|
|
|
|
|
|
|
J. Ivanov, M. A. Borger, T. E. David, G. Cohen, N. Walton, and C. D. Naylor
Predictive accuracy study: comparing a statistical model to clinicians' estimates of outcomes after coronary bypass surgery
Ann. Thorac. Surg.,
July 1, 2000;
70(1):
162 - 168.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
D. J. Margolis, A. C. Halpern, T. Rebbeck, L. Schuchter, R. L. Barnhill, J. Fine, and M. Berwick
Validation of a Melanoma Prognostic Model
Arch Dermatol,
December 1, 1998;
134(12):
1597 - 1601.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
C. van Walraven and C. D. Naylor
Do We Know What Inappropriate Laboratory Utilization Is?: A Systematic Review of Laboratory Clinical Audits
JAMA,
August 12, 1998;
280(6):
550 - 558.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
C. E. Phelps
Good Technologies Gone Bad: How and Why the Cost-Effectiveness of a Medical Intervention Changes for Different Populations
Med Decis Making,
February 1, 1997;
17(1):
107 - 117.
[Abstract]
[PDF]
|
|
|
|
|
|
|
H. R. Arkes
The Covariance Decomposition of the Probability Score and Its Use in Evaluating Prognostic Estimates: Hal R. Arkes, PhD, Neal V. Dawson, Md, Theodore Speroff, PhD, Frank E. Harrell, Jr., PhD, Carlos Alzola, Ms, Russell Phillips, Md, Norman Desbiens, Md, Robert K. Oye, Md, William Knaus, Md, Alfred F. Connors, Jr., Md, and the Support Investigators
Med Decis Making,
June 1, 1995;
15(2):
120 - 131.
[Abstract]
[PDF]
|
|
|
|
|
|
|
J. A. Baron
Uncertainty in Bayes
Med Decis Making,
February 1, 1994;
14(1):
46 - 51.
[Abstract]
[PDF]
|
|
|
|
|
|
|
N. V. Dawson, A. F. Connors, T. Speroff, A. Kemka, P. Shaw, and H. R. Arkes
Hemodynamic Assessment in Managing the Critically III: Is Physician Confidence Warranted?
Med Decis Making,
August 1, 1993;
13(3):
258 - 266.
[Abstract]
[PDF]
|
|
|
|
|
|
|
B. L. Carter, C. D. Butler, J. C. Rogers, and R. L. Holloway
Evaluation of Physician Decision Making With the Use of Prior Probabilities and a Decision-Analysis Model
Arch Fam Med,
May 1, 1993;
2(5):
529 - 534.
[Abstract]
[PDF]
|
|
|
|
|
|
|
M. Bobbio, R. Detrano, A. H. Shandling, M. H. Ellestad, J. Clark, O. Brezden, A. Abecia, and D. Martinez-Caro
Clinical Assessment of the Probability of Coronary Artery Disease: Judgmental Bias from Personal Knowledge
Med Decis Making,
August 1, 1992;
12(3):
197 - 203.
[Abstract]
[PDF]
|
|
|
|
|
|
|
T. G. Tape, J. Kripal, and R. S. Wigton
Comparing Methods of Learning Clinical Prediction from Case Simulations
Med Decis Making,
August 1, 1992;
12(3):
213 - 221.
[Abstract]
[PDF]
|
|
|
|
|
|
|
F. Sainfort
Eualuation of Medical Technologies: A Generalized ROC Analysis
Med Decis Making,
August 1, 1991;
11(3):
208 - 220.
[Abstract]
[PDF]
|
|
|
|
|
|
|
T. Chard
Qualitative Probability versus Quantitative Probability in Clinical Diagnosis: A Study Using a Computer Simulation
Med Decis Making,
February 1, 1991;
11(1):
38 - 41.
[Abstract]
[PDF]
|
|
|
|
|
|
|
T. S. Kotler and G. A. Diamond
Exercise Thallium-201 Scintigraphy in the Diagnosis and Prognosis of Coronary Artery Disease
Ann Intern Med,
November 1, 1990;
113(9):
684 - 702.
[Abstract]
[PDF]
|
|
|
|
|
|
|
T. G. Tape and R. S. Wigton
Medical Students' and Residents' Estimates of Cardiac Risk
Med Decis Making,
August 1, 1989;
9(3):
170 - 175.
[Abstract]
[PDF]
|
|
|
|
|
|
|
R. M. Poses, R. D. Cebul, and R. M. Centor
Eualuating Physicians' Probabilistic Judgments
Med Decis Making,
December 1, 1988;
8(4):
233 - 240.
[Abstract]
[PDF]
|
|
|
|
|
|
|
W. M. Tierney, C. J. McDonald, S. L. Hui, and D. K. Martin
Computer Predictions of Abnormal Test Results: Effects on Outpatient Testing
JAMA,
February 26, 1988;
259(8):
1194 - 1198.
[Abstract]
[PDF]
|
|
|
|
|
