|
Sign In to gain access to subscriptions and/or personal tools.
|
Eualuating Physicians' Probabilistic Judgments
Roy M. Poses
Randall D. Cebul
Robert M. Centor
Physicians increasingly are challenged to make probabilistic judgments quantitatively. Their ability to make such judgments may be directly linked to the quality of care they provide. Many methods are available to evaluate these judgments. Graphic means of assessment include the calibration curve, covariance graph, and receiver operating characteristic (ROC) curve. Statistical tools can measure the significance of departures from ideal calibration, and measure the area under ROC curve. Modeling the calibration curve using linear or logistic regression provides another method to assess probabilistic judgments, although these may be limited by failure of the data to meet the model's assumptions. Scoring rules provide indices of overall judgmental performance, although their reliability is difficult to gauge for small sample sizes. Decompositions of scoring rules separate judgmental performance into functional components. The authors provide preliminary guidelines for choosing methods for specific research in this area. Key Words: medical judgments; probabilistic judgments; ROC curves; calibration; models. (Med Decis Making 8:233-240, 1988)
Medical Decision Making, Vol. 8, No. 4,
233-240 (1988)
DOI: 10.1177/0272989X8800800403

CiteULike Complore Connotea Del.icio.us Digg Reddit Technorati Twitter What's this?
This article has been cited by other articles:

|
 |

|
 |
 
F Kee, T Owen, and R Leathem
Offering a prognosis in lung cancer: when is a team of experts an expert team?
J Epidemiol Community Health,
April 1, 2007;
61(4):
308 - 313.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
J. R. Egger, G. R. Cutter, P. A. Carney, S. H. Taplin, W. E. Barlow, R. E. Hendrick, C. J. D'Orsi, J. S. Fosse, L. Abraham, and J. G. Elmore
Mammographers' Perception of Women's Breast Cancer Risk
Med Decis Making,
May 1, 2005;
25(3):
283 - 289.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
J. Ivanov, M. A. Borger, T. E. David, G. Cohen, N. Walton, and C. D. Naylor
Predictive accuracy study: comparing a statistical model to clinicians' estimates of outcomes after coronary bypass surgery
Ann. Thorac. Surg.,
July 1, 2000;
70(1):
162 - 168.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
A. C. Justice, K. E. Covinsky, and J. A. Berlin
Assessing the Generalizability of Prognostic Information
Ann Intern Med,
March 16, 1999;
130(6):
515 - 524.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
R. M. Poses, W. R. Smith, D. K. McClish, E. C. Huber, F. L. W. Clemo, B. P. Schmitt, D. Alexander-Forti, E. M. Racht, C. C. Colenda III, and R. M. Centor
Physicians' Survival Predictions for Patients With Acute Congestive Heart Failure
Arch Intern Med,
May 12, 1997;
157(9):
1001 - 1007.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
H. R. Arkes
The Covariance Decomposition of the Probability Score and Its Use in Evaluating Prognostic Estimates: Hal R. Arkes, PhD, Neal V. Dawson, Md, Theodore Speroff, PhD, Frank E. Harrell, Jr., PhD, Carlos Alzola, Ms, Russell Phillips, Md, Norman Desbiens, Md, Robert K. Oye, Md, William Knaus, Md, Alfred F. Connors, Jr., Md, and the Support Investigators
Med Decis Making,
June 1, 1995;
15(2):
120 - 131.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
D. Timmermans
The Roles of Experience and Domain of Expertise in Using Numerical and Verbal Probability Terms in Medical Decisions
Med Decis Making,
April 1, 1994;
14(2):
146 - 156.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
H. J. Bernelot Moens, A. J. Hirshberg, and A. A.M.C. Claessens
Data-source Effects on the Sensitivities and Specificities of Clinical Features in the Diagnosis of Rheumatoid Arthritis: The Relevance of Multiple Sources of Knowledge for a Decision-support System
Med Decis Making,
December 1, 1992;
12(4):
250 - 258.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
K. A. Schulman, J. J. Escarce, J. M. Eisenberg, J. C. Hershey, M. J. Young, D. M. McCarthy, and S. V. Williams
Assessing Physicians Estimates of the Probability of Coronary Artery Disease: The Influence of Patient Characteristics
Med Decis Making,
June 1, 1992;
12(2):
109 - 114.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
R. M. Poses and M. Anthony
Availability, Wishful Thinking, and Physicians' Diagnostic Judgments for Patients with Suspected Bacteremia
Med Decis Making,
August 1, 1991;
11(3):
159 - 168.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
D. G. Fryback and J. R. Thornbury
The Efficacy of Diagnostic Imaging
Med Decis Making,
June 1, 1991;
11(2):
88 - 94.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
T. Chard
Qualitative Probability versus Quantitative Probability in Clinical Diagnosis: A Study Using a Computer Simulation
Med Decis Making,
February 1, 1991;
11(1):
38 - 41.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
R. M. Poses, C. Bekes, R. L. Winkler, W. E. Scott, and F. J. Copare
Are Two (Inexperienced) Heads Better Than One (Experienced) Head? Averaging House Officers' Prognostic Judgments for Critically Ill Patients
Arch Intern Med,
September 1, 1990;
150(9):
1874 - 1878.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
N. V. Dawson and R. D. Cebul
Advances in Quantitative Techniques for Making Medical Decisions: The Last Decade
Eval Health Prof,
March 1, 1990;
13(1):
37 - 62.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
R. M. Poses, C. Bekes, F. J. Copare, and W. E. Scott
What Difference Do Two Days Make? The Inertia of Physicians' Sequential Prognostic Judgments for Critically III Patients
Med Decis Making,
February 1, 1990;
10(1):
6 - 14.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
R. D. Cebul
Decision Making Research at the Interface Between Descriptive and Prescriptive Studies
Med Decis Making,
December 1, 1988;
8(4):
231 - 232.
[PDF]
|
 |
|
|
|