|
Sign In to gain access to subscriptions and/or personal tools.
|
Estimating Diagnostic Accuracy from Multiple Conflicting Reports
A New Meta-analytic Method
Benjamin Littenberg, MD
Lincoln E. Moses, PhD
Reports of diagnostic accuracy often differ. The authors present a method to summarize disparate reports that uses a logistic transformation and linear regression to produce a summary receiver operating characteristic curve. The curve is useful for summarizing a body of diagnostic accuracy literature, comparing technologies, detecting outliers, and finding the optimum operating point of the test. Examples from clinical chemistry and diagnostic radiology are provided. By extending the logic of meta-analysis to diagnostic testing, the method provides a new tool for technology assessment. Key words: meta-analysis; sensitivity and specificity; decision support; data interpretation, statistical; regression analysis; diagnostic accuracy. (Med Decis Making 1993;13:313-321)
Medical Decision Making, Vol. 13, No. 4,
313-321 (1993)
DOI: 10.1177/0272989X9301300408

CiteULike Complore Connotea Del.icio.us Digg Reddit Technorati Twitter What's this?
This article has been cited by other articles:

|
 |

|
 |
 
T. A. Trikalinos, U. Siebert, and J. Lau
Decision-Analytic Modeling to Evaluate Benefits and Harms of Medical Tests: Uses and Limitations
Med Decis Making,
September 1, 2009;
29(5):
E22 - E29.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
S. Greco, M. Rulli, E. Girardi, C. Piersimoni, and C. Saltini
Diagnostic Accuracy of In-House PCR for Pulmonary Tuberculosis in Smear-Positive Patients: Meta-Analysis and Metaregression
J. Clin. Microbiol.,
March 1, 2009;
47(3):
569 - 576.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
K. R. Steingart, N. Dendukuri, M. Henry, I. Schiller, P. Nahid, P. C. Hopewell, A. Ramsay, M. Pai, and S. Laal
Performance of Purified Antigens for Serodiagnosis of Pulmonary Tuberculosis: a Meta-Analysis
Clin. Vaccine Immunol.,
February 1, 2009;
16(2):
260 - 276.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
D. I. Ling, A. A. Zwerling, and M. Pai
GenoType MTBDR assays for the diagnosis of multidrug-resistant tuberculosis: a meta-analysis
Eur. Respir. J.,
November 1, 2008;
32(5):
1165 - 1174.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
P. V. Pandharipande, M. G. Harisinghani, E. M. Ozanne, M. C. Specht, C. Hur, J. M. Lee, and G. S. Gazelle
Staging MR Lymphangiography of the Axilla for Early Breast Cancer: Cost-Effectiveness Analysis
Am. J. Roentgenol.,
November 1, 2008;
191(5):
1308 - 1319.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
P. Whiting, R. Harbord, I. de Salis, M. Egger, and J. Sterne
Evidence-based diagnosis
J Health Serv Res Policy,
October 1, 2008;
13(suppl_3):
57 - 63.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
L.R. Arends, T.H. Hamza, J.C. van Houwelingen, M.H. Heijenbrok-Kal, M.G.M. Hunink, and T. Stijnen
Bivariate Random Effects Meta-Analysis of ROC Curves
Med Decis Making,
September 1, 2008;
28(5):
621 - 638.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
T. H. Hamza, J. B. Reitsma, and T. Stijnen
Meta-Analysis of Diagnostic Studies: A Comparison of Random Intercept, Normal-Normal, and Binomial-Normal Bivariate Summary ROC Approaches
Med Decis Making,
September 1, 2008;
28(5):
639 - 649.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
E. Warner, H. Messersmith, P. Causer, A. Eisen, R. Shumak, and D. Plewes
Systematic Review: Using Magnetic Resonance Imaging to Screen Women at High Risk for Breast Cancer
Ann Intern Med,
May 6, 2008;
148(9):
671 - 679.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
T.E.M. Verhagen, D.J. Hendriks, L.F.J.M.M. Bancsi, B.W.J. Mol, and F.J.M. Broekmans
The accuracy of multivariate models predicting ovarian reserve and pregnancy after in vitro fertilization: a meta-analysis
Hum. Reprod. Update,
March 1, 2008;
14(2):
95 - 100.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
E. E. Pakos, H. D. Koumoulis, A. D. Fotopoulos, and J. P. A. Ioannidis
Osteomyelitis: Antigranulocyte Scintigraphy with 99mTc Radiolabeled Monoclonal Antibodies for Diagnosis Meta-Analysis
Radiology,
December 1, 2007;
245(3):
732 - 741.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
N. H. G. M. Peters, I. H. M. Borel Rinkes, N. P. A. Zuithoff, W. P. T. M. Mali, K. G. M. Moons, and P. H. M. Peeters
Meta-Analysis of MR Imaging in the Diagnosis of Breast Lesions
Radiology,
December 1, 2007;
246(1):
116 - 124.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
M. H. Heijenbrok-Kal, M. C. J. M. Kock, and M. G. M. Hunink
Lower Extremity Arterial Disease: Multidetector CT Angiography Meta-Analysis
Radiology,
November 1, 2007;
245(2):
433 - 439.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
K. R Steingart, M. Henry, S. Laal, P. C Hopewell, A. Ramsay, D. Menzies, J. Cunningham, K. Weldingh, and M. Pai
A systematic review of commercial serological antibody detection tests for the diagnosis of extrapulmonary tuberculosis
Postgrad. Med. J.,
November 1, 2007;
83(985):
705 - 712.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
K. R Steingart, M. Henry, S. Laal, P. C Hopewell, A. Ramsay, D. Menzies, J. Cunningham, K. Weldingh, and M. Pai
A systematic review of commercial serological antibody detection tests for the diagnosis of extrapulmonary tuberculosis
Thorax,
October 1, 2007;
62(10):
911 - 918.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
P. K. Vanhoenacker, M. H. Heijenbrok-Kal, R. Van Heste, I. Decramer, L. R. Van Hoe, W. Wijns, and M. G. M. Hunink
Diagnostic Performance of Multidetector CT Angiography for Assessment of Coronary Artery Disease: Meta-analysis
Radiology,
August 1, 2007;
244(2):
419 - 428.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
R. M. Harbord, J. J. Deeks, M. Egger, P. Whiting, and J. A. C. Sterne
A unification of models for meta-analysis of diagnostic accuracy studies
Biostat.,
April 1, 2007;
8(2):
239 - 251.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
J. J. Bailey, M. Hodges, and T. R. Church
Decision to Implant a Cardioverter Defibrillator after Myocardial Infarction: The Role of Ejection Fraction v. Other Risk Factor Markers
Med Decis Making,
March 1, 2007;
27(2):
151 - 160.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
G. J. Williams, P. Macaskill, S. F. Chan, T. E. Karplus, W. Yung, E. M. Hodson, and J. C. Craig
Comparative Accuracy of Renal Duplex Sonographic Parameters in the Diagnosis of Renal Artery Stenosis: Paired and Unpaired Analysis
Am. J. Roentgenol.,
March 1, 2007;
188(3):
798 - 811.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
M. Leeflang, J. Reitsma, R. Scholten, A. Rutjes, M. Di Nisio, J. Deeks, and P. Bossuyt
Impact of Adjustment for Quality on Results of Metaanalyses of Diagnostic Accuracy
Clin. Chem.,
February 1, 2007;
53(2):
164 - 172.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
A. Kapoor, S. Page, M. LaValley, D. R. Gale, and D. T. Felson
Magnetic Resonance Imaging for Diagnosing Foot Osteomyelitis: A Meta-analysis
Arch Intern Med,
January 22, 2007;
167(2):
125 - 132.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
F.J. Broekmans, J. Kwee, D.J. Hendriks, B.W. Mol, and C.B. Lambalk
A systematic review of tests predicting ovarian reserve and IVF outcome
Hum. Reprod. Update,
November 1, 2006;
12(6):
685 - 718.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
S. Nayak, I. Olkin, H. Liu, M. Grabe, M. K. Gould, I. E. Allen, D. K. Owens, and D. M. Bravata
Meta-analysis: accuracy of quantitative ultrasound for identifying patients with osteoporosis.
Ann Intern Med,
June 6, 2006;
144(11):
832 - 841.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
J. Latour-Perez, F. J. Coves-Orts, C. Abad-Terrado, V. Abraira, and J. Zamora
Accuracy of B-type natriuretic peptide levels in the diagnosis of left ventricular dysfunction and heart failure: A systematic review
Eur J Heart Fail,
June 1, 2006;
8(4):
390 - 399.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
A. Lee, L. T. Y. Fan, T. Gin, M. K. Karmakar, and W. D. Ngan Kee
A systematic review (meta-analysis) of the accuracy of the mallampati tests to predict the difficult airway.
Anesth. Analg.,
June 1, 2006;
102(6):
1867 - 1878.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
C. A. Parvin
dr-ROC Software. Mathew D. Mitchell. Glenside, PA: Dr2Consulting, 2005, CD. Individual license, $150.00; Departmental license, $400.00; Commercial license, $500.00; Student/resident license, $105.00.
Clin. Chem.,
March 1, 2006;
52(3):
543 - 544.
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
M. H. Heijenbrok-Kal, E. Buskens, P. J. Nederkoorn, Y. van der Graaf, and M. G. M. Hunink
Optimal Peak Systolic Velocity Threshold at Duplex US for Determining the Need for Carotid Endarterectomy: A Decision Analytic Approach
Radiology,
December 21, 2005;
(2005)
2381041078.
[Abstract]
[Full Text]
|
 |
|

|
 |

|
 |
 
O. P. P. Temmerman, P. G. H. M. Raijmakers, J. Berkhof, O. S. Hoekstra, G. J. J. Teule, and I. C. Heyligers
Accuracy of diagnostic imaging techniques in the diagnosis of aseptic loosening of the femoral component of a hip prosthesis: A META-ANALYSIS
J Bone Joint Surg Br,
June 1, 2005;
87-B(6):
781 - 785.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
F. B. Karassa, M. I. Matsagas, W. A. Schmidt, and J. P.A. Ioannidis
Meta-Analysis: Test Performance of Ultrasonography for Giant-Cell Arteritis
Ann Intern Med,
March 1, 2005;
142(5):
359 - 369.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
P. G. Danias, A. Roussakis, and J. P.A. Ioannidis
Diagnostic performance of coronary magnetic resonance angiography as compared against conventional x-ray angiography: A meta-analysis
J. Am. Coll. Cardiol.,
November 2, 2004;
44(9):
1867 - 1876.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
J. C. Felli and G. B. Hazen
Javelin Diagrams: A Graphical Tool for Probabilistic Sensitivity Analysis
Decision Analysis,
June 1, 2004;
1(2):
93 - 107.
[Abstract]
[PDF]
|
 |
|

|
 |

|
 |
 
M. E. Numans, J. Lau, N. J. de Wit, and P. A. Bonis
Short-Term Treatment with Proton-Pump Inhibitors as a Test for Gastroesophageal Reflux Disease: A Meta-Analysis of Diagnostic Test Characteristics
Ann Intern Med,
April 6, 2004;
140(7):
518 - 527.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
R. I. Dorin, C. R. Qualls, and L. M. Crapo
Diagnosis of Adrenal Insufficiency
Ann Intern Med,
August 5, 2003;
139(3):
194 - 204.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
P. J. Nederkoorn, Y. van der Graaf, and M.G. M. Hunink
Duplex Ultrasound and Magnetic Resonance Angiography Compared With Digital Subtraction Angiography in Carotid Artery Stenosis: A Systematic Review
Stroke,
May 1, 2003;
34(5):
1324 - 1331.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
M. Cruciani, P. Marcati, M. Malena, O. Bosco, G. Serpelloni, and C. Mengoli
Meta-analysis of diagnostic procedures for Pneumocystis carinii pneumonia in HIV-1-infected patients
Eur. Respir. J.,
October 1, 2002;
20(4):
982 - 989.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
R. Smith-Bindman, M. K. Gould, and D. K. Owens
Positron Emission Tomography to Evaluate Lung Lesions
JAMA,
June 6, 2001;
285(21):
2711 - 2712.
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
M. J. W. Koelemay, J. G. Lijmer, J. Stoker, D. A. Legemate, and P. M. M. Bossuyt
Magnetic Resonance Angiography for the Evaluation of Lower Extremity Arterial Disease: A Meta-analysis
JAMA,
March 14, 2001;
285(10):
1338 - 1345.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
C. Z. Dickinson, H. J. Dworkin, J. H. O'Keefe, Jr, T. M. Bateman, R. J. Gibbons, S. Kymes, L. Shaw, J. Fletcher, K. E. Fleischmann, M. G. M. Hunink, et al.
Exercise Echocardiography vs Exercise SPECT Testing
JAMA,
November 3, 1999;
282(17):
1621 - 1623.
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
M. G.M. Hunink, K. M. Kuntz, K. E. Fleischmann, and T. J. Brady
Noninvasive Imaging for the Diagnosis of Coronary Artery Disease: Focusing the Development of New Diagnostic Technology
Ann Intern Med,
November 2, 1999;
131(9):
673 - 680.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
J. G. Lijmer, B. W. Mol, S. Heisterkamp, G. J. Bonsel, M. H. Prins, J. H. P. van der Meulen, and P. M. M. Bossuyt
Empirical Evidence of Design-Related Bias in Studies of Diagnostic Tests
JAMA,
September 15, 1999;
282(11):
1061 - 1066.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
K. E. Fleischmann, M. G. M. Hunink, K. M. Kuntz, and P. S. Douglas
Exercise Echocardiography or Exercise SPECT Imaging?: A Meta-analysis of Diagnostic Test Performance
JAMA,
September 9, 1998;
280(10):
913 - 920.
[Abstract]
[Full Text]
[PDF]
|
 |
|

|
 |

|
 |
 
D. Mossman
Resampling Techniques in the Analysis of Non-binormal ROC Data
Med Decis Making,
October 1, 1995;
15(4):
358 - 366.
[Abstract]
[PDF]
|
 |
|
|
|