This Article Full Text (PDF) References Alert me when this article is cited Alert me if a correction is posted Citation Map Services Email this article to a friend Similar articles in this journal Similar articles in PubMed Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Tourassi, G. D. Articles by Floyd, C. E. Search for Related Content PubMed PubMed Citation Articles by Tourassi, G. D. Articles by Floyd, C. E. Social Bookmarking                   What's this?

The Effect of Data Sampling on the Performance Evaluation of Artificial Neural Networks in Medical Diagnosis

Address correspondence and reprint requests to Dr. Tourassi Department of Diagnostic Radiology, University of Louisville Hospital, Louisville, KY 40202

Carey E. Floyd, PhD

Purpose. To study the effect of data sampling on the predictive assessment of artificial neural networks (ANNs) for medical diagnostic tasks. Methods. Three statistical techniques were used to evaluate the diagnostic performances of ANNs: 1) cross validation, 2) round robin, and 3) bootstrap. These techniques are different sampling plans designed to reduce the small-sample estimation bias and variance contributions. The study was based on two networks, one developed for the diagnosis of pulmonary embolism (1,064 cases) and the other developed for the diagnosis of breast cancer (206 cases). Results. The three sampling techniques produced different performance estimates for both networks. The estimates varied substantially depending on the training sample size and the training-stopping criterion. Conclusion. The predictive assessment of ANNs in medical diagnosis can vary substantially based on the complexity of the problem, the data sampling technique, and the number of cases available. Key words: computer-aided diagnosis; artificial neural networks; sampling; cross validation; round robin; bootstrap; receiver operating characteristic analysis. (Med Decis Making 1997;17:186-192)

Medical Decision Making, Vol. 17, No. 2, 186-192 (1997)
DOI: 10.1177/0272989X9701700209


CiteULike    Connotea    Del.icio.us    Digg    Reddit    Technorati    What's this?

This article has been cited by other articles:

				S. G. Armato III, G. McLennan, M. F. McNitt-Gray, C. R. Meyer, D. Yankelevitz, D. R. Aberle, C. I. Henschke, E. A. Hoffman, E. A. Kazerooni, H. MacMahon, et al. Lung Image Database Consortium: Developing a Resource for the Medical Imaging Research Community Radiology, September 1, 2004; 232(3): 739 - 748. [Abstract] [Full Text] [PDF]

				H. Yoshida, J. Nappi, P. MacEneaney, D. T. Rubin, and A. H. Dachman Computer-aided Diagnosis Scheme for Detection of Polyps at CT Colonography RadioGraphics, July 1, 2002; 22(4): 963 - 979. [Abstract] [Full Text] [PDF]

				A. Gottschalk, M. C. Hyzer, and R. T. Geer A Comparison of Human and Machine-based Predictions of Successful Weaning from Mechanical Ventilation Med Decis Making, April 1, 2000; 20(2): 160 - 169. [Abstract] [PDF]

				J. Hilden Neural Networks and the Roles of Cross Validation Med Decis Making, January 1, 1998; 18(1): 122 - 123. [PDF]

				G. D. Tourassi and C. E. Floyd JR. In reply Med Decis Making, January 1, 1998; 18(1): 123 - 124. [PDF]