Journal of Clinical Epidemiology
Volume 52, Issue 3 , Pages 237-241 , March 1999

Validation of Logistic Regression Models in Small Samples: Application to Calvarial Lesions Diagnosis

  • Daniel Bautista

      Affiliations

    • Department of Preventive Medicine, Hospital Malva-Rosa, Valencia, Spain
    • Corresponding Author InformationAddress correspondence to: Daniel Bautista, C/Josep Iturbi, 14-2, 46200 Paiporta, Valencia, Spain
    • ,
  • Estanislao Arana

      Affiliations

    • Department of Radiology, Hospital Universitario Le Fe, Valencia, Spain
    • ,
  • Luis Martı́-Bonmatı́

      Affiliations

    • Department of Radiology, Hospital Universitario Dr. Peset, Valencia, Spain
    • ,
  • Roberto Paredes

      Affiliations

    • Institute of Technical Informatic, Polytechnic University, Valencia, Spain

,Accepted 3 November 1998.

References 

  1. McCarthy PJ. The use of balanced half-sample replication in cross-validation studies. J Am Stat Assoc. 1976;44:596–604
  2. Van Houwelingen JC, Le Cessie S. Predictive values of statistical models. Stat Med. 1990;9:1303–1325
  3. Miller ME, Hui SL, Tierney WM. Validation techniques for logistic regression models. Stat Med. 1991;10:1213–1226
  4. Hosmer DW, Taber S, Lemeshow S. The importance of assessing the fit of logistic regression models (A case study). Am J Public Health. 1991;81:1630–1635
  5. Efron B. How biased is the apparent error rate of a prediction rule?. J Am Stat Assoc. 1986;81:461–470
  6. Stone M. An asymptotic equivalence of choice of model by cross-validation and Akaike’s criterion. J R Stat Soc B. 1977;39:44–47
  7. In:  Hosmer DW,  Lemeshow S editor. Applied Logistic Regression. New York: John Wiley & Sons; 1989;
  8. Lemeshow S, Hosmer DW. A review of goodness of fit statistics for use in the development of logistic regression models. Am J Epidemiol. 1982;115:92–106
  9. Harrell FE, Califf RM, Pryor DB, Lee KL, Rosati RA. Evaluating the yield of medical tests. JAMA. 1982;247:2543–2546
  10. Hanley JA, McNeil BJ. The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. 1982;143:29–36
  11. Metz CE. Basic principles of ROC analysis. Sem Nucl Med. 1978;8:283–298
  12. Miller RG. The jackknife—a review. Biometrika. 1974;61:1–15
  13. Metz C, Wang P, Kronman H. A new approach for testing the significance of differences between ROC curves from correlated data. In:  Deconinck F editors. Information Processing in Medical Imaging. The Hague: Nijhoff; 1984;
  14. CLABROC [computer program]. Metz C, Herman B, Shen JH, Kronman HB, Wang P. Chicago, IL: Department of Radiology. University of Chicago; 1993; IBM-PC. Fortran. URL ftp: //random.bsd.uchicago.edu.
  15. Castaldo G, Oriani G, Cimino L, Topa M, Budillon G, Salvatore F, et al.  Discriminant function based on serum analytes differentiates hepatocarcinoma from secondary liver neoplasia. Clin Chem. 1995;41:439–443
  16. Yarnold PR, Soltysik RC, Martin GJ. Heart rate variability and susceptibility for sudden cardiac death (An example of multivariable optimal discriminant analysis). Stat Med. 1994;13:1015–1021
  17. Castaldo G, Oriani G, Lofrano MM, Cimino L, Topa M, Budillon G, et al.  Differential diagnosis between hepatocellular carcinoma and cirrhosis through a discriminant function based on results for serum analytes. Clin Chem. 1996;42:1263–1269
  18. Chandonia JM, Karplus M. Neural networks for secondary structure and structural class predictions. Protein Sci. 1995;4:275–285
  19. Gross GW, Boone JM, Bishop DM. Pediatric skeletal age (Determination with neural networks). Radiology. 1995;195:689–695
  20. Dalmas B, Hunter GJ, Bannister WH. Prediction of protein secondary structure from circular dichroism spectra using artificial neural network techniques. Biochem Mol Biol Int. 1994;34:17–26
  21. Floyd CE, Lo JY, Yun AJ, Sullivan DC, Kornguth PJ. Prediction of breast cancer malignancy using an artificial neural network. Cancer. 1994;74:2944–2948
  22. Gong G. Cross-validation, the jackknife, and the bootstrap (Excess error estimation in forward logistic regression). J Am Stat Assoc. 1986;81:108–113
  23. Reinus W, Wilson A. Quantitative analysis of solitary lesions of bone. Invest Radiol. 1995;30:427–432
  24. Harrell FE, Lee KL, Mark DB. Multivariable prognostic models (Issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors). Stat Med. 1996;15:361–387

PII: S0895-4356(98)00165-6

Journal of Clinical Epidemiology
Volume 52, Issue 3 , Pages 237-241 , March 1999

Article Tools

* Image Usage & Resolution