Journal of Clinical Epidemiology
Volume 63, Issue 3 , Pages 257-269 , March 2010

A statistical method was used for the meta-analysis of tests for latent TB in the absence of a gold standard, combining random-effect and latent-class methods to estimate test accuracy

  • Mohsen Sadatsafavi

      Affiliations

    • Faculty of Pharmaceutical Sciences, Collaboration for Outcomes Research and Evaluation, University of British Columbia, Vancouver, British Columbia, Canada
    • ,
  • Neal Shahidi

      Affiliations

    • Faculty of Pharmaceutical Sciences, Center for Clinical Epidemiology and Evaluation, Vancouver Coastal Health institute, Vancouver, British Columbia, Canada
    • ,
  • Fawziah Marra

      Affiliations

    • Faculty of Pharmaceutical Sciences, Collaboration for Outcomes Research and Evaluation, Pharmacy and Vaccine Services, British Columbia Center for Disease Control, Vancouver, British Columbia, Canada
    • ,
  • Mark J. FitzGerald

      Affiliations

    • Faculty of Medicine, Center for Clinical Epidemiology and Evaluation, Vancouver Coastal Health institute, University of British Columbia, Vancouver, British Columbia, Canada
    • ,
  • Kevin R. Elwood

      Affiliations

    • Division of Tuberculosis Control, British Columbia Center for Disease Control, Vancouver, British Columbia, Canada
    • Division of Respiratory Medicine, Faculty of Medicine, University of British Columbia, Vancouver, British Columbia, Canada
    • ,
  • Na Guo

      Affiliations

    • Faculty of Pharmaceutical Sciences, Collaboration for Outcomes Research and Evaluation, University of British Columbia, Vancouver, British Columbia, Canada
    • ,
  • Carlo A. Marra

      Affiliations

    • Faculty of Pharmaceutical Sciences, Collaboration for Outcomes Research and Evaluation, University of British Columbia, Vancouver, British Columbia, Canada
    • Corresponding Author InformationCorresponding author. Faculty of Pharmaceutical Sciences, Collaboration for Outcomes Research and Evaluation, University of British Columbia, 2146 East Mall, Vancouver, BC V6T 1Z3, Canada. Tel.: +1-604-806-8817; fax: +1-604-875-5179.

,Accepted 20 April 2009.

References 

  1. Dye C. Global epidemiology of tuberculosis. Lancet. 2006;367:938–940
  2. Schwartzman K. Latent tuberculosis infection: old problem, new priorities. CMAJ. 2002;166:759–761
  3. Blumberg HM, Leonard MK, Jasmer RM. Update on the treatment of tuberculosis and latent tuberculosis infection. JAMA. 2005;293:2776–2784
  4. Huebner RE, Schein MF, Bass JB. The tuberculin skin test. Clin Infect Dis. 1993;17:968–975
  5. Farhat M, Greenaway C, Pai M, Menzies D. False-positive tuberculin skin tests: what is the absolute effect of BCG and non-tuberculous mycobacteria?. Int J Tuberc Lung Dis. 2006;10:1192–1204
  6. Menzies D. Interpretation of repeated tuberculin tests. Boosting, conversion, and reversion. Am J Respir Crit Care Med. 1999;159:15–21
  7. Lalvani A. Diagnosing tuberculosis infection in the 21st century: new tools to tackle an old enemy. Chest. 2007;131:1898–1906
  8. Menzies D, Pai M, Comstock G. Meta-analysis: new tests for the diagnosis of latent tuberculosis infection: areas of uncertainty and recommendations for research. Ann Intern Med. 2007;146:340–354
  9. Brodie D, Schluger NW. The diagnosis of tuberculosis. Clin Chest Med. 2005;26:247–271vi
  10. Rutjes AW, Reitsma JB, Coomarasamy A, Khan KS, Bossuyt PM. Evaluation of diagnostic tests when there is no gold standard. A review of methods. Health Technol Assess. 2007;11(50):1–72
  11. Hui SL, Walter SD. Estimating the error rates of diagnostic tests. Biometrics. 1980;36:167–171
  12. Garrett ES, Eaton WW, Zeger S. Methods for evaluating the performance of diagnostic tests in the absence of a gold standard: a latent class model approach. Stat Med. 2002;21:1289–1307
  13. Qu Y, Tan M, Kutner MH. Random effects models in latent class analysis for evaluating accuracy of diagnostic tests. Biometrics. 1996;52:797–810
  14. Mori T, Sakatani M, Yamagishi F, Takashima T, Kawabe Y, Nagao K, et al. Specific detection of tuberculosis infection: an interferon-gamma-based assay using new antigens. Am J Respir Crit Care Med. 2004;170:59–64
  15. Wolfinger RD, editor. Fitting nonlinear mixed models with the new NLMIXED procedure. Proceedings of the 24th Annual SAS Users Group International; 1999; Miami, FL.
  16. Burden R, Faires J. Numerical analysis. 7th edition. Florence, KY: Brooks/Cole; 2000;
  17. Savalei V. Logistic approximation to the normal: the KL rationale. Psychometrika. 2006;71:763–767
  18. Burnham KP, Anderson DR. Multimodel inference: understanding AIC and BIC in model selection. Sociol Methods Res. 2004;33:261–304
  19. Arend SM, Thijsen SF, Leyten EM, Bouwman JJ, Franken WP, Koster BF, et al. Comparison of two interferon-gamma assays and tuberculin skin test for tracing tuberculosis contacts. Am J Respir Crit Care Med. 2007;175:618–627
  20. Carvalho AC, Pezzoli MC, El-Hamad I, Arce P, Bigoni S, Scarcella C, et al. QuantiFERON-TB Gold test in the identification of latent tuberculosis infection in immigrants. J Infect. 2007;55:164–168
  21. Choi JC, Shin JW, Kim JY, Park IW, Choi BW, Lee M-K. The effect of previous tuberculin skin test on the follow-up examination of whole-blood interferon-{gamma} assay in the screening for latent tuberculosis infection. Chest. 2008;133:1415–1420
  22. Diel R, Nienhaus A, Lange C, Meywald-Walter K, Forssbohm M, Schaberg T. Tuberculosis contact investigation with a new, specific blood test in a low-incidence population containing a high proportion of BCG-vaccinated persons. Respir Res. 2006;7:77
  23. Harada N, Nakajima Y, Higuchi K, Sekiya Y, Rothel J, Mori T. Screening for tuberculosis infection using whole-blood interferon-gamma and Mantoux testing among Japanese healthcare workers. Infect Control Hosp Epidemiol. 2006;27:442–448
  24. Herrmann JL, Simonney N, Bergeron A, Ducreux-Adolphe N, Porcher R, Rouveau M, et al. IFNgamma and antibody responses among French nurses during a tuberculosis contact tracing investigation. Pathol Biol (Paris). 2009;57:e49–e53
  25. Hotta K, Ogura T, Nishii K, Kodani T, Onishi M, Shimizu Y, et al. Whole blood interferon-gamma assay for baseline tuberculosis screening among Japanese healthcare students. PLoS One. 2007;2:e803
  26. Kang YA, Lee HW, Yoon HI, Cho B, Han SK, Shim YS, et al. Discrepancy between the tuberculin skin test and the whole-blood interferon gamma assay for the diagnosis of latent tuberculosis infection in an intermediate tuberculosis-burden country. JAMA. 2005;293:2756–2761
  27. Lee JY, Choi HJ, Park IN, Hong SB, Oh YM, Lim CM, et al. Comparison of two commercial interferon-gamma assays for diagnosing Mycobacterium tuberculosis infection. Eur Respir J. 2006;28:24–30
  28. Lee SS, Liu YC, Huang TS, Chen YS, Tsai HC, Wann SR, et al. Comparison of the interferon-gamma release assay and the tuberculin skin test for contact investigation of tuberculosis in BCG-vaccinated health care workers. Scand J Infect Dis. 2008;40:373–380
  29. Mahomed H, Hughes EJ, Hawkridge T, Minnies D, Simon E, Little F, et al. Comparison of mantoux skin test with three generations of a whole blood IFN-gamma assay for tuberculosis infection. Int J Tuberc Lung Dis. 2006;10:310–316
  30. Mirtskhulava V, Kempker R, Shields KL, Leonard MK, Tsertsvadze T, del Rio C, et al. Prevalence and risk factors for latent tuberculosis infection among health care workers in Georgia. Int J Tuberc Lung Dis. 2008;12:513–519
  31. Mazurek GH, Zajdowicz MJ, Hankinson AL, Costigan DJ, Toney SR, Rothel JS, et al. Detection of Mycobacterium tuberculosis infection in United States Navy recruits using the tuberculin skin test or whole-blood interferon-gamma release assays. Clin Infect Dis. 2007;45:826–836
  32. Pai M, Gokhale K, Joshi R, Dogra S, Kalantri S, Mendiratta DK, et al. Mycobacterium tuberculosis infection in health care workers in rural India: comparison of a whole-blood interferon gamma assay with tuberculin skin testing. JAMA. 2005;293:2746–2755
  33. Perry S, Sanchez L, Yang S, Agarwal Z, Hurst P, Parsonnet J. Reproducibility of QuantiFERON-TB gold in-tube assay. Clin Vaccine Immunol. 2008;15:425–432
  34. Porsa E, Cheng L, Seale MM, Delclos GL, Ma X, Reich R, et al. Comparison of a new ESAT-6/CFP-10 peptide-based gamma interferon assay and a tuberculin skin test for tuberculosis screening in a moderate-risk population. Clin Vaccine Immunol. 2006;13:53–58
  35. Porsa E, Cheng L, Graviss EA. Comparison of an ESAT-6/CFP-10 peptide-based enzyme-linked immunospot assay to a tuberculin skin test for screening of a population at moderate risk of contracting tuberculosis. Clin Vaccine Immunol. 2007;14:714–719
  36. Silverman MS, Reynolds D, Kavsak PA, Garay J, Daly A, Davis I. Use of an interferon-gamma based assay to assess bladder cancer patients treated with intravesical BCG and exposed to tuberculosis. Clin Biochem. 2007;40:913–915
  37. Franken WPJ, Timmermans JF, Prins C, Slootman E-JHJ, Dreverman J, Bruins H, et al. Comparison of Mantoux and QuantiFERON TB gold tests for diagnosis of latent tuberculosis infection in army personnel. Clin Vaccine Immunol. 2007;14:477–480
  38. Hill PC, Brookes RH, Fox A, Fielding K, Jeffries DJ, Jackson-Sillah D, et al. Large-scale evaluation of enzyme-linked immunospot assay and skin test for diagnosis of Mycobacterium tuberculosis infection against a gradient of exposure in The Gambia. Clin Infect Dis. 2004;38:966–973
  39. Ferrara G, Losi M, D'Amico R, Roversi P, Piro R, Meacci M, et al. Use in routine clinical practice of two commercial blood tests for diagnosis of infection with Mycobacterium tuberculosis: a prospective study. Lancet. 2006;367:1328–1334
  40. Winje BA, Oftung F, Korsvold GE, Mannsaker T, Jeppesen AS, Harstad I, et al. Screening for tuberculosis infection among newly arrived asylum seekers: comparison of QuantiFERONTB Gold with tuberculin skin test. BMC Infect Dis. 2008;8:65
  41. Kobashi Y, Obase Y, Fukuda M, Yoshida K, Miyashita N, Fujii M, et al. Usefulness of QuantiFERON TB-2G, a diagnostic method for latent tuberculosis infection, in a contact investigation of health care workers. Intern Med. 2007;46:1543–1549
  42. Diel R, Loddenkemper R, Meywald-Walter K, Niemann S, Nienhaus A. Predictive value of a whole blood IFN-gamma assay for the development of active tuberculosis disease after recent infection with Mycobacterium tuberculosis. Am J Respir Crit Care Med. 2008;177:1164–1170
  43. Pai M, Joshi R, Dogra S, Mendiratta DK, Narang P, Kalantri S, et al. Serial testing of health care workers for tuberculosis using interferon-gamma assay. Am J Respir Crit Care Med. 2006;174:349–355
  44. Goetghebeur E, Liinev J, Boelaert M, Van der Stuyft P. Diagnostic test analyses in search of their gold standard: latent class analyses with random effects. Stat Methods Med Res. 2000;9:231–248
  45. Hadgu A, Qu Y. A biomedical application of latent class models with random effects. J R Stat Soc Ser C (Appl Stat). 1998;47:603–616
  46. Boelaert M, Aoun K, Liinev J, Goetghebeur E, Van der Stuyft P. The potential of latent class analysis in diagnostic test validation for canine Leishmania infantum infection. Epidemiol Infect. 1999;123:499–506
  47. Chen F, Mackey AJ, Vermunt JK, Roos DS. Assessing performance of orthology detection strategies applied to eukaryotic genomes. PLoS One. 2007;2:e383
  48. Goletti D, Carrara S, Vincenti D, Saltini C, Rizzi EB, Schinina V, et al. Accuracy of an immune diagnostic assay based on RD1 selected epitopes for active tuberculosis in a clinical setting: a pilot study. Clin Microbiol Infect. 2006;12:544–550
  49. Meier T, Eulenbruch HP, Wrighton-Smith P, Enders G, Regnath T. Sensitivity of a new commercial enzyme-linked immunospot assay (T SPOT-TB) for diagnosis of tuberculosis in clinical practice. Eur J Clin Microbiol Infect Dis. 2005;24:529–536
  50. Scholvinck E, Wilkinson KA, Whelan AO, Martineau AR, Levin M, Wilkinson RJ. Gamma interferon-based immunodiagnosis of tuberculosis: comparison between whole-blood and enzyme-linked immunospot methods. J Clin Microbiol. 2004;42:829–831
  51. Pai M, Zwerling A, Menzies D. Systematic review: T-cell-based assays for the diagnosis of latent tuberculosis infection: an update. Ann Intern Med. 2008;149:177–184
  52. Menzies D. What does tuberculin reactivity after bacille Calmette-Guerin vaccination tell us?. Clin Infect Dis. 2000;31(Suppl 3):S71–S74
  53. Dickersin K, Berlin JA. Meta-analysis: state-of-the-science. Epidemiol Rev. 1992;14:154–176
  54. Wasserman L. Bayesian model selection and model averaging. J Math Psychol. 2000;44:92–107
  55. Centor RM. Signal detectability: the use of ROC curves and their analyses. Med Decis Making. 1991;11:102–106
  56. Walter SD, Irwig L, Glasziou PP. Meta-analysis of diagnostic tests with imperfect reference standards. J Clin Epidemiol. 1999;52:943–951

PII: S0895-4356(09)00129-2

doi: 10.1016/j.jclinepi.2009.04.008

Journal of Clinical Epidemiology
Volume 63, Issue 3 , Pages 257-269 , March 2010

Article Tools

* Image Usage & Resolution