Journal of Clinical Epidemiology
Volume 52, Issue 4 , Pages 281-291 , April 1999

Recursive Cumulative Meta-analysis: A Diagnostic for the Evolution of Total Randomized Evidence from Group and Individual Patient Data

  • John P.A Ioannidis

      Affiliations

    • Therapeutics Research Program, Division of AIDS, National Institute of Allergy and Infectious Diseases, National Institutes of Health, Bethesda, MD USA
    • Corresponding Author InformationAddress correspondence to: John P. A. Ioannidis, M.D., 23A Kalavryton St., Ano Voula 16673, Greece
  • ,
  • Despina G Contopoulos-Ioannidis

      Affiliations

    • Department of Pediatrics, George Washington University School of Medicine, Washington, DC USA
  • ,
  • Joseph Lau

      Affiliations

    • Division of Clinical Care Research, New England Medical Center Hospitals, Tufts University School of Medicine, Boston, MA USA

,Accepted 6 November 1998.

References 

  1. Dickersin K. The existence of publication bias and risk factors for its occurrence. JAMA. 1990;263:1385–1389
  2. Ioannidis JP. Effect of the statistical significance of results on the time to completion and publication of randomized efficacy trials. JAMA. 1998;279:281–286
  3. Stewart LA, Clarke MJ. Practical methodology of meta-analyses (overviews) using updated individual patient data. Cochrane Working Group. Stat Med. 1995;14:2057–2079
  4. Stewart LA, Parmar MKB. Meta-analysis of the literature or of individual patient data (Is there a difference?). Lancet. 1993;341:418–422
  5. Steinberg KK, Smith SJ, Stroup DF, Olkin I, Lee NC, Williamson GD, et al.  Comparison of effect estimates from a meta-analysis of summary data from published studies and from a meta-analysis using individual patient data for ovarian cancer studies. Am J Epidemiol. 1997;145:917–925
  6. Franzosi MG, Santoro E, Santoro L, ACE-Inhibitor Collaborative Group . Prospective meta-analysis using individual patient data vs. meta-analysis of published reports (The case of ACE-inhibitors in myocardial infarction). Control Clin Trials. 1997;18:183S
  7. Lau J, Antman EM, Jimenez-Silva J, et al.  Cumulative meta-analysis of trials of treatments for myocardial infarction. N Engl J Med. 1992;327:248–254
  8. Lau J, Schmid CH, Chalmers TC. Cumulative meta-analysis builds evidence for exemplary medical care. J Clin Epidemiol. 1995;48:45–57
  9. Berkey CS, Mosteller F, Lau J, Antman EM. Uncertainty of the time of first significance in random effects cumulative meta-analysis. Control Clin Trials. 1996;17:357–371
  10. Mantel N, Haenszel W. Statistical aspects of the analysis of data from retrospective studies of disease. J Natl Cancer Inst. 1959;22:719–748
  11. Der Simonian R, Laird NM. Meta-analysis in clinical trials. Control Clin Trials. 1986;7:177–188
  12. Cox DR, Oakes D. Analysis of Survival Data. London: Chapman and Hall; 1984;
  13. Lau J, Ioannidis JP, Schmid CH. Quantitative synthesis in systematic reviews. Ann Intern Med. 1997;126:820–826
  14. Ioannidis JP, Collier AC, Cooper DA, Corey L, Fiddian AP, Gazzard BG, et al.  Clinical efficacy of high-dose acyclovir in patients with human immunodeficiency virus infection. J Infect Dis. 1998;178:349–359
  15. Cooper DA, Pedersen C, Aiuti F, Vilde JL, Ruhnke M, Pehrson PO, et al.  The efficacy and safety of zidovudine with or without acyclovir in the treatment of patients with AIDS-related complex. AIDS. 1991;5:933–943
  16. Cooper DA, Pehrson O, Pedersen C, Moroni M, Oksenhehdler H, Rozenbaum W, et al.  The efficacy and safety of zidovudine alone or as cotherapy with acyclovir for the treatment of patients with AIDS and AIDS-related complex (a double-blind, randomized trial). AIDS. 1993;7:197–207
  17. Youle MS, Gazzard BG, Johnson MA, Cooper DA, Hoy JF, Busch H, et al.  Effects of high-dose oral acyclovir on herpesvirus disease and survival in patients with advanced HIV disease (a double-blind, placebo-controlled study). AIDS. 1994;8:641–649
  18. Chavanet P, Malet J, Wladner A, Aho S, Buisson M, Biefeld P, et al.  A double-blind randomized placebo trial on very high doses of acyclovir in weakly symptomatic HIV-patients. Cancer Detect Prev. 1990;14:669–673
  19. Collier AC, Bozzette S, Coombs RW, Causey DM, Schoenfeld DA, Spector SA, et al.  A pilot study of low-dose zidovudine in human immunodeficiency virus infection. N Engl J Med. 1990;323:1015–1021
  20. Lavelle J, Lang W, Lefkowitz L, et al. A randomized trial comparing zidovudine alone and in combination with acyclovir for treatment of early symptomatic HIV infection. In: Abstracts of the VIII International Conference on AIDS, Amsterdam, 1992. (Abstract PoB 3585)
  21. Cooper DA, Gazzard GB, Stevens J, Bell AR. The effect of acyclovir cotherapy on survival in individuals with advanced HIV disease. In: Interscience Conference on Antimicrobial Agents and Chemotherapy, 1994 Oct 4–7. (Abstract 61)
  22. Collier AC, Schoenfeld DA, Bourland D, Hirsch M, Davis LG, Corey L. Prospective comparative study of acyclovir and zidovudine versus zidovudine alone in patients with AIDS. In: Abstracts of the 2nd National Conference on Human Retroviruses and Related Infections, January 29–February 2, 1995. (Abstract 383)
  23. Smith GD, Egger M. Meta-analysis. Unresolved issues and future developments. BMJ. 1998;316:221–225
  24. Song F, Freemantle N, Sheldon TA, House A, Watson P, Long A, et al.  Selective serotonin inhibitors (Meta-analysis of efficacy and acceptability). BMJ. 1993;306:683–687
  25. Nakielny J. Effective and acceptable treatment for depression. BMJ. 1993;306:1125
  26. Mulder JW, de Wolf F, Goudsmit J, et al.  Long-term zidovudine treatment of asymptomatic HIV-1 infected subjects. Antiviral Res. 1990;13:127–138
  27. Luxton JC, Williams I, Weller I, Crawford DH. Epstein-Barr virus infection of HIV-seropositive individuals is transiently suppressed by high-dose acyclovir treatment. AIDS. 1993;7:1337–1343
  28. Collier AC, Schoenfel D, Hirsch M, et al.  Lack of effect on survival of high-dose acyclovir and zidovudine compared with zidovudine alone for acquired immunodeficiency syndrome. Antiviral Ther. 1998;3:25–32
  29. Schmid CH, Lau J, McIntosh M, Cappelleri JC. An empirical study of the effect of the control rate as a predictor of treatment efficacy in a meta-analysis of clinical trials. Stat Med. 1998;17:1923–1942
  30. ISIS-4 Collaborative Group . ISIS-4 (A randomized factorial trial assessing early oral captopril, oral mononitrate, and intravenous magnesium sulphate in 58050 patients with suspected acute myocardial infarction). Lancet. 1995;345:669–685
  31. Borzak S, Ridker PM. Discordance between meta-analyses and large-scale randomized, controlled trials. Ann Intern Med. 1995;123:873–877
  32. Hughes MD, Freedman LS, Pocock SJ. The impact of stopping rules on heterogeneity of results in overviews of clinical trials. Biometrics. 1992;48:41–53
  33. Hughes MD, Pocock SJ. Stopping rules and estimation problems in clinical trials. Stat Med. 1988;7:1231–1242
  34. Pocock SJ, Hughes MD. Practical problems in interim analyses, with particular regard to estimation. Control Clin Trials. 1989;10(Suppl. 4):209S–221S
  35. Lau J, Ioannidis JP, Schmid CH. Summing up evidence (One answer is not always enough). Lancet. 1998;351:123–127
  36. Pogue JM, Yusuf S. Cumulative evidence from randomized trials (Utilizing sequential monitoring boundaries for cumulative meta-analysis). Control Clin Trials. 1997;18:580–593
  37. Bero L, Rennie D. The Cochrane Collaboration. JAMA. 1995;274:1935–1938
  38. Villar J, Carroli G, Belizan JM. Predictive ability of meta-analysis of randomized controlled trials. Lancet. 1995;345:772–776
  39. Cappelleri JC, Ioannidis JPA, Schmid CH, et al.  Large trials versus meta-analyses of small trials (How do their results compare?). JAMA. 1996;276:1332–1338
  40. LeLorier J, Gregoire G, Benhaddad A, Lapierre J, Derderian F. Discrepancies between meta-analyses and subsequent large randomized, controlled trials. N Engl J Med. 1997;337:536–542
  41. Ioannidis JPA, Cappelleri JC, Lau J. Issues in comparisons between meta-analyses and large trials. JAMA. 1998;279:1089–1093
  42. Rothwell PM, Robertson G. Meta-analyses of randomised controlled trials. Lancet. 1998;350:1181–1182(Letter)
  43. Egger M, Smith GD, Sterne JAC. Meta-analysis (Is moving the goal post the answer?). Lancet. 1998;351:1517
  44. Ioannidis JP, Cappelleri JC, Lau J, Skalnik PR, Melville B, Chalmers TC, et al.  Early or deferred zidovudine therapy in HIV-infected patients without an AIDS-defining illness (A meta-analysis). Ann Intern Med. 1995;122:856–866
  45. Ioannidis JP, Bassett R, Hughes MD, Valbenting PA, Sacks HS, Lau J. Predictors and impact of patients lost to follow-up in a long-term trial of early versus deferred antiretroviral treatment. J Acquir Immune Defic Syndr Hum Retrovirol. 1997;16:22–30
  46. McIntosh M. The population risk as an explanatory variable in research synthesis of clinical trials. Stat Med. 1996;15:1713–1728
  47. Ioannidis JP, Cappelleri JC, Schmid CH, Lau J. Impact of epidemic and individual heterogeneity on the population distribution of disease progression rates (An example from trials of human immunodeficiency virus infection). Am J Epidemiol. 1996;144:1074–1085
  48. Ioannidis JP, Lau J. The impact of high risk patients on the results of clinical trials. J Clin Epidemiol. 1997;50:1089–1098
  49. Yusuf S, Wites J, Probstfield J, Tyroler HA. Analysis and interpretation of treatment effects in subgroups of patients in randomized clinical trials. JAMA. 1991;266:93–98

PII: S0895-4356(98)00159-0

Journal of Clinical Epidemiology
Volume 52, Issue 4 , Pages 281-291 , April 1999