Journal of Clinical Epidemiology
Volume 49, Issue 2 , Pages 235-243 , February 1996

Meta-analyses to evaluate analgesic interventions: A systematic qualitative review of their methodology

  • Alejandro R. Jadad

      Affiliations

    • Oxford Regional Pain Relief Unit, Churchill Hospital, University of Oxford, Oxford, United Kingdom
    • Nuffield Department of Anaesthetics, University of Oxford, Oxford, United Kingdom
    • Current address: Department of Clinical Epidemiology and Biostatistics, McMaster University, 1200 Main Street West, Hamilton, Canada L8N 325.
    • ,
  • Henry J. McQuay

      Affiliations

    • Corresponding Author InformationPlease address correspondence to: Henry J. McQuay, Oxford Regional Pain Relief Unit, Churchill Hospital, Oxford, OX3 7LJ, United Kingdom.
    • Oxford Regional Pain Relief Unit, Churchill Hospital, University of Oxford, Oxford, United Kingdom
    • Nuffield Department of Anaesthetics, University of Oxford, Oxford, United Kingdom

,Revised 11 October 1994

References 

  1. Sacks HS, Berrier J, Reitman D, Ancona-Berk VA, Chalmers TC. Meta-analyses of randomized controlled trials. N Engl J Med. 1987;316:450–455
  2. Gerbarg ZB, Horwitz RI. Resolving conflicting clinical trials: Guidelines for meta-analysis. J Clin Epidemiol. 1988;41:503–509
  3. Kassirer JP. Clinical trials and meta-analysis—what do they do for us?. N Engl J Med. 1992;327:273–274
  4. Goldman L, Feinstein AR. Anticoagulants and myocardial infarction—the problems of pooling, drowning, and floating. Ann Intern Med. 1979;90:92–94
  5. Fleiss JL, Gross AJ. Meta-analysis in epidemiology, with special reference to studies of the association between exposure to environmental tobacco smoke and lung cancer: A critique. J Clin Epidemiol. 1991;44:127–139
  6. Thomson SG, Pocock SJ. Can meta-analysis be trusted?. Lancet. 1991;338:1127–1130
  7. Felson D. Bias in meta-analysis. J Clin Epidemiol. 1992;45:885–892
  8. Oxman AD, Guyatt GH. Validation of an index of the quality of review articles. J Clin Epidemiol. 1991;44:1271–1278
  9. Oxman AD, Guyatt GH, Singer J, Goldsmith CH, Hutchison BG, Milner RA, et al. Agreement among reviewers of review articles. J Clin Epidemiol. 1991;44:91–98
  10. Jadad AR, McQuay HJ. A high-yield strategy to identify randomized controlled trials for systematic reviews. Online J Curr Clin Trials. 1993; (Doc No. 33)
  11. Shrout PE, Fleiss JL. Intraclass correlations: Uses in assessing rater reliability. Psychol Bull. 1979;86:420–428
  12. Duckro PN, Cantwell-Simmonds E. A review of studies evaluating bio-feedback and relaxation training in the management of pediatric headache. Headache. 1989;29:428–433
  13. Amery WK. Prophylactic and curative treatment of migraine with calcium antagonists. Drug Desi Delivery. 1989;4:197–203
  14. Abenhaim L, Bergeron AM. Twenty years of randomized clinical trials of manipulative therapy for back pain: A review. Clin Invest Med. 1992;15:527–535
  15. Gabriel SE, Jaakkimainen L, Bombardier C. The cost-effectiveness of misoprostol for nonsteroidal antiinflammatory drug-associated adverse gastrointestinal events. Arthr Rheum. 1993;36:447–459
  16. Simkin P. Non-pharmacological methods of pain relief during labour. In:  Chalmers I,  Enkin M,  Keirse MJNC editor. Effective Care in Pregnancy and Childbirth. Oxford: Oxford University Press; 1989;p. 893–911
  17. Dickersin K. Pharmacological control of pain during labour. In:  Chalmers I,  Enkin M,  Keirse MJNC editor. Effective Care in Pregnancy and Childbirth. Oxford: Oxford University Press; 1989;p. 913–950
  18. Grant A, Sleep J. Relief of perineal pain and discomfort after childbirth. In:  Chalmers I,  Enkin M,  Keirse MJNC editor. Effective Care in Pregnancy and Childbirth. Oxford: Oxford University Press; 1989;p. 1347–1358
  19. Beecher HK. The powerful placebo. JAMA. 1955;159:1602–1606
  20. Hathaway D. Effect of preoperative instruction on postoperative outcomes: A meta-analysis. Nurs Res. 1986;35:269–275
  21. Penzien DB, Holroyd KA, Hursey KG, Holm JE, Wittchen H. The behavioral treatment of migraine headache: A meta-analytic review of the literature. In: 1987;p. 1–67 Based on a doctoral dissertation by Penzien DB
  22. Bamberg P, Caswell CM, Lam SK, Wong CK. A meta-analysis comparing the efficacy of omeprazole with H2-receptor antagonists for acute treatment of duodenal ulcer in Asian patients. J Gastroenterol Hepatol. 1992;7:577–585
  23. Capell HA, Porter DR, Madhok R, Hunter JA. Second line (disease modifying) treatment in rheumatoid arthritis: Which drug for which patient?. Ann Rheum Dis. 1993;52:423–428
  24. Ballantyne JC, Carr DB, Chalmers TC, Dear DBG, Angelillo IF, Mosteller F. Postoperative patient-controlled analgesia: Meta-analyses of initial randomized control trials. J Clin Anesth. 1993;5:182–193
  25. Radack K, Wyderski RJ. Conservative management of intermittent claudication. Ann Intern Med. 1990;113:135–146
  26. Holroyd KA, Penzien DB. Pharmacological versus non-pharmacological prophylaxis of recurrent migraine headache: A meta-analytic review of clinical trials. Pain. 1990;42:1–13
  27. Malone MD, Strube MJ. Meta-analysis of non-medical treatments for chronic pain. Pain. 1988;34:231–244
  28. Shekelle PG, Adams AH, Chassin MR, Hurwitz EL, Brook RH. Spinal manipulation for low back pain. Ann Intern Med. 1992;117:590–598
  29. Felson DT, Anderson JJ, Meenan RF. The comparative efficacy and toxicity of second-line drugs in rheumatoid arthritis: Results of two metaanalyses. Arthr Rheum. 1990;33:1449–1461
  30. Cutler R, Fishbain D, Rosomoff H, Abdel-Moty E, Khalil T, Steele-Rosomoff R. Does non-surgical treatment of chronic pain return patients to work? A review and meta-analysis of the literature. In: Proc Am Pain Soc Meeting. 1992;p. 83
  31. Chalmers TC, Ballantyne JC, Carr DB, Dear KBG, Angelillo IF, Mosteller F. Comparative effects of analgesic therapies upon postoperative pulmonary function: meta-analyses. In: Abstracts—7th World Congress on Pain. 1993;p. 136
  32. Gøtzsche P. Meta-analysis of NSAIDs: Contribution of drugs, doses, trial designs, and meta-analytic techniques. Scand J Rheumatol. 1993;22:255–260
  33. Gøtzsche PC. Methodology and overt and hidden bias in reports of 196 double-blind trials of nonsteroidal antiinflammatory drugs in rheumatoid arthritis. Control Clin Trials. 1989;10:31–56
  34. Turner JA, Ersek M, Herron L, Deyo R. Surgery for lumbar spinal stenosis: Attempted meta-analysis of the literature. Spine. 1992;17:1–8
  35. Hoffman RM, Kent DL, Deyo RA. Diagnostic accuracy and clinical utility of thermography for lumbar radiculopathy: A meta-analysis. Spine. 1991;16:623–628
  36. Broome ME, Lillis PP, Smith MC. Pain interventions with children: A meta-analysis of research. Nurs Res. 1989;38:154–158
  37. Patel M, Gutzwiller F, Paccaud F, Marazzi A. A meta-analysis of acupuncture for chronic pain. Int J Epidemiol. 1989;18:900–906
  38. Ter Riet G, Kleijnen J, Knipschild P. Acupuncture and chronic pain: A criteria-based meta-analysis. J Clin Epidemiol. 1990;43:1191–1199
  39. Chalmers TC, Berrier J, Hewitt P, Berlin J, Reitman D, Nagalingam R, et al.  Meta-analysis of randomized controlled trials as a method of estimating rare complications of non-steroidal anti-inflammatory drug therapy. Aliment Pharmacol Therapeut. 1988;2:9–26
  40. Gabriel SE, Jaakkimainen L, Bombardier C. Risk of serious gastrointestinal complications related to use of nonsteroidal anti-inflammatory drugs. Ann Intern Med. 1991;115:787–796
  41. Bollini P, Garcia-Rodriguez LA, Perez-Gutthann S, Walker AM. The impact of research quality and study design on epidemiologic estimates of the effect of non-steroidal anti-inflammatory drugs on upper gastrointestinal tract disease. Arch Intern Med. 1992;152:1289–1295
  42. Ottenbacher K, Difabio RP. Efficacy of spinal manipulation/mobilization therapy: A meta-analysis. Spine. 1985;10:833–837
  43. Anderson R, Meeker WC, Wirick BE, Mootz RD, Kirk DH, Adams A. A meta-analysis of clinical trials of spinal manipulation. J Manipulative Physiol Therapeut. 1992;15:181–194
  44. Felson DT, Anderson JJ, Meenan RF. Use of short-term efficacy/toxicity tradeoffs to select second-line drugs in rheumatoid arthritis—a meta-analysis of published clinical trials. Arthr Rheum. 1992;35:1117–1125
  45. Koes BW, Assendelft WJJ, Van der Heijden GJM, Bouter LM, Knipschild PG. Spinal manipulation and mobilisation for back and neck pain: A blinded review. Br Med J. 1991;303:1298–1303
  46. Gøtzsche PC, Pødenphant J, Olesen M, Halberg P. Meta-analysis of second-line antirheumatic drugs: Sample bias and uncertain benefit. J Clin Epidemiol. 1992;45:587–594
  47. Beckerman H, de-Bie RA, Bouter LM, De-Cuyper HJ, Oostendorp RAB. The efficacy of laser therapy for musculoskeletal and skin disorders: A criteria-based meta-analysis of randomized clinical trials. Phys Ther. 1992;72:483–491
  48. Gam AN, Thorsen H, Lønnberg F. The effect of low-level laser therapy on musculoskeletal pain: A meta-analysis. Pain. 1993;52:63–66
  49. Schmader KE, Studenski S. Are current therapies useful for the prevention of postherpetic neuralgia. J Gen Intern Med. 1989;4:83–89
  50. Lycka BAS. Postherpetic neuralgia and systemic corticosteroid therapy: Efficacy and safety. Int J Dermatol. 1990;29:523–527
  51. Naldi L, Zucchi A, Brevi A, Cavalieri D'Oro L, Cainelli T. Corticosteroids and post-herpetic neuralgia. Lancet. 1990;336:947
  52. Crooks RJ, Jones DA, Fiddian P. Zoster-associated chronic pain: An overview of clinical trials with acyclovir. Scand J Infect. 1991;78:62–68 (Suppl.)
  53. Wilkie DJ, Savedra MC, Holzemer WL, Tesler MD, Paul SM. Use of the McGill Pain Questionnaire to measure pain: A meta-analysis. Nurs Res. 1990;39:36–40
  54. Holroyd KA, Penzien DB, Cordingley GE. Propranolol in the management of recurrent migraine: A meta-analytic review. Headache. 1991;31:333–340
  55. Holroyd KA, Penzien DB. Client variables and the behavioral treatment of recurrent tension headache: A meta-analytic review. J Behav Med. 1986;9:515–535
  56. Antczak-Bouckoms A, Tung F, Chalmers TC, Bouckoms A. Quality assessment and meta-analysis of randomized control trials of ibuprofen. Pain. 1987;S51; (Suppl.)
  57. Haase W, Fischer M. Statistische Metaanalyse von multizentrischen klinischen Studien mit Ibuprofen im Himblick auf die Kohortengröβe. Z Rheumatol. 1991;50:77–83
  58. Vaiani G, Grossi E. Meta-analysis of Italian clinical trials of nabumetone. Drugs. 1990;(Suppl. 5):48–59
  59. Schiassi M, Bianchini C, Restelli A, Zoni G. Tolerability profile of the antiinflammatory compound imidazole salicylate: A meta-analysis of safety data in 1408 patients. Int J Tiss React. 1989;11:321–326
  60. Suls J, Fletcher B. The relative efficacy of avoidant and nonavoidant coping strategies: A meta-analysis. Health Psychol. 1985;4:249–288
  61. Suls J, Wan CK. Effects of sensory and procedural information on coping with stressful medical procedures and pain: A meta-analysis. J Consult Clin Psychol. 1989;57:372–379
  62. Sand T. Which factors affect reported headache incidences after lumbar myelography? A statistical analysis of publications in the literature. Neuroradiology. 1989;31:55–59
  63. Sacks HS, Ancona-Berk VA, Berrier J, Nagalingam R, Chalmers TC. Dipyridamole in the treatment of angina pectoris: A meta-analysis. Clin Pharmacol Therapeut. 1988;43:610–615
  64. Robinson M, Mills RJ, Euler AR. Ranitidine prevents duodenal ulcers associated with non-steroidal anti-inflammatory drug therapy. Aliment Pharmacol Therapeut. 1991;5:143–150
  65. Mullen PD, Laville EA, Biddle AK, Lorig K. Efficacy of psychoeducational interventions on pain, depression, and disability in people with arthritis: A meta-analysis. J Rheumatol. 1987;14:33–39
  66. Gøtzsche PC. Patients' preference in indomethacin trials: An overview. Lancet. 1989;1:88–91
  67. Bosi-Ferraz M, Tugwell P, Goldsmith CH, Atra E. Meta-analysis of sulfasalazine in ankylosing spondylitis. J Rheumatol. 1990;17:1482–1486
  68. Flor H, Fydrich T, Turk DC. Efficacy of multidisciplinary pain treatment centers: A meta-analytic review. Pain. 1992;49:221–230
  69. Bosi-Ferraz M, Atra E. Metaanálise: Nova opcao em pesquisa clínica. Rev Paul Med. 1989;107(1):5–9
  70. Fernandez E, Turk DC. The utility of cognitive coping strategies for altering pain perception: A meta-analysis. Pain. 1989;38:123–135
  71. Devine EC, Cook TD. Clinical and cost-saving effects of psychoeducational interventions with surgical patients: A meta-analysis. Res Nurs Health. 1986;9:89–105
  72. Blanchard EB, Andrasik F, Ahles TA, Teders ST, O'Keefe D. Migraine and tension headache: A meta-analytic review. Behav Ther. 1980;11:613–631
  73. Onghena P, Van Houdenhove B. Antidepressant-induced analgesia in chronic non-malignant pain: A meta-analysis of 39 placebo controlled studies. Pain. 1992;49:205–219
  74. Hyman RB, Feldman HR, Harris RB, Levin RF, Malloy GB. The effects of relaxation training on clinical symptoms: A meta-analysis. Nurs Res. 1989;38:216–220
  75. Penzien DB, Rains JC, Holroyd KA. A review of alternative behavioral treatments for headache. Mississippi Psychol. 1992;17:8–9
  76. Holroyd KA, Athens OH, Penzien DB, Jackson MS, Rokicki LA, Cordingley GE. Flunarizine vs propranolol: A meta-analysis of clinical trials. Headache. 1992;32:256
  77. Penzien DB, Holroyd KA. The behavioral treatment of migraine headache: A meta-analytic review of the literature. Dissertation Abstracts Int. 1987;47: Order No. DA8629941
  78. Gøtzsche PC. Sensitivity of effect variables in rheumatoid arthritis: A meta-analysis of 130 placebo controlled NSAIDs trials. J Clin Epidemiol. 1990;43:1313–1318
  79. Gøtzsche PC. Meta-analysis of grip strength: Most common, but superfluous variable in comparative NSAID trials. Dan Med Bull. 1989;36:493–495
  80. Pace NL. Prevention of succinylcholine myalgias: A meta-analysis. Anesth Analg. 1990;70:477–483
  81. Geis GS. Overall safety of Arthrotec. Scand J Rheumatol. 1992;(Suppl. 96):33–36
  82. Blanchard EB, Andrasik F. Psychological assessment and treatment of headache: Recent developments and emerging issues. J Consult Clin Psychol. 1982;50:859–879
  83. Lataste X, Taylor P, Notter M. DHE nasal spray in the acute management of migraine attacks. Cephalalgia. 1989;9:342–343
  84. Cutler RB, Fishbain DA, Rosomoff HL, Abdel-Moty E, Khalil TM, Rosomoff RS. Does non-surgical pain center treatment of chronic pain return patients to work?. Spine. 1994;19:643–652
  85. Laska EM, Sunshine A, Mueller F, Elvers WB, Siegel C, Rubin A. Caffeine as an analgesic adjuvant. Clin Pharmacol Ther. 1984;251:1711–1718
  86. Amery WK. Onset of action of various migraine prophylactics. Cephalalgia. 1988;8:11–13
  87. Carr D, Eisenberg E, Chalmers TC. Neurolytic celiac plexus block for cancer pain—a meta-analysis. In: Abstracts—7th World Congress on Pain. 1993;p. 338
  88. Koes BW, Bouter LM, Beckerman H, Van der Heijden GJM, Knipschild PG. Physiotherapy exercises and back pain: A blinded review. Br Med J. 1991;302:1572–1576
  89. Devine EC. Effects of psychoeducational care for adult surgical patients: A meta-analysis of 191 studies. Patient Educ Counsel. 1992;19:129–142
  90. Johanson JF, Rimm A. Optimal nonsurgical treatment of hemorrhoids: A comparative analysis of infrared coagulation, rubber band ligation and injection sclerotherapy. Am J Gastroenterol. 1992;87:1601–1606
  91. Pope JE, Anderson JJ, Felson DT. A meta-analysis of the effects of nonsteroidal anti-inflammatory drugs on blood pressure. Arch Intern Med. 1993;153:477–484
  92. Capurso L, Koch M. Prevention of NSAID-induced gastric lesions: H2 antagonists or misoprostol? A meta-analysis of controlled clinical trials. Clin Terapeut. 1991;139:179–189
  93. Howell C, Chalmers I. A review of prospectively controlled comparisons of epidural with non-epidural forms of pain relief during labour. Int J Obstet Anesth. 1991;2:1–17
  94. Radack K, Deck C. β-Adrenergic blocker therapy does not worsen intermittent claudication in subjects with peripheral arterial disease: A meta-analysis of randomized controlled trials. Arch Intern Med. 1992;151:1769–1776
  95. Broome ME, Lillis PP. A descriptive analysis of the pediatric pain management research. Appl Nurs Res. 1989;2:74–81
  96. Dickersin K, Higgins K, Meinert CL. Identification of meta-analyses: The need for standard terminology. Control Clin Trials. 1990;11:52–66
  97. Felson DT, Anderson JJ. Critique of meta-analysis of second-line anti-rheumatic drugs. J Clin Epidemiol. 1993;46:315–321
  98. Gøtzsche PC, Pødenphant J, Olensen M, Halberg P. Response to “Critique of meta-analysis of second-line antirheumatic drugs”. J Clin Epidemiol. 1993;46:319–321
  99. Eysenck HJ. An exercise of meta-silliness. Am Psychol. 1978;33:517
  100. Wachter KW. Disturbed by meta-analysis?. Science. 1988;241:1407–1408

PII: 0895-4356(95)00062-3

Journal of Clinical Epidemiology
Volume 49, Issue 2 , Pages 235-243 , February 1996

Article Tools