Advertisement
Review| Volume 79, P3-9, November 2016

A systematic review reveals that the credibility of subgroup claims in low back pain trials was low

  • Bruno T. Saragiotto
    Correspondence
    Corresponding author. Level 3/ 50 Bridge Street, Sydney, New South Wales 2000, Australia.Tel.: +61-2-8052-4300; fax: +61-2-8052-4301.
    Affiliations
    Musculoskeletal Division, The George Institute for Global Health, Sydney Medical School, The University of Sydney, Level 3/50 Bridge Street, 2000, Sydney, NSW, Australia
    Search for articles by this author
  • Chris G. Maher
    Affiliations
    Musculoskeletal Division, The George Institute for Global Health, Sydney Medical School, The University of Sydney, Level 3/50 Bridge Street, 2000, Sydney, NSW, Australia
    Search for articles by this author
  • Anne M. Moseley
    Affiliations
    Musculoskeletal Division, The George Institute for Global Health, Sydney Medical School, The University of Sydney, Level 3/50 Bridge Street, 2000, Sydney, NSW, Australia
    Search for articles by this author
  • Tie P. Yamato
    Affiliations
    Musculoskeletal Division, The George Institute for Global Health, Sydney Medical School, The University of Sydney, Level 3/50 Bridge Street, 2000, Sydney, NSW, Australia
    Search for articles by this author
  • Bart W. Koes
    Affiliations
    Department of General Practice, Erasmus MC, South Holland, Wytemaweg 80, 3015, CN, Rotterdam, The Netherlands
    Search for articles by this author
  • Xin Sun
    Affiliations
    Chinese Evidence-Based Medicine Center, West China Hospital, Sichuan University, Section 3, Ren Min Nan Lu. Chengdu, Sichuan 610041, P.R. China

    Department of Clinical Epidemiology and Biostatistics, Faculty of Health Sciences, McMaster University, 1280 Main Street West, L8S4L8, Hamilton, Ontario, Canada
    Search for articles by this author
  • Mark J. Hancock
    Affiliations
    Faculty of Medicine and Health Sciences, Macquarie University, Balaclava Road, North Ryde, Sydney, New South Wales 2109, Australia
    Search for articles by this author

      Abstract

      Objectives

      To assess the credibility of subgroup claims in back pain randomized controlled trials.

      Study Design and Setting

      A sample of reports of back pain trials from 2000 to 2015 that provided a subgroup claim were included (n=38). Two reviewers independently assessed risk of bias and credibility of subgroup claims as well as the strength of the author's claim. The credibility of subgroup claims was assessed using a 10-criteria tool, and strength of the subgroup claims was assessed based on seven criteria to categorize claims into a reasonably strong claim of a definitive subgroup effect or a more cautious claim of a possible effect.

      Results

      A total of 91 claims of a subgroup effect were reported in the 38 included trials, of which 28 were considered strong claims of a definitive effect, and 63 were cautious claims of a possible effect. None of the subgroup claims met all 10 credibility criteria, and only 24% (22 claims) satisfied at least five criteria. The only criteria satisfied by more than 50% of the claims were if the subgroup variable was a characteristic measured at baseline, and whether the test of interaction was significant. All other criteria were satisfied by less than 30% of the claims. There was no association between the credibility of subgroup claims and the journal impact factor, risk of bias, sample size, or year of publication.

      Conclusion

      The credibility of subgroup claims in back pain trials is usually low, irrespective of the strength of the authors' claim.

      Keywords

      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to Journal of Clinical Epidemiology
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

        • Global Burden of Disease Study
        Global, regional, and national incidence, prevalence, and years lived with disability for 301 acute and chronic diseases and injuries in 188 countries, 1990-2013: a systematic analysis for the Global Burden of Disease Study 2013.
        Lancet. 2014; 386: 743-800
        • Hoy D.
        • March L.
        • Brooks P.
        • Blyth F.
        • Woolf A.
        • Bain C.
        • et al.
        The global burden of low back pain: estimates from the Global Burden of Disease 2010 study.
        Ann Rheum Dis. 2014; 73: 968-974
        • Hoy D.
        • Bain C.
        • Williams G.
        • March L.
        • Brooks P.
        • Blyth F.
        • et al.
        A systematic review of the global prevalence of low back pain.
        Arthritis Rheum. 2012; 64: 2028-2037
        • Chou R.
        • Qaseem A.
        • Snow V.
        • Casey D.
        • Cross Jr., J.T.
        • Shekelle P.
        • et al.
        Diagnosis and treatment of low back pain: a joint clinical practice guideline from the American College of Physicians and the American Pain Society.
        Ann Intern Med. 2007; 147: 478-491
        • van Tulder M.
        • Becker A.
        • Bekkering T.
        • Breen A.
        • del Real M.T.
        • Hutchinson A.
        • et al.
        Chapter 3. European guidelines for the management of acute nonspecific low back pain in primary care.
        Eur Spine J. 2006; 15: S169-S191
        • Kent P.
        • Keating J.
        Do primary-care clinicians think that nonspecific low back pain is one condition?.
        Spine (Phila Pa 1976). 2004; 29: 1022-1031
        • Kent P.
        • Keating J.L.
        Classification in nonspecific low back pain: what methods do primary care clinicians currently use?.
        Spine (Phila Pa 1976). 2005; 30: 1433-1440
        • Fritz J.M.
        • Lindsay W.
        • Matheson J.W.
        • Brennan G.P.
        • Hunter S.J.
        • Moffit S.D.
        • et al.
        Is there a subgroup of patients with low back pain likely to benefit from mechanical traction? Results of a randomized clinical trial and subgrouping analysis.
        Spine (Phila Pa 1976). 2007; 32: E793-E800
        • Kamper S.J.
        • Maher C.G.
        • Hancock M.J.
        • Koes B.W.
        • Croft P.R.
        • Hay E.
        Treatment-based subgroups of low back pain: a guide to appraisal of research studies and a summary of current evidence.
        Best Pract Res Clin Rheumatol. 2010; 24: 181-191
        • Borkan J.M.
        • Koes B.
        • Reis S.
        • Cherkin D.C.
        A report from the second international forum for primary care research on low back pain. Reexamining priorities.
        Spine (Phila Pa 1976). 1998; 23: 1992-1996
        • Guccione A.
        • Goldstein M.
        • Elliott S.
        Clinical research agenda for physical therapy.
        Phys Ther. 2000; 80: 499-513
        • Hancock M.J.
        • Maher C.G.
        • Latimer J.
        • Herbert R.D.
        • McAuley J.H.
        Independent evaluation of a clinical prediction rule for spinal manipulative therapy: a randomised controlled trial.
        Eur Spine J. 2008; 17: 936-943
        • Flynn T.
        • Fritz J.
        • Whitman J.
        • Wainner R.
        • Magel J.
        • Rendeiro D.
        • et al.
        A clinical prediction rule for classifying patients with low back pain who demonstrate short-term improvement with spinal manipulation.
        Spine (Phila Pa 1976). 2002; 27: 2835-2843
        • Childs J.D.
        • Fritz J.M.
        • Flynn T.W.
        • Irrgang J.J.
        • Johnson K.K.
        • Majkowski G.R.
        • et al.
        A clinical prediction rule to identify patients with low back pain most likely to benefit from spinal manipulation: a validation study.
        Ann Intern Med. 2004; 141: 920-928
        • Brennan G.P.
        • Fritz J.M.
        • Hunter S.J.
        • Thackeray A.
        • Delitto A.
        • Erhard R.E.
        Identifying subgroups of patients with acute/subacute “nonspecific” low back pain: results of a randomized clinical trial.
        Spine (Phila Pa 1976). 2006; 31: 623-631
        • Sun X.
        • Briel M.
        • Busse J.W.
        • You J.J.
        • Akl E.A.
        • Mejza F.
        • et al.
        Credibility of claims of subgroup effects in randomised controlled trials: systematic review.
        BMJ. 2012; 344: e1553
        • van Klaveren D.
        • Vergouwe Y.
        • Farooq V.
        • Serruys P.W.
        • Steyerberg E.W.
        Estimates of absolute treatment benefit for individual patients required careful modeling of statistical interactions.
        J Clin Epidemiol. 2015; 68: 1366-1374
        • Hasford J.
        • Bramlage P.
        • Koch G.
        • Lehmacher W.
        • Einhaupl K.
        • Rothwell P.M.
        Inconsistent trial assessments by the National Institute for Health and Clinical Excellence and IQWiG: standards for the performance and interpretation of subgroup analyses are needed.
        J Clin Epidemiol. 2010; 63: 1298-1304
        • Oxman A.D.
        • Guyatt G.H.
        A consumer's guide to subgroup analyses.
        Ann Intern Med. 1992; 116: 78-84
        • Sun X.
        • Briel M.
        • Walter S.D.
        • Guyatt G.H.
        Is a subgroup effect believable? Updating criteria to evaluate the credibility of subgroup analyses.
        BMJ. 2010; 340: c117
        • Stanton T.R.
        • Hancock M.J.
        • Maher C.G.
        • Koes B.W.
        Critical appraisal of clinical prediction rules that aim to optimize treatment selection for musculoskeletal conditions.
        Phys Ther. 2010; 90: 843-854
        • Hancock M.
        • Herbert R.D.
        • Maher C.G.
        A guide to interpretation of studies investigating subgroups of responders to physical therapy interventions.
        Phys Ther. 2009; 89: 698-704
        • Sun X.
        • Briel M.
        • Busse J.W.
        • Akl E.A.
        • You J.J.
        • Mejza F.
        • et al.
        Subgroup Analysis of Trials Is Rarely Easy (SATIRE): a study protocol for a systematic review to characterize the analysis, reporting, and claim of subgroup effects in randomized trials.
        Trials. 2009; 10: 101
        • Sun X.
        • Ioannidis J.P.
        • Agoritsas T.
        • Alba A.C.
        • Guyatt G.
        How to use a subgroup analysis: users' guide to the medical literature.
        JAMA. 2014; 311: 405-411
        • Oxman A.D.
        Subgroup analyses.
        BMJ. 2012; 344: e2022
        • Maher C.G.
        • Sherrington C.
        • Herbert R.D.
        • Moseley A.M.
        • Elkins M.
        Reliability of the PEDro scale for rating quality of randomized controlled trials.
        Phys Ther. 2003; 83: 713-721
        • de Morton N.A.
        The PEDro scale is a valid measure of the methodological quality of clinical trials: a demographic study.
        Aust J Physiother. 2009; 55: 129-133
        • Macedo L.G.
        • Elkins M.R.
        • Maher C.G.
        • Moseley A.M.
        • Herbert R.D.
        • Sherrington C.
        There was evidence of convergent and construct validity of physiotherapy evidence database quality scale for physiotherapy trials.
        J Clin Epidemiol. 2010; 63: 920-925
        • Landis J.
        • Koch G.
        The measurement of observer agreement for categorical data.
        Biometrics. 1977; 33: 159-174
        • Mistry D.
        • Patel S.
        • Hee S.W.
        • Stallard N.
        • Underwood M.
        Evaluating the quality of subgroup analyses in randomized controlled trials of therapist-delivered interventions for nonspecific low back pain: a systematic review.
        Spine (Phila Pa 1976). 2014; 39: 618-629
        • Chan A.W.
        • Hrobjartsson A.
        • Jorgensen K.J.
        • Gotzsche P.C.
        • Altman D.G.
        Discrepancies in sample size calculations and data analyses reported in randomised trials: comparison of publications with protocols.
        BMJ. 2008; 337: a2299
        • Sun X.
        • Briel M.
        • Busse J.W.
        • You J.J.
        • Akl E.A.
        • Mejza F.
        • et al.
        The influence of study characteristics on reporting of subgroup analyses in randomised controlled trials: systematic review.
        BMJ. 2011; 342: d1569