Advertisement
Review| Volume 101, P87-106.e2, September 2018

Minimum clinically important differences in chronic pain vary considerably by baseline pain and methodological factors: systematic review of empirical studies

      Abstract

      Background

      The minimum clinically important difference (MCID) is used to interpret the relevance of treatment effects, e.g., when developing clinical guidelines, evaluating trial results or planning sample sizes. There is currently no agreement on an appropriate MCID in chronic pain and little is known about which contextual factors cause variation.

      Methods

      This is a systematic review. We searched PubMed, EMBASE, and Cochrane Library. Eligible studies determined MCID for chronic pain based on a one-dimensional pain scale, a patient-reported transition scale of perceived improvement, and either a mean change analysis (mean difference in pain among minimally improved patients) or a threshold analysis (pain reduction associated with best sensitivity and specificity for identifying minimally improved patients). Main results were descriptively summarized due to considerable heterogeneity, which were quantified using meta-analyses and explored using subgroup analyses and metaregression.

      Results

      We included 66 studies (31.254 patients). Median absolute MCID was 23 mm on a 0–100 mm scale (interquartile range [IQR] 12–39) and median relative MCID was 34% (IQR 22–45) among studies using the mean change approach. In both cases, heterogeneity was very high: absolute MCID I2 = 99% and relative MCID I2 = 96%. High variation was also seen among studies using the threshold approach: median absolute MCID was 20 mm (IQR 15–30) and relative MCID was 32% (IQR 15–41). Absolute MCID was strongly associated with baseline pain, explaining approximately two-thirds of the variation, and to a lesser degree with the operational definition of minimum pain relief and clinical condition. A total of 15 clinical and methodological factors were assessed as possible causes for variation in MCID.

      Conclusions

      MCID for chronic pain relief vary considerably. Baseline pain is strongly associated with absolute, but not relative, measures. To a much lesser degree, MCID is also influenced by the operational definition of relevant pain relief and possibly by clinical condition. Explicit and conscientious reflections on the choice of an MCID are required when classifying effect sizes as clinically important or trivial.

      Keywords

      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to Journal of Clinical Epidemiology
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

        • Gross A.
        • Miller J.
        • D'Sylva J.
        • Burnie S.J.
        • Goldsmith C.H.
        • Graham N.
        • et al.
        Manipulation or mobilisation for neck pain: a Cochrane Review.
        Man Ther. 2010; 15: 315-333
        • Wandel S.
        • Jüni P.
        • Tendal B.
        • Nüesch E.
        • Villiger P.M.
        • Welton N.J.
        • et al.
        Effects of glucosamine, chondroitin, or placebo in patients with osteoarthritis of hip or knee: network meta-analysis.
        BMJ. 2010; 341: c4675
        • da Costa B.R.
        • Nüesch E.
        • Kasteler R.
        • Husni E.
        • Welch V.
        • Rutjes A.W.S.
        • et al.
        Oral or transdermal opioids for osteoarthritis of the knee or hip.
        Cochrane Database Syst Rev. 2014; 9: CD003115
        • Machado G.C.
        • Maher C.G.
        • Ferreira P.H.
        • Pinheiro M.B.
        • Lin C.-W.C.
        • Day R.O.
        • et al.
        Efficacy and safety of paracetamol for spinal pain and osteoarthritis: systematic review and meta-analysis of randomised placebo controlled trials.
        BMJ. 2015; 350: h1225
        • Pillastrini P.
        • Rocchi G.
        • Deserri D.
        • Foschi P.
        • Mardegan M.
        • Naldi M.T.
        • et al.
        Effectiveness of neuromuscular taping on painful hemiplegic shoulder: a randomised clinical trial.
        Disabil Rehabil. 2016; 38: 1603-1609
        • Crosby R.D.
        • Kolotkin R.L.
        • Williams G.R.
        Defining clinically meaningful change in health-related quality of life.
        J Clin Epidemiol. 2003; 56: 395-407
        • Dworkin R.H.
        • Turk D.C.
        • Wyrwich K.W.
        • Beaton D.
        • Cleeland C.S.
        • Farrar J.T.
        • et al.
        Interpreting the clinical importance of treatment outcomes in chronic pain clinical trials: IMMPACT recommendations.
        J Pain. 2008; 9: 105-121
        • Glassman S.D.
        • Copay A.G.
        • Berven S.H.
        • Polly D.W.
        • Subach B.R.
        • Carreon L.Y.
        Defining substantial clinical benefit following lumbar spine arthrodesis.
        J Bone Joint Surg Am. 2008; 90: 1839-1847
        • Johnston B.C.
        • Thorlund K.
        • da Costa B.R.
        • Furukawa T.A.
        • Guyatt G.H.
        New methods can extend the use of minimal important difference units in meta-analyses of continuous outcome measures.
        J Clin Epidemiol. 2012; 65: 817-826
        • Chansirinukor W.
        • Maher C.G.
        • Latimer J.
        • Hush J.
        Comparison of the functional rating index and the 18-item Roland-Morris disability questionnaire: responsiveness and reliability.
        Spine. 2005; 30: 141-145
        • Ostelo R.W.
        • Deyo R.A.
        • Stratford P.
        • Waddell G.
        • Croft P.
        • Von Korff M.
        • et al.
        Interpreting change scores for pain and functional status in low back pain: towards international consensus regarding minimal important change.
        Spine (Phila Pa 1976). 2008; 33: 90-94
        • Black N.
        Patient reported outcome measures could help transform healthcare.
        BMJ. 2013; 346: f167
        • Stauffer M.E.
        • Taylor S.D.
        • Watson D.J.
        • Peloso P.M.
        • Morrison A.
        Definition of nonresponse to analgesic treatment of arthritic pain: an analytical literature review of the smallest detectable difference, the minimal detectable change, and the minimal clinically important difference on the pain visual analog scale.
        Int J Inflamm. 2011; 2011: 231926
        • Guyatt G.H.
        • Osoba D.
        • Wu A.W.
        • Wyrwich K.W.
        • Norman G.R.
        Clinical significance consensus meeting group. Methods to explain the clinical significance of health status measures.
        Mayo Clin Proc. 2002; 77: 371-383
        • Deyo R.A.
        • Centor R.M.
        Assessing the responsiveness of functional scales to clinical change: an analogy to diagnostic test performance.
        J Chronic Dis. 1986; 39: 897-906
        • Auffinger B.
        • Lam S.
        • Shen J.
        • Thaci B.
        • Roitberg B.Z.
        Usefulness of minimum clinically important difference for assessing patients with subaxial degenerative cervical spine disease: statistical versus substantial clinical benefit.
        Acta Neurochir (Wien). 2013; 155 (discussion 2355): 2345-2354
        • Beurskens A.J.
        • de Vet H.C.
        • Köke A.J.
        Responsiveness of functional status in low back pain: a comparison of different instruments.
        Pain. 1996; 65: 71-76
        • Carreon L.Y.
        • Glassman S.D.
        • Campbell M.J.
        • Anderson P.A.
        Neck Disability Index, short form-36 physical component summary, and pain scales for neck and arm pain: the minimum clinically important difference and substantial clinical benefit after cervical spine fusion.
        Spine J. 2010; 10: 469-474
        • Childs J.D.
        • Piva S.R.
        • Fritz J.M.
        Responsiveness of the numeric pain rating scale in patients with low back pain.
        Spine. 2005; 30: 1331-1334
        • Cleland J.A.
        • Childs J.D.
        • Whitman J.M.
        Psychometric properties of the neck disability index and numeric pain rating scale in patients with mechanical neck pain.
        Arch Phys Med Rehabil. 2008; 89: 69-74
        • Coelho R.A.
        • Siqueira F.B.
        • Ferreira P.H.
        • Ferreira M.L.
        Responsiveness of the Brazilian-Portuguese version of the oswestry disability index in subjects with low back pain.
        Eur Spine J. 2008; 17: 1101-1106
        • Colangelo K.J.
        • Pope J.E.
        • Peschken C.
        The minimally important difference for patient reported outcomes in systemic lupus erythematosus including the HAQ-DI, pain, fatigue, and SF-36.
        J Rheumatol. 2009; 36: 2231-2237
        • Copay A.G.
        • Glassman S.D.
        • Subach B.R.
        • Berven S.
        • Schuler T.C.
        • Carreon L.Y.
        Minimum clinically important difference in lumbar spine surgery patients: a choice of methods using the oswestry disability index, medical outcomes study questionnaire short form 36, and pain scales.
        Spine J. 2008; 8: 968-974
        • Crossley K.M.
        • Bennell K.L.
        • Cowan S.M.
        • Green S.
        Analysis of outcome measures for persons with patellofemoral pain: which are reliable and valid?.
        Arch Phys Med Rehabil. 2004; 85: 815-822
        • Dhanani S.
        • Quenneville J.
        • Perron M.
        • Abdolell M.
        • Feldman B.M.
        Minimal difference in pain associated with change in quality of life in children with rheumatic disease.
        Arthritis Rheum. 2002; 47: 501-505
        • Dunkl P.R.
        • Taylor A.G.
        • McConnell G.G.
        • Alfano A.P.
        • Conaway M.R.
        Responsiveness of fibromyalgia clinical trial outcome measures.
        J Rheumatol. 2000; 27: 2683-2691
        • Eberle E.
        • Ottillinger B.
        Clinically relevant change and clinically relevant difference in knee osteoarthritis.
        Osteoarthritis Cartilage. 1999; 7: 502-503
        • Emshoff R.
        • Emshoff I.
        • Bertram S.
        Estimation of clinically important change for visual analog scales measuring chronic temporomandibular disorder pain.
        J Orofac Pain. 2010; 24: 262-269
        • Emshoff R.
        • Bertram S.
        • Emshoff I.
        Clinically important difference thresholds of the visual analog scale: a conceptual model for identifying meaningful intraindividual changes for pain intensity.
        Pain. 2011; 152: 2277-2282
        • Farrar J.T.
        • Young Jr., J.P.
        • LaMoreaux L.
        • Werth J.L.
        • Poole R.M.
        Clinical importance of changes in chronic pain intensity measured on an 11-point numerical pain rating scale.
        Pain. 2001; 94: 149-158
        • Farrar J.T.
        • Pritchett Y.L.
        • Robinson M.
        • Prakash A.
        • Chappell A.
        The clinical importance of changes in the 0 to 10 numeric rating scale for worst, least, and average pain intensity: analyses of data from clinical trials of duloxetine in pain disorders.
        J Pain. 2010; 11: 109-118
        • Forouzanfar T.
        • Weber W.E.
        • Kemler M.
        • van Kleef M.
        What is a meaningful pain reduction in patients with complex regional pain syndrome type 1?.
        Clin J Pain. 2003; 19: 281-285
        • Giraudeau B.
        • Rozenberg S.
        • Valat J.-P.
        Assessment of the clinically relevant change in pain for patients with sciatica.
        Ann Rheum Dis. 2004; 63: 1180-1181
        • Grotle M.
        • Brox J.I.
        • Vøllestad N.K.
        Concurrent comparison of responsiveness in pain and functional status measurements used for patients with low back pain.
        Spine. 2004; 29: E492-E501
        • Gum J.L.
        • Glassman S.D.
        • Carreon L.Y.
        Clinically important deterioration in patients undergoing lumbar spine surgery: a choice of evaluation methods using the Oswestry Disability Index, 36-Item Short Form Health Survey, and pain scales: clinical article.
        J Neurosurg Spine. 2013; 19: 564-568
        • Hanley M.A.
        • Jensen M.P.
        • Ehde D.M.
        • Robinson L.R.
        • Cardenas D.D.
        • Turner J.A.
        • et al.
        Clinically significant change in pain intensity ratings in persons with spinal cord injury or amputation.
        Clin J Pain. 2006; 22: 25-31
        • Hirschfeld G.
        • Wager J.
        • Schmidt P.
        • Zernikow B.
        Minimally clinically significant differences for adolescents with chronic pain-variability of ROC-based cut points.
        J Pain. 2014; 15: 32-39
        • Hägg O.
        • Fritzell P.
        • Nordwall A.
        • Swedish Lumbar Spine Study Group
        The clinical importance of changes in outcome scores after treatment for chronic low back pain.
        Eur Spine J. 2003; 12: 12-20
        • ten Klooster P.M.
        • Drossaers-Bakker K.W.
        • Taal E.
        • van de Laar M.A.
        Patient-perceived satisfactory improvement (PPSI): interpreting meaningful change in pain from the patient's perspective.
        Pain. 2006; 121: 151-157
        • Kovacs F.M.
        • Abraira V.
        • Royuela A.
        • Corcoll J.
        • Alegre L.
        • Cano A.
        • et al.
        Minimal clinically important change for pain intensity and disability in patients with nonspecific low back pain. [Miscellaneous article].
        Spine (Phila Pa 1976). 2007; 32: 2915-2920
        • Kovacs F.M.
        • Bagó J.
        • Royuela A.
        • Seco J.
        • Giménez S.
        • Muriel A.
        • et al.
        Psychometric characteristics of the Spanish version of instruments to measure neck pain disability.
        BMC Musculoskelet Disord. 2008; 9: 42
        • Kvamme M.K.
        • Kristiansen I.S.
        • Lie E.
        • Kvien T.K.
        Identification of cutpoints for acceptable health status and important improvement in patient-reported outcomes, in rheumatoid arthritis, psoriatic arthritis, and ankylosing spondylitis.
        J Rheumatol. 2010; 37: 26-31
        • Kwok T.
        • Pope J.E.
        Minimally important difference for patient-reported outcomes in psoriatic arthritis: health Assessment Questionnaire and pain, fatigue, and global visual analog scales.
        J Rheumatol. 2010; 37: 1024-1028
        • Lauche R.
        • Langhorst J.
        • Dobos G.J.
        • Cramer H.
        Clinically meaningful differences in pain, disability and quality of life for chronic nonspecific neck pain - a reanalysis of 4 randomized controlled trials of cupping therapy.
        Complement Ther Med. 2013; 21: 342-347
        • Lauridsen H.H.
        • Hartvigsen J.
        • Manniche C.
        • Korsholm L.
        • Grunnet-Nilsson N.
        Danish version of the oswestry disability index for patients with low back pain. Part 2: sensitivity, specificity and clinically significant improvement in two low back pain populations.
        Eur Spine J. 2006; 15: 1717-1728
        • Lauridsen H.H.
        • Hartvigsen J.
        • Manniche C.
        • Korsholm L.
        • Grunnet-Nilsson N.
        Responsiveness and minimal clinically important difference for pain and disability instruments in low back pain patients.
        BMC Musculoskelet Disord. 2006; 7: 82
        • Lauridsen H.H.
        • Manniche C.
        • Korsholm L.
        • Grunnet-Nilsson N.
        • Hartvigsen J.
        What is an acceptable outcome of treatment before it begins? Methodological considerations and implications for patients with chronic low back pain.
        Eur Spine J. 2009; 18: 1858-1866
        • Mannion A.F.
        • Junge A.
        • Fairbank J.C.T.
        • Dvorak J.
        • Grob D.
        Development of a German version of the oswestry disability index. Part 1: cross-cultural adaptation, reliability, and validity.
        Eur Spine J. 2006; 15: 55-65
        • Maughan E.F.
        • Lewis J.S.
        Outcome measures in chronic low back pain.
        Eur Spine J. 2010; 19: 1484-1494
        • Mesrian A.
        • Neubauer E.
        • Schiltenwolf M.
        Reduction in pain intensity after treatment for chronic back pain. When is it clinically meaningful?.
        Schmerz. 2007; 21 (214–7): 212
        • Parker S.L.
        • Adogwa O.
        • Paul A.R.
        • Anderson W.N.
        • Aaronson O.
        • Cheng J.S.
        • et al.
        Utility of minimum clinically important difference in assessing pain, disability, and health state after transforaminal lumbar interbody fusion for degenerative lumbar spondylolisthesis.
        J Neurosurg Spine. 2011; 14: 598-604
        • Parker S.L.
        • Mendenhall S.K.
        • Shau D.N.
        • Adogwa O.
        • Anderson W.N.
        • Devin C.J.
        • et al.
        Minimum clinically important difference in pain, disability, and quality of life after neural decompression and fusion for same-level recurrent lumbar stenosis: understanding clinical versus statistical significance.
        J Neurosurg Spine. 2012; 16: 471-478
        • Parker S.L.
        • Mendenhall S.K.
        • Shau D.
        • Adogwa O.
        • Cheng J.S.
        • Anderson W.N.
        • et al.
        Determination of minimum clinically important difference in pain, disability, and quality of life after extension of fusion for adjacent-segment disease.
        J Neurosurg Spine. 2012; 16: 61-67
        • Parker S.L.
        • Godil S.S.
        • Shau D.N.
        • Mendenhall S.K.
        • McGirt M.J.
        Assessment of the minimum clinically important difference in pain, disability, and quality of life after anterior cervical discectomy and fusion: clinical article.
        J Neurosurg Spine. 2013; 18: 154-160
        • Parker S.L.
        • Godil S.S.
        • Zuckerman S.L.
        • Mendenhall S.K.
        • Wells J.A.
        • Shau D.N.
        • et al.
        Comprehensive assessment of 1-year outcomes and determination of minimum clinically important difference in pain, disability, and quality of life after suboccipital decompression for chiari malformation I in adults.
        Neurosurgery. 2013; 73 (discussion 581): 569-581
        • Perrot S.
        • Bertin P.
        “Feeling better” or “feeling well” in usual care of hip and knee osteoarthritis pain: determination of cutoff points for patient acceptable symptom state (PASS) and minimal clinically important improvement (MCII) at rest and on movement in a national multicenter cohort study of 2414 patients with painful osteoarthritis.
        Pain. 2013; 154: 248-256
        • Pool J.J.M.
        • Ostelo R.W.J.G.
        • Hoving J.L.
        • Bouter L.M.
        • de Vet H.C.W.
        Minimal clinically important change of the neck disability index and the numerical rating scale for patients with neck pain.
        Spine. 2007; 32: 3047-3051
        • Pope J.E.
        • Khanna D.
        • Norrie D.
        • Ouimet J.M.
        The minimally important difference for the health assessment questionnaire in rheumatoid arthritis clinical practice is smaller than in randomized controlled trials.
        J Rheumatol. 2009; 36: 254-259
        • Reddy V.K.
        • Parker S.L.
        • Patrawala S.A.
        • Lockney D.T.
        • Su P.-F.
        • Mericle R.A.
        Microvascular decompression for classic trigeminal neuralgia: determination of minimum clinically important difference in pain improvement for patient reported outcomes.
        Neurosurgery. 2013; 72 (discussion 754): 749-754
        • Reddy V.K.
        • Parker S.L.
        • Lockney D.T.
        • Patrawala S.A.
        • Su P.-F.
        • Mericle R.A.
        Percutaneous stereotactic radiofrequency lesioning for trigeminal neuralgia: determination of minimum clinically important difference in pain improvement for patient-reported outcomes. [Miscellaneous article].
        Neurosurg. 2014; 74: 262-266
        • van der Roer N.
        • Ostelo R.W.J.G.
        • Bekkering G.E.
        • van Tulder M.W.
        • de Vet H.C.W.
        Minimal clinically important change for pain intensity, functional status, and general health status in patients with nonspecific low back pain.
        Spine. 2006; 31: 578-582
        • Salaffi F.
        • Stancati A.
        • Silvestri C.A.
        • Ciapetti A.
        • Grassi W.
        Minimal clinically important changes in chronic musculoskeletal pain intensity measured on a numerical rating scale.
        Eur J Pain. 2004; 8: 283-291
        • Saps M.
        • Lavigne J.V.
        Abdominal pain endpoints currently recommended by the FDA and EMA for adult patients with irritable bowel syndrome may not be reliable in children.
        Neurogastroenterol Motil. 2015; 27: 849-855
        • Sekhon S.
        • Pope J.
        • Baron M.
        • Canadian Scleroderma Research Group
        The minimally important difference in clinical practice for patient-centered outcomes including health assessment questionnaire, fatigue, pain, sleep, global visual analog scale, and SF-36 in scleroderma.
        J Rheumatol. 2010; 37: 591-598
        • Sheldon E.A.
        • Bird S.R.
        • Smugar S.S.
        • Tershakovec A.M.
        Correlation of measures of pain, function, and overall response: results pooled from two identical studies of etoricoxib in chronic low back pain.
        Spine. 2008; 33: 533-538
        • Solberg T.
        • Johnsen L.G.
        • Nygaard Ø.P.
        • Grotle M.
        Can we define success criteria for lumbar disc surgery? : estimates for a substantial amount of improvement in core outcome measures.
        Acta Orthop. 2013; 84: 196-201
        • Strand L.I.
        • Ljunggren A.E.
        • Bogen B.
        • Ask T.
        • Johnsen T.B.
        The Short-Form McGill Pain Questionnaire as an outcome measure: test-retest reliability and responsiveness to change.
        Eur J Pain. 2008; 12: 917-925
        • Tashjian R.Z.
        • Deloach J.
        • Porucznik C.A.
        • Powell A.P.
        Minimal clinically important differences (MCID) and patient acceptable symptomatic state (PASS) for visual analog scales (VAS) measuring pain in patients treated for rotator cuff disease.
        J Shoulder Elb Surg. 2009; 18: 927-932
        • Tubach F.
        • Wells G.A.
        • Ravaud P.
        • Dougados M.
        Minimal clinically important difference, low disease activity state, and patient acceptable symptom state: methodological issues.
        J Rheumatol. 2005; 32: 2025-2029
        • Tubach F.
        • Ravaud P.
        • Baron G.
        • Falissard B.
        • Logeart I.
        • Bellamy N.
        • et al.
        Evaluation of clinically relevant states in patient reported outcomes in knee and hip osteoarthritis: the patient acceptable symptom state.
        Ann Rheum Dis. 2005; 64: 34-37
        • Tubach F.
        • Ravaud P.
        • Martin-Mola E.
        • Awada H.
        • Bellamy N.
        • Bombardier C.
        • et al.
        Minimum clinically important improvement and patient acceptable symptom state in pain and function in rheumatoid arthritis, ankylosing spondylitis, chronic back pain, hand osteoarthritis, and hip and knee osteoarthritis: results from a prospective multinational study.
        Arthritis Care Res (Hoboken). 2012; 64: 1699-1707
        • de Vet H.C.
        • Ostelo R.W.
        • Terwee C.B.
        • van der Roer N.
        • Knol D.L.
        • Beckerman H.
        • et al.
        Minimally important change determined by a visual method integrating an anchor-based and a distribution-based approach.
        Qual Life Res. 2007; 16: 131-142
        • de Vet H.C.
        • Foumani M.
        • Scholten M.A.
        • Jacobs W.C.
        • Stiggelbout A.M.
        • Knol D.L.
        • et al.
        Minimally important change values of a measurement instrument depend more on baseline values than on the type of intervention.
        J Clin Epidemiol. 2015; 68: 518-524
        • Wheaton L.
        • Pope J.
        The minimally important difference for patient-reported outcomes in spondyloarthropathies including pain, fatigue, sleep, and health assessment questionnaire.
        J Rheumatol. 2010; 37: 816-822
        • Young I.A.
        • Cleland J.A.
        • Michener L.A.
        • Brown C.
        Reliability, construct validity, and responsiveness of the neck disability index, patient-specific functional scale, and numeric pain rating scale in patients with cervical radiculopathy.
        Am J Phys Med Rehabil. 2010; 89: 831-839
        • Beurskens A.J.
        • de Vet H.C.
        • Köke A.J.
        • van der Heijden G.J.
        • Knipschild P.G.
        Measuring the functional status of patients with low back pain. Assessment of the quality of four disease-specific questionnaires.
        Spine. 1995; 20: 1017-1028
        • Lambert P.C.
        • Sutton A.J.
        • Abrams K.R.
        • Jones D.R.
        A comparison of summary patient-level covariates in meta-regression with individual patient data meta-analysis.
        J Clin Epidemiol. 2002; 55: 86-94
        • Guyatt G.H.
        • Townsend M.
        • Keller J.L.
        • Singer J.
        Should study subjects see their previous responses: data from a randomized control trial.
        J Clin Epidemiol. 1989; 42: 913-920
        • Doganay Erdogan B.
        • Leung Y.Y.
        • Pohl C.
        • Tennant A.
        • Conaghan P.G.
        Minimal clinically important difference as applied in rheumatology: an OMERACT rasch working group systematic review and critique.
        J Rheumatol. 2016; 43: 194-202
        • Bombardier C.
        • Hayden J.
        • Beaton D.E.
        Minimal clinically important difference. Low back pain: outcome measures.
        J Rheumatol. 2001; 28: 431-438
        • Ferreira M.L.
        • Herbert R.D.
        • Ferreira P.H.
        • Latimer J.
        • Ostelo R.W.
        • Nascimento D.P.
        • et al.
        A critical review of methods used to determine the smallest worthwhile effect of interventions for low back pain.
        J Clin Epidemiol. 2012; 65: 253-261
        • Olsen M.F.
        • Bjerre E.
        • Hansen M.D.
        • Hilden J.
        • Landler N.E.
        • Tendal B.
        • et al.
        Pain relief that matters to patients: systematic review of empirical studies assessing the minimum clinically important difference in acute pain.
        BMC Med. 2017; 15: 35
        • Rouquette A.
        • Blanchin M.
        • Sébille V.
        • Guillemin F.
        • Côté S.M.
        • Falissard B.
        • et al.
        The minimal clinically important difference determined using item response theory models: an attempt to solve the issue of the association with baseline score.
        J Clin Epidemiol. 2014; 67: 433-440
        • Lauridsen H.H.
        • Hartvigsen J.
        • Korsholm L.
        • Grunnet-Nilsson N.
        • Manniche C.
        Choice of external criteria in back pain research: does it matter? Recommendations based on analysis of responsiveness.
        Pain. 2007; 131: 112-120
        • Jensen M.P.
        • Chen C.
        • Brugger A.M.
        Postsurgical pain outcome assessment.
        Pain. 2002; 99: 101-109
        • Ferreira M.L.
        • Herbert R.D.
        • Ferreira P.H.
        • Latimer J.
        • Ostelo R.W.
        • Grotle M.
        • et al.
        The smallest worthwhile effect of nonsteroidal anti-inflammatory drugs and physiotherapy for chronic low back pain: a benefit-harm trade-off study.
        J Clin Epidemiol. 2013; 66: 1397-1404
        • Carragee E.J.
        The rise and fall of the “minimum clinically important difference.”.
        Spine J. 2010; 10: 283-284
        • Ferreira M.L.
        • Ferreira P.H.
        • Herbert R.D.
        • Latimer J.
        People with low back pain typically need to feel “much better” to consider intervention worthwhile: an observational study.
        Aust J Physiother. 2009; 55: 123-127
        • Barrett B.
        Sufficiently important difference: concepts, caveats, and challenges.
        Med Decis Making. 2013; 33: 869-874
        • Mercadante S.
        • Adile C.
        • Torta R.
        • Varetto A.
        • Fulfaro F.
        • Giarratano A.
        • et al.
        Meaningful cut-off pain intensity for breakthrough pain changes in advanced cancer patients.
        Curr Med Res Opin. 2013; 29: 93-97
        • Moore R.A.
        • Straube S.
        • Aldington D.
        Pain measures and cut-offs - “no worse than mild pain” as a simple, universal outcome.
        Anaesthesia. 2013; 68: 400-412
        • Robinson K.A.
        • Saldanha I.J.
        • McKoy N.A.
        Development of a framework to identify research gaps from systematic reviews.
        J Clin Epidemiol. 2011; 64: 1325-1330
        • Beaton D.E.
        • Boers M.
        • Wells G.A.
        Many faces of the minimal clinically important difference (MCID): a literature review and directions for future research.
        Curr Opin Rheumatol. 2002; 14: 109-114
        • Ruyssen-Witrand A.
        • Tubach F.
        • Ravaud P.
        Systematic review reveals heterogeneity in definition of a clinically relevant difference in pain.
        J Clin Epidemiol. 2011; 64: 463-470
        • Terwee C.B.
        • Roorda L.D.
        • Dekker J.
        • Bierma-Zeinstra S.M.
        • Peat G.
        • Jordan K.P.
        • et al.
        Mind the MIC: large variation among populations and methods.
        J Clin Epidemiol. 2010; 63: 524-534
        • Dworkin R.H.
        • Turk D.C.
        • McDermott M.P.
        • Peirce-Sandner S.
        • Burke L.B.
        • Cowan P.
        • et al.
        Interpreting the clinical importance of group differences in chronic pain clinical trials: IMMPACT recommendations.
        Pain. 2009; 146: 238-244