Advertisement
Original article| Volume 138, P102-114, October 2021

Download started.

Ok

Pilot and feasibility studies for pragmatic trials have unique considerations and areas of uncertainty

  • Author Footnotes
    1 Joint first authors
    Claire L Chan
    Footnotes
    1 Joint first authors
    Affiliations
    Centre for Clinical Trials and Methodology, Institute of Population Health Sciences, Queen Mary University of London, London, E1 2AB, UK
    Search for articles by this author
  • Author Footnotes
    1 Joint first authors
    Monica Taljaard
    Correspondence
    Corresponding author. Tel:. 613-798-5555 x18618. fax:. 613-761-5402.
    Footnotes
    1 Joint first authors
    Affiliations
    Ottawa Hospital Research Institute, Clinical Epidemiology Program, Centre for Practice-Changing Research, The Ottawa Hospital, Ottawa, ON, K1H 8L6, Canada

    School of Epidemiology and Public Health, University of Ottawa, Ottawa, Ontario, Canada
    Search for articles by this author
  • Gillian A Lancaster
    Affiliations
    Keele Clinical Trials Unit, School of Medicine, Keele University, Keele, Staffordshire, ST5 5BG, UK
    Search for articles by this author
  • Jamie C Brehaut
    Affiliations
    Ottawa Hospital Research Institute, Clinical Epidemiology Program, Centre for Practice-Changing Research, The Ottawa Hospital, Ottawa, ON, K1H 8L6, Canada

    School of Epidemiology and Public Health, University of Ottawa, Ottawa, Ontario, Canada
    Search for articles by this author
  • Sandra M Eldridge
    Affiliations
    Centre for Clinical Trials and Methodology, Institute of Population Health Sciences, Queen Mary University of London, London, E1 2AB, UK
    Search for articles by this author
  • Author Footnotes
    1 Joint first authors

      Abstract

      Background and objective

      Feasibility studies are increasingly being used to support the development of, and investigate uncertainties around, future large-scale trials. The future trial can be designed with either a pragmatic or explanatory mindset. Whereas pragmatic trials aim to inform the choice between different care options and thus, are designed to resemble conditions outside of a clinical trial environment, explanatory trials examine the benefit of a treatment under more controlled conditions. There is existing guidance for designing feasibility studies, but none that explicitly considers the goals of pragmatic designs. We aimed to identify unique areas of uncertainty that are relevant to planning a pragmatic trial.

      Results

      We identified ten relevant domains, partly based on the pragmatic-explanatory continuum indicator summary-2 (PRECIS-2) framework, and describe potential questions of uncertainty within each: intervention development, research ethics, participant identification and eligibility, recruitment of individuals, setting, organization, flexibility of delivery, flexibility of adherence, follow-up, and importance of primary outcome to patients and decision-makers. We present examples to illustrate how uncertainty in these domains might be addressed within a feasibility study.

      Conclusion

      Researchers planning a feasibility study in advance of a pragmatic trial should consider feasibility objectives specifically relevant to areas of uncertainty for pragmatic trials.

      Keywords

      To read this article in full you will need to make a payment

      Purchase one-time access:

      Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online access
      One-time access price info
      • For academic or personal research use, select 'Academic and Personal'
      • For corporate R&D use, select 'Corporate R&D Professionals'

      Subscribe:

      Subscribe to Journal of Clinical Epidemiology
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

        • Eldridge S.M.
        • Lancaster G.A.
        • Campbell M.J.
        • Thabane L.
        • Hopewell S.
        • Coleman C.L.
        • et al.
        Defining feasibility and pilot studies in preparation for randomised controlled trials: development of a conceptual framework.
        PLoS One. 2016; 11e0150205
        • Eldridge S.M.
        • Chan C.L.
        • Campbell M.J.
        • Bond C.M.
        • Hopewell S.
        • Thabane L.
        • et al.
        CONSORT 2010 statement: extension to randomised pilot and feasibility trials.
        BMJ. 2016 Oct 24; 355 (PMID: 27777223): i5239
        • Patsopoulos N.A.
        A pragmatic view on pragmatic trials.
        Dialogues Clin Neurosci. 2011; 13: 217-224
        • Schwartz D.
        • Lellouch J.
        Explanatory and pragmatic attitudes in therapeutical trials.
        J Chronic Dis. 1967; 20: 637-648
        • Roland M.
        • Torgerson D.J.
        Understanding controlled trials: what are pragmatic trials?.
        BMJ. 1998; 316: 285
        • Treweek S.
        • Zwarenstein M.
        Making trials matter: pragmatic and explanatory trials and the problem of applicability.
        Trials. 2009; 10: 37
        • Thabane L.
        • Ma J.
        • Chu R.
        • Cheng J.
        • Ismaila A.
        • Rios L.P.
        • et al.
        A tutorial on pilot studies: the what, why and how.
        BMC Med Res Methodol. 2010; 10: 1
        • Arnold D.M.
        • Burns K.E.A.
        • Adhikari N.K.J.
        • Kho M.E.
        • Meade M.O.
        • Cook D.J.
        • et al.
        The design and interpretation of pilot trials in clinical research in critical care.
        Critic Care Med. 2009; 37: S69-S74
        • Arain M.
        • Campbell M.J.
        • Cooper C.L.
        • Lancaster G.A.
        What is a pilot or feasibility study? A review of current practice and editorial policy.
        BMC Med Res Methodol. 2010; 10: 67
        • Lancaster GA
        • Dodd S
        • Williamson PR.
        Design and analysis of pilot studies: recommendations for good practice.
        J Eval Clin Pract. 2004; 10 (PMID: 15189396): 307-312https://doi.org/10.1111/j..2002.384.doc.x
        • Loudon K.
        • Treweek S.
        • Sullivan F.
        • Donnan P.
        • Thorpe K.E.
        • Zwarenstein M.
        • et al.
        The PRECIS-2 tool: designing trials that are fit for purpose.
        BMJ. 2015; 350https://doi.org/10.1136/bmj.h2147
        • Nicholls S.G.
        • Carroll K.
        • Zwarenstein M.
        • Brehaut J.C.
        • Weijer C.
        • Hey S.P.
        • et al.
        The ethical challenges raised in the design and conduct of pragmatic trials: an interview study with key stakeholders.
        Trials. 2019; 20: 765https://doi.org/10.1186/s13063-019-3899-x
        • Hung A.
        • Baas C.
        • Bekelman J.
        • Fitz-Randolph M.C.
        • Mullins D.
        Patient and stakeholder engagement in designing pragmatic clinical trials.
        in: Birnbaum H. Greenberg P. Decision Making in a World of Comparative Effectiveness Research. Adis, Singapore2017
        • Keith R.E.
        • Crosson J.C.
        • O’Malley A.S
        • Cromp D.
        • Taylor E.F.
        Using the Consolidated Framework for Implementation Research (CFIR) to produce actionable findings: a rapid-cycle evaluation approach to improving implementation.
        Implementation Sci. 2017; 12: 15
        • Atkins L.
        • Francis J.
        • Islam R.
        • O’Connor D.
        • Patey A.
        • Ivers N.
        • et al.
        A guide to using the Theoretical Domains Framework of behaviour change to investigate implementation problems.
        Implementation Sci. 2017; 12: 77https://doi.org/10.1186/s13012-017-0605-9
        • Cooper H.
        • Lancaster G.A.
        • Gichuru P.
        • Peak M.
        A mixed methods study to evaluate the feasibility of using the Adolescent Diabetes Needs Assessment Tool App in paediatric diabetes care in preparation for a longitudinal cohort study.
        Pilot and Feasibility Studies. 2017; 4: 13
        • Fiallo-Scharer R.
        • Palta M.
        • Chewning B.A.
        • Wysocki T.
        • Wetterneck T.B.
        • Cox E.D.
        Design and baseline data from a PCORI-funded randomized controlled trial of family-centered tailoring of diabetes self-management resources.
        Contemp Clin Trials. 2017; 58: 58-65
        • McKinney Jr R.E.
        • Beskow L.M.
        • Ford D.E.
        • Lantos J.D.
        • McCall J.
        • Patrick-Lake B.
        • et al.
        Use of altered informed consent in pragmatic clinical research.
        Clinical Trials. 2015; 12: 494-502
        • Hemming K
        • Haines T.P.
        • Chilton P.J.
        • Girling A.J.
        • Lilford R.J.
        The stepped wedge cluster randomised trial: rationale, design, analysis, and reporting.
        BMJ. 2015; 350: h391https://doi.org/10.1136/bmj.h391
        • Hemming K
        • Taljaard M
        • Weijer C
        • Forbes AB.
        Use of multiple period, cluster randomised, crossover trial designs for comparative effectiveness research.
        BMJ. 2020; 371: m3800
        • McIntyre L.
        • Taljaard M.
        • McArdle T.
        • Fox-Robichaud A.
        • English S.W.
        • Martin C.
        • et al.
        FLUID trial: a protocol for a hospital-wide open-label cluster crossover pragmatic comparative effectiveness randomised pilot trial.
        BMJ Open. 2018; 8e022780
        • Coronado G.D.
        • Vollmer W.M.
        • Petrick A.
        • Aguirre J.
        • Kapka T.
        • Devoe J.
        • et al.
        Strategies and opportunities to STOP colon cancer in priority populations: pragmatic pilot study design and outcomes.
        BMC Cancer. 2014; 14: 55
        • Treweek S.
        • Banister K.
        • Bower P.
        • Cotton S.
        • Devane D.
        • Gardner H.R.
        • et al.
        Developing the include ethnicity framework—a tool to help trialists design trials that better reflect the communities they serve.
        Trials. 2021; 22: 337https://doi.org/10.1186/s13063-021-05276-8
        • Brehaut JC
        • Carroll K
        • Presseau J
        • Richards DP
        • Gordon J
        • Bénard A
        • Hudek N
        • Graham ID
        • Fergusson DA
        • Marlin S
        A patient-focused, theory-guided approach to survey design identified barriers to and drivers of clinical trial participation.
        J Clin Epidemiol. 2021; 132 (AprEpub 2020 Dec 15. PMID: 33338563): 106-115https://doi.org/10.1016/j.jclinepi.2020.12.013
        • Petrella R.J.
        • Gill D.P.
        • Zou G.
        • DE Cruz A.
        • Riggin B.
        • Bartol C.
        • et al.
        Hockey fans in training: a pilot pragmatic randomized controlled trial.
        Med Sci Sports Exer. 2017; 49: 2506-2516
        • Hamilton F.L.
        • Hornby J.
        • Sheringham J.
        • Linke S.
        • Ashton C.
        • Moore K.
        • et al.
        DIAMOND (DIgital Alcohol Management ON Demand): a mixed methods feasibility RCT and embedded process evaluation of a digital health intervention to reduce hazardous and harmful alcohol use.
        Pilot Feasibility Stud. 2017; 3: 34
        • Bowyer-Crane C.
        • Nielsen D.
        • Bryant M.
        • Dharni N.
        • Heald R.
        • Storr C.
        • et al.
        A randomised controlled feasibility trial and qualitative evaluation of an early years language development intervention: study protocol of the ‘outcomes of Talking Together evaluation and results’ (oTTer) project.
        Pilot Feasibility Stud. 2019; 5: 119
        • Hemming K.
        • Taljaard M.
        Reflection on modern methods: when is a stepped-wedge cluster randomized trial a good study design choice?.
        Int J Epidemiol. 2020; 49: 1043-1052
        • Dormandy E.
        • Kavalier F.
        • Logan J.
        • Harris H.
        • Ishmael N.
        • Marteau T.M.
        Maximising recruitment and retention of general practices in clinical trials: a case study.
        Br J Gen Pract. 2008; 58: 759-766
        • Killaspy H.
        • Priebe S.
        • McPherson P.
        • Zenasni Z.
        • McCrone P.
        • Dowling S.
        • et al.
        Feasibility Randomised trial comparing two forms of mental health supported accommodation (supported housing and floating outreach); a component of the QuEST (Quality and Effectiveness of Supported Tenancies) study.
        Front Psychiatry. 2019; 10: 258
        • Dodds C.M.
        • Britto M.T.
        Learnings from a pragmatic pilot trial of text messaging for high risk adolescents with asthma.
        Ann Allergy Asthma Immunol. 2018; 120: 546-547https://doi.org/10.1016/j.anai.2018.02.008
        • Coronado G.D.
        • Vollmer W.M.
        • Petrick A.
        • Aguirre J.
        • Kapka T.
        • Devoe J.
        • et al.
        Strategies and opportunities to STOP colon cancer in priority populations: pragmatic pilot study design and outcomes.
        BMC Cancer. 2014; 14: 55
        • Dember LM
        • Lacson E
        • Brunelli SM
        • Hsu JY
        • Cheung AK
        • Daugirdas JT
        • Greene T
        • Kovesdy CP
        • Miskulin DC
        • Thadhani RI
        • Winkelmayer WC
        • Ellenberg SS
        • Cifelli D
        • Madigan R
        • Young A
        • Angeletti M
        • Wingard RL
        • Kahn C
        • Nissenson AR
        • Maddux FW
        • Abbott KC
        • Landis JR.
        JASN. 2019; 30: 890-903https://doi.org/10.1681/ASN.2018090945
        • Mc Cord K.A.
        • Al-Shahi Salman R.
        • Treweek S.
        • Gardner H.
        • Strech D.
        • Whiteley W.
        • et al.
        Routinely collected data for randomized trials: promises, barriers, and implications.
        Trials. 2018; 19: 29
        • Williams N.H.
        • Mawdesley K.
        • Roberts J.L.
        • Ud Din N.
        • Totton N.
        • Charles J.M.
        • et al.
        Hip fracture in the elderly multidisciplinary rehabilitation (FEMuR) feasibility study: testing the use of routinely collected data for future health economic evaluations.
        Pilot Feasibility Stud. 2018; 4: 76
      1. Feder, G., Foster, G., Eldridge, S., Ramsay, J., Spencer, A., on behalf of the PreDove steering group. Prevention of domestic violence (PreDoVe). 2005 [cited 2019 22 Jan]; Available from: http://webspace.qmul.ac.uk/spriebe/publications/pub%20by%20year/2005/2005%20-%20Preventon%20of%20domestic%20violence%20(PreDoVe)%20-%20Report%20to%20the%20Nuffield%20Foundation.pdf.

        • Skinner M.W.
        • Chai-Adisaksopha C.
        • Curtis R.
        • Frick N.
        • Nichol M.
        • Noone D.
        • et al.
        The patient reported outcomes, burdens and experiences (PROBE) project: development and evaluation of a questionnaire assessing patient reported outcomes in people with haemophilia.
        Pilot Feasibility Stud. 2018; 4: 58
        • Taljaard M.
        • Weijer C.
        • Grimshaw J.M.
        • Ali A.
        • Brehaut J.C.
        • Campbell M.K.
        • et al.
        Developing a framework for the ethical design and conduct of pragmatic trials in healthcare: a mixed methods research protocol.
        Trials. 2018; 19: 525https://doi.org/10.1186/s13063-018-2895-x
        • Dal-Ré R
        • Avendaño-Solà C
        • Bloechl-Daum B
        • de Boer A
        • Eriksson S
        • Fuhr U
        • et al.
        Low risk pragmatic trials do not always require participants’ informed consent.
        BMJ. 2019; 364: l1092
        • Kim SY
        • Miller FG.
        Informed consent for pragmatic trials–the integrated consent model.
        N Engl J Med. 2014; 370 (PMID: 24552326): 769-772https://doi.org/10.1056/NEJMhle1312508
        • Lin LY
        • Jochym N
        • Merz JF.
        Refusal rates and waivers of informed consent in pragmatic and comparative effectiveness RCTs: A systematic review.
        Contemp Clin Trials. 2021; 104 (Epub ahead of print. PMID: 33737197)106361https://doi.org/10.1016/j.cct.2021.106361
      2. Zhang JZ, Nicholls SG, Carroll K, Nix HP, Goldstein CE, Hey SP, et al. Informed consent in pragmatic trials: Results from a survey of trials published 2014-2019. Under review.

        • Eldridge S
        • Kerry S
        • Torgerson DJ.
        Bias in identifying and recruiting participants in cluster randomised trials: what can be done?.
        BMJ. 2009; 339 (PMID: 19819928): b4006https://doi.org/10.1136/bmj.b4006
        • Baier R.R.
        • Jutkowitz E.
        • Mitchell S.L.
        • McCreedy E.
        • Mor V.
        Readiness assessment for pragmatic trials (RAPT): a model to assess the readiness of an intervention for testing in a pragmatic trial.
        BMC Med Res Methodol. 2019; 19: 156
        • Cooper H.
        • Lancaster G.A.
        • Gichuru P.
        • Peak M.
        A mixed methods study to evaluate the feasibility of using the adolescent diabetes needs assessment tool app in paediatric diabetes care in preparation for a longitudinal cohort study.
        Pilot and Feasibility Studies. 2017; 4: 13
        • Fiallo-Scharer R.
        • Palta M.
        • Chewning B.A.
        • Wysocki T.
        • Wetterneck T.B.
        • Cox E.D.
        Design and baseline data from a PCORI-funded randomized controlled trial of family-centered tailoring of diabetes self-management resources.
        Contemp Clin Trials. 2017; 58: 58-65
        • McIntyre L.
        • Taljaard M.
        • McArdle T.
        • Fox-Robichaud A.
        • English S.W.
        • Martin C.
        • et al.
        FLUID trial: a protocol for a hospital-wide open-label cluster crossover pragmatic comparative effectiveness randomised pilot trial.
        BMJ Open. 2018; 8e022780
        • Coronado G.D.
        • et al.
        Strategies and opportunities to STOP colon cancer in priority populations: pragmatic pilot study design and outcomes.
        BMC Cancer. 2014; 14: 55
        • Petrella R.J.
        • et al.
        Hockey fans in training: a pilot pragmatic randomized controlled trial.
        Medicine & Science in Sports & Exercise. 2017; 49: 2506-2516
        • Hamilton F.L.
        • et al.
        DIAMOND (DIgital Alcohol Management ON Demand): a mixed methods feasibility RCT and embedded process evaluation of a digital health intervention to reduce hazardous and harmful alcohol use.
        Pilot Feasibility Stud. 2017; 3: 34
        • Bowyer-Crane C.
        • et al.
        A randomised controlled feasibility trial and qualitative evaluation of an early years language development intervention: study protocol of the ‘outcomes of Talking Together evaluation and results’ (oTTer) project.
        Pilot Feasibility Stud. 2019; 5: 119
        • Dormandy E.
        • et al.
        Maximising recruitment and retention of general practices in clinical trials: a case study.
        Br J Gen Pract. 2008; 58: 759-766
        • Killaspy H.
        • et al.
        Feasibility Randomised trial comparing two forms of mental health supported accommodation (supported housing and floating outreach); a component of the QuEST (Quality and Effectiveness of Supported Tenancies) study.
        Front Psychiatry. 2019; : 10
        • Dodds C.M.
        • Britto M.T.
        Learnings from a pragmatic pilot trial of text messaging for high risk adolescents with asthma.
        Ann Allergy Asthma Immunol. 2018;
        • Dember LM
        • Lacson E
        • Brunelli SM
        • Hsu JY
        • Cheung AK
        • Daugirdas JT
        • et al.
        The TiME Trial: A Fully Embedded, Cluster-Randomized, Pragmatic Trial of Hemodialysis Session Duration.
        JASN. 2019; 30: 890-903https://doi.org/10.1681/ASN.2018090945
        • Williams N.H.
        • et al.
        Hip fracture in the elderly multidisciplinary rehabilitation (FEMuR) feasibility study: testing the use of routinely collected data for future health economic evaluations.
        Pilot Feasibility Stud. 2018; 4: 76
      3. Feder, G., et al. Prevention of domestic violence (PreDoVe). 2005 [cited 2019 22 Jan]; Available from: http://webspace.qmul.ac.uk/spriebe/publications/pub%20by%20year/2005/2005%20-%20Preventon%20of%20domestic%20violence%20(PreDoVe)%20-%20Report%20to%20the%20Nuffield%20Foundation.pdf.

        • Skinner M.
        • et al.
        The patient reported outcomes, burdens and experiences (PROBE) project: development and evaluation of a questionnaire assessing patient reported outcomes in people with haemophilia.
        Pilot Feasibility Stud. 2018; 4: 58