Abstract
Objective
To assess the effects of abbreviated literature searches on evidence syntheses conclusions.
Study design and setting
We randomly selected 60 Cochrane reviews of clinical interventions and repeated literature
searches using 14 abbreviated approaches (combinations of MEDLINE, Embase, CENTRAL
with and without searches of reference lists). If abbreviated searches missed included
studies, we recalculated meta-analyses. Cochrane authors determined whether the new
evidence base would change conclusions. We assessed the noninferiority of abbreviated
searches allowing for a maximum of 10% changed conclusions.
Results
We conducted 840 abbreviated literature searches. Noninferiority varied based on the
definition of “changed conclusion”. When the reduction of the certainty of a conclusion
was of concern, all abbreviated searches were inferior. Searching Embase only rendered
the greatest proportion of changed conclusions (27%, 95% confidence interval [CI]:
16%–40%); combining MEDLINE, Embase, CENTRAL with searches of references lists the
lowest (8%, 95% CI 3%–18%). When falsely reaching an opposite conclusion was of concern,
combining one database with another or with searches of reference lists was noninferior
to comprehensive searches (2%, 95% CI: 0%–9%).
Conclusion
If decision-makers are willing to accept less certainty and a small risk for opposite
conclusions, some abbreviated searches are viable options for rapid evidence syntheses.
Decisions demanding high certainty require comprehensive searches.
Keywords
To read this article in full you will need to make a payment
Purchase one-time access:
Academic & Personal: 24 hour online accessCorporate R&D Professionals: 24 hour online accessOne-time access price info
- For academic or personal research use, select 'Academic and Personal'
- For corporate R&D use, select 'Corporate R&D Professionals'
Subscribe:
Subscribe to Journal of Clinical EpidemiologyAlready a print subscriber? Claim online access
Already an online subscriber? Sign in
Register: Create an account
Institutional Access: Sign in to ScienceDirect
References
- Expediting systematic reviews: methods and implications of rapid reviews.Implement Sci. 2010; 5: 56
- EPC Methods: An Exploration of Methods and Context for the Production of Rapid Reviews.AHRQ Agency for Healthcare Research and Quality: Scientific Resource Center, Portland, Oregon2015
- A retrospective comparison of systematic reviews with same-topic rapid reviews.J Clin Epidemiol. 2018; 96: 23-34
- Rapid versus full systematic reviews: an inventory of current methods and practice in Health Technology Assessment. ASERNIP-S Report No. 60.ASERNIP-S, Adelaide, South Africa2007
- Rapid assessments provide acceptable quality advice.Annu Meet Int Soc Technol Assess Health Care Int Soc Technol Assess Health Care Meet. 2002; (Abstract 70): 18
- Medicinal use of potato-derived products: conclusions of a rapid versus full systematic review.Phytother Res. 2011; 25: 787-788
- Methods for developing evidence reviews in short periods of time: a scoping review.PLoS One. 2016; 11: e0165903
- Rapid review programs to support health care and policy decision making: a descriptive analysis of processes and methods.Syst Rev. 2015; 4: 26
- Rapid review summit: an overview and initiation of a research agenda.Syst Rev. 2015; 4: 111
- A scoping review of rapid review methods.BMC Med. 2015; 13: 224
- Comparisons of citations in web of science, scopus, and google scholar for articles published in general medical journals.JAMA. 2009; 302: 1092-1096
- How important are comprehensive literature searches and the assessment of trial quality in systematic reviews? Empiracal study.Health Technology Assess. 2003; 7: 1-76
- Meta-epidemiologic analysis indicates that MEDLINE searches are sufficient for diagnostic test accuracy systematic reviews.J Clin Epidemiol. 2014; 67: 1192-1199
- Where and how to search for information on the effectiveness of public health interventions–a case study for prevention of cardiovascular disease.Health Info Libr J. 2014; 31: 303-313
- Using data sources beyond PubMed has a modest impact on the results of systematic reviews of therapeutic interventions.J Clin Epidemiol. 2015; 68: 1076-1084
- Efficiency and contribution of strategies for finding randomized controlled trials: a case study from a systematic review on therapeutic interventions of chronic depression.J Public Health Res. 2014; 3: 177
- Searching one or two databases was insufficient for meta-analysis of observational studies.J Clin Epidemiol. 2005; 58: 867-873
- Assessing the validity of abbreviated literature searches for rapid reviews: protocol of a non-inferiority and meta-epidemiologic study.Syst Rev. 2016; 5: 197
- Optimal two-stage designs for phase II clinical trials.Control Clin Trials. 1989; 10: 1-10
- Sample size calculator.(Available at:)2017http://www.sample-size.net/confidence-interval-proportionDate accessed: August 30, 2017
- Trading certainty for speed - how much uncertainty are decisionmakers and guideline developers willing to accept when using rapid reviews: an international survey.BMC Med Res Methodol. 2017; 17: 121
- Standards for the conduct of new Cochrane intervention reviews, Methodological expectations of Cochrane intervention reviews.Cochrane, London2016
- Tricco A.C. Langlois E.V. Straus S.E. Performing rapid reviews, in rapid reviews to strenghten health policy and systems: a practical guide. World Health Organization, Schweiz2017: 21
- Clarivate Analytics, EndNote, Version X8 (computer software).2018 (Philadelphia, USA)
- Software to conduct web-based surveys.(Available at:)
- Lipid-lowering efficacy of rosuvastatin.Cochrane Database Syst Rev. 2014; https://doi.org/10.1002/14651858.CD010254.pub2
- Oral anticoagulation in patients with cancer who have no therapeutic or prophylactic indication for anticoagulation.Cochrane Database Syst Rev. 2014; https://doi.org/10.1002/14651858.CD006466.pub5
- Parenteral anticoagulation in ambulatory patients with cancer.Cochrane Database Syst Rev. 2014; https://doi.org/10.1002/14651858.CD006652.pub4
- Anticoagulation for the long-term treatment of venous thromboembolism in patients with cancer.Cochrane Database Syst Rev. 2014; https://doi.org/10.1002/14651858.CD006650.pub4
- Post-pyloric versus gastric tube feeding for preventing pneumonia and improving nutritional outcomes in critically ill adults.Cochrane Database Syst Rev. 2015; https://doi.org/10.1002/14651858.CD008875.pub2
- Exercise-based cardiac rehabilitation for coronary heart disease.Cochrane Database Syst Rev. 2016; https://doi.org/10.1002/14651858.CD001800.pub3
- Early versus late tracheostomy for critically ill patients.Cochrane Database Syst Rev. 2015; https://doi.org/10.1002/14651858.CD007271.pub3
- Parent-infant psychotherapy for improving parental and infant mental health.Cochrane Database Syst Rev. 2015; https://doi.org/10.1002/14651858.CD010534.pub2
- Evans Rivastigmine for Alzheimer's disease.Cochrane Database Syst Rev. 2015; https://doi.org/10.1002/14651858.CD001191.pub4
- Perioperative beta-blockers for preventing surgery-related mortality and morbidity.Cochrane Database Syst Rev. 2014; https://doi.org/10.1002/14651858.CD004476.pub2
- Hormone therapy for preventing cardiovascular disease in post-menopausal women.Cochrane Database Syst Rev. 2015; https://doi.org/10.1002/14651858.CD002229.pub4
- Music for stress and anxiety reduction in coronary heart disease patients.Cochrane Database Syst Rev. 2013; https://doi.org/10.1002/14651858.CD006577.pub3
- Percutaneous vertebroplasty for osteoporotic vertebral compression fracture.Cochrane Database Syst Rev. 2015; https://doi.org/10.1002/14651858.CD006349.pub2
- Sulfasalazine for ankylosing spondylitis.Cochrane Database Syst Rev. 2014; https://doi.org/10.1002/14651858.CD004800.pub3
- Amiodarone versus other pharmacological interventions for prevention of sudden cardiac death.Cochrane Database Syst Rev. 2015; https://doi.org/10.1002/14651858.CD008093.pub2
- Calcium supplementation for prevention of primary hypertension.Cochrane Database Syst Rev. 2015; https://doi.org/10.1002/14651858.CD010037.pub2
- Pulmonary rehabilitation for interstitial lung disease.Cochrane Database Syst Rev. 2014; https://doi.org/10.1002/14651858.CD006322.pub3
- Exercise for osteoarthritis of the knee.Cochrane Database Syst Rev. 2015; https://doi.org/10.1002/14651858.CD004376.pub3
- Exercise for osteoarthritis of the hip.Cochrane Database Syst Rev. 2014; https://doi.org/10.1002/14651858.CD007912.pub2
- Cooling for cerebral protection during brain surgery.Cochrane Database Syst Rev. 2015; https://doi.org/10.1002/14651858.CD006638.pub3
- Second-generation antidepressants for preventing seasonal affective disorder in adults.Cochrane Database Syst Rev. 2015; https://doi.org/10.1002/14651858.CD011268.pub2
- Music therapy for people with autism spectrum disorder.Cochrane Database Syst Rev. 2014; https://doi.org/10.1002/14651858.CD004381.pub3
- Colchicine for prevention of cardiovascular events.Cochrane Database Syst Rev. 2016; https://doi.org/10.1002/14651858.CD011047.pub2
- Effects of total fat intake on body weight.Cochrane Database Syst Rev. 2015; https://doi.org/10.1002/14651858.CD011834
- Reduction in saturated fat intake for cardiovascular disease.Cochrane Database Syst Rev. 2015; https://doi.org/10.1002/14651858.CD011737
- Structured telephone support or non-invasive telemonitoring for patients with heart failure.Cochrane Database Syst Rev. 2015; https://doi.org/10.1002/14651858.CD007228.pub3
- Psychological interventions for women with non-metastatic breast cancer.Cochrane Database Syst Rev. 2015; https://doi.org/10.1002/14651858.CD008729.pub2
- Preoperative inspiratory muscle training for postoperative pulmonary complications in adults undergoing cardiac and major abdominal surgery.Cochrane Database Syst Rev. 2015; https://doi.org/10.1002/14651858.CD010356.pub2
- Food supplementation for improving the physical and psychosocial health of socio-economically disadvantaged children aged three months to five years.Cochrane Database Syst Rev. 2015; https://doi.org/10.1002/14651858.CD009924.pub2
- Self-management education programmes for osteoarthritis.Cochrane Database Syst Rev. 2014; https://doi.org/10.1002/14651858.CD008963.pub2
- Non-steroidal anti-inflammatory drugs (NSAIDs) for axial spondyloarthritis (ankylosing spondylitis and non-radiographic axial spondyloarthritis).Cochrane Database Syst Rev. 2015; https://doi.org/10.1002/14651858.CD010952.pub2
- Angiotensin converting enzyme (ACE) inhibitors versus angiotensin receptor blockers for primary hypertension.Cochrane Database Syst Rev. 2014; https://doi.org/10.1002/14651858.CD009096.pub2
- Closure versus medical therapy for preventing recurrent stroke in patients with patent foramen ovale and a history of cryptogenic stroke or transient ischemic attack.Cochrane Database Syst Rev. 2015; https://doi.org/10.1002/14651858.CD009938.pub2
- Peroxisome proliferator-activated receptor gamma agonists for preventing recurrent stroke and other vascular events in patients with stroke or transient ischaemic attack.Cochrane Database Syst Rev. 2015; https://doi.org/10.1002/14651858.CD010693.pub3
- Screening for lung cancer.Cochrane Database Syst Rev. 2013; https://doi.org/10.1002/14651858.CD001991.pub3
- Prophylactic lidocaine for myocardial infarction.Cochrane Database Syst Rev. 2015; https://doi.org/10.1002/14651858.CD008553.pub2
- Homocysteine-lowering interventions for preventing cardiovascular events.Cochrane Database Syst Rev. 2015; https://doi.org/10.1002/14651858.CD006612.pub4
- Pre-hospital versus in-hospital thrombolysis for ST-elevation myocardial infarction.Cochrane Database Syst Rev. 2014; https://doi.org/10.1002/14651858.CD010191.pub2
- Statins for the treatment of dementia.Cochrane Database Syst Rev. 2014; https://doi.org/10.1002/14651858.CD007514.pub3
- Statins for the prevention of dementia.Cochrane Database Syst Rev. 2016; https://doi.org/10.1002/14651858.CD003160.pub3
- Implantable defibrillators versus medical therapy for cardiac channelopathies.Cochrane Database Syst Rev. 2015; https://doi.org/10.1002/14651858.CD011168.pub2
- Non-invasive ventilation during exercise training for people with chronic obstructive pulmonary disease.Cochrane Database Syst Rev. 2014; https://doi.org/10.1002/14651858.CD007714.pub2
- Dopamine agonists for the treatment of cocaine dependence.Cochrane Database Syst Rev. 2015; https://doi.org/10.1002/14651858.CD003352.pub4
- Blood pressure-lowering efficacy of monotherapy with thiazide diuretics for primary hypertension.Cochrane Database Syst Rev. 2014; https://doi.org/10.1002/14651858.CD003824.pub2
- Interventions for drug-using offenders with co-occurring mental illness.Cochrane Database Syst Rev. 2015; https://doi.org/10.1002/14651858.CD010901.pub2
- Chronic disease management programmes for adults with asthma.Cochrane Database Syst Rev. 2015; https://doi.org/10.1002/14651858.CD007988.pub2
- Chemotherapy for advanced non-small cell lung cancer in the elderly population.Cochrane Database Syst Rev. 2015; https://doi.org/10.1002/14651858.CD010463.pub2
- Folic acid and folinic acid for reducing side effects in patients receiving methotrexate for rheumatoid arthritis.Cochrane Database Syst Rev. 2013; https://doi.org/10.1002/14651858.CD000951.pub2
- Interventions for preventing delirium in hospitalised non-ICU patients.Cochrane Database Syst Rev. 2016; https://doi.org/10.1002/14651858.CD005563.pub3
- Long-term effects of weight-reducing drugs in people with hypertension.Cochrane Database Syst Rev. 2016; https://doi.org/10.1002/14651858.CD007654.pub4
- Interleukin-1 inhibitors for acute gout.Cochrane Database Syst Rev. 2014; https://doi.org/10.1002/14651858.CD009993.pub2
- Haemophilus influenzae oral vaccination for preventing acute exacerbations of chronic bronchitis and chronic obstructive pulmonary disease.Cochrane Database Syst Rev. 2014; https://doi.org/10.1002/14651858.CD010010.pub2
- Non-invasive positive pressure ventilation for prevention of complications after pulmonary resection in lung cancer patients.Cochrane Database Syst Rev. 2015; https://doi.org/10.1002/14651858.CD010355.pub2
- Statins for acute coronary syndrome.Cochrane Database Syst Rev. 2014; https://doi.org/10.1002/14651858.CD006870.pub3
- Parenteral fluid regimens for improving functional outcome in people with acute stroke.Cochrane Database Syst Rev. 2015; https://doi.org/10.1002/14651858.CD011138.pub2
- Fibrates for secondary prevention of cardiovascular disease and stroke.Cochrane Database Syst Rev. 2015; https://doi.org/10.1002/14651858.CD009580.pub2
- Blood pressure lowering efficacy of partial agonist beta blocker monotherapy for primary hypertension.Cochrane Database Syst Rev. 2014; https://doi.org/10.1002/14651858.CD007450.pub2
- Blood pressure lowering efficacy of dual alpha and beta blockers for primary hypertension.Cochrane Database Syst Rev. 2015; https://doi.org/10.1002/14651858.CD007449.pub2
- Blood pressure lowering efficacy of nonselective beta-blockers for primary hypertension.Cochrane Database Syst Rev. 2014; https://doi.org/10.1002/14651858.CD007452.pub2
- Cerebrolysin for acute ischaemic stroke.Cochrane Database Syst Rev. 2015; https://doi.org/10.1002/14651858.CD007026.pub3
- ROBIS: a new tool to assess risk of bias in systematic reviews was developed.J Clin Epidemiol. 2016; 69: 225-234
- Testing the effectiveness of simplified search strategies for updating systematic reviews.J Clin Epidemiol. 2017; 88: 148-153
Article info
Publication history
Published online: June 01, 2018
Accepted:
May 25,
2018
Footnotes
Conflict of interest: None of the authors report any conflicts of interest with respect to the topic of this manuscript.
Funding source: This work was supported by internal funds of Cochrane Austria.
Identification
Copyright
© 2018 Elsevier Inc. All rights reserved.
