Advertisement
Original Article| Volume 155, P1-12, March 2023

Reporting guidelines for surgical technique could be improved: a scoping review and a call for action

Open AccessPublished:November 26, 2022DOI:https://doi.org/10.1016/j.jclinepi.2022.11.012

      Highlights

      • Many surgical technique reporting guidelines have been published covering a broad spectrum of clinical specialties.
      • The development methodology of guidelines that assist with the reporting of surgical technique could be improved.
      • The level of detailed description that current guidelines require to make the surgical technique more reproducible is low.

      Abstract

      Objectives

      To identify reporting guidelines related to surgical technique and propose recommendations for areas that require improvement.

      Study Design and Setting

      A protocol-guided scoping review was conducted. A literature search of MEDLINE, the EQUATOR Network Library, Google Scholar, and Networked Digital Library of Theses and Dissertations was conducted to identify surgical technique reporting guidelines published up to December 31, 2021.

      Results

      We finally included 55 surgical technique reporting guidelines, vascular surgery (n = 18, 32.7%) was the most common among the clinical specialties covered. The included guidelines generally showed a low degree of international and multidisciplinary cooperation. Few guidelines provided a detailed development process (n = 14, 25.5%), conducted a systematic literature review (n = 13, 23.6%), used the Delphi method (n = 4, 7.3%), or described post-publication strategy (n = 6, 10.9%). The vast majority guidelines focused on the reporting of intraoperative period (n = 50, 90.9%). However, of the guidelines requiring detailed descriptions of surgical technique methodology (n = 43, 78.2%), most failed to provide guidance on what constitutes an adequate description.

      Conclusion

      Our study demonstrates significant deficiencies in the development methodology and practicality of reporting guidelines for surgical technique. A standardized reporting guideline that is developed rigorously and focuses on details of surgical technique may serve as a necessary impetus for change.

      Keywords

      What is new?

        Key findings

      • Many surgical technique reporting guidelines have been published, covering a broad spectrum of clinical specialties.
      • For most reporting guidelines the developers have failed to describe how the guidance was developed, and the level of detailed description they require to make the surgical technique more reproducible is low.

        What this adds to what is known?

      • Standardized and transparent reporting of surgical technique is the cornerstone of effective dissemination and implementation. However the reporting of surgical technique in the literature is currently inadequate. We found the development methodology and clinical practicality in the current guidelines that assist with the reporting of surgical technique has a large potential for improvement.

        What is the implication, what should change now?

      • Surgical technique reporting guideline developers need to optimize how their guidelines are developed and implemented, and provide more structured information on how details of surgical technique and factors contributing to outcome variations should be reported in the future.

      1. Introduction

      Surgical technique is delicately described as the essential component of the craft and art of surgery [
      • Hosseinpour A.R.
      The importance of surgical technique.
      ]. However many studies published over the years have not provided sufficient technical detail to permit the duplication of the investigators’ efforts [
      • Jacquier I.
      • Boutron I.
      • Moher D.
      • Roy C.
      • Ravaud P.
      The reporting of randomized clinical trials using a surgical intervention is in need of immediate improvement: a systematic review.
      ,
      • van Eck C.F.
      • Schreiber V.M.
      • Mejia H.A.
      • Samuelsson K.
      • van Dijk C.N.
      • Karlsson J.
      • et al.
      “Anatomic” anterior cruciate ligament reconstruction: a systematic review of surgical techniques and reporting of surgical data.
      ,
      • Kibler W.B.
      • Sciascia A.
      Current practice for the surgical treatment of SLAP lesions: a systematic review.
      ], which further subverts the hard work needed to set up and conduct a new study. This problem is further exacerbated by the sophisticated nature of contemporary surgical practice, which involves a series of steps, team cooperation, availability of facilities, and unexpected variations [
      • Jacquier I.
      • Boutron I.
      • Moher D.
      • Roy C.
      • Ravaud P.
      The reporting of randomized clinical trials using a surgical intervention is in need of immediate improvement: a systematic review.
      ,
      • Birkmeyer J.D.
      • Finks J.F.
      • O’Reilly A.
      • Oerline M.
      • Carlin A.M.
      • Nunn A.R.
      • et al.
      Surgical skill and complication rates after bariatric surgery.
      ]. A recently published systematic review of 16 case reports found that the reporting of surgical techniques for minimally invasive transthoracic liver resections is poor, due to a lack of full description of technique details, patient selection, and governance procedures [
      • Pathak S.
      • Main B.G.
      • Blencowe N.S.
      • Rees J.R.E.
      • Robertson H.F.
      • Abbadi R.A.G.
      • et al.
      A systematic review of minimally invasive trans-thoracic liver resection to examine intervention description, governance, and outcome reporting of an innovative technique.
      ]. The results of previous reviews show that the extremely low standard of reporting leaves readers with an incomplete picture of how surgical techniques are performed which hampers statistical comparisons between studies [
      • Soler F.
      • Mocini F.
      • Djemeto D.T.
      • Cattaneo S.
      • Saccomanno M.F.
      • Milano G.
      No differences between conservative and surgical management of acromioclavicular joint osteoarthritis: a scoping review.
      ,
      • Poppler L.H.
      • Parikh R.P.
      • Bichanich M.J.
      • Rebehn K.
      • Bettlach C.R.
      • Mackinnon S.E.
      • et al.
      Surgical interventions for the treatment of painful neuroma: a comparative meta-analysis.
      ].
      Reporting guidelines are a relatively new phenomenon but evidence of their positive influence on the quality of published research reports is already emerging [
      • Simera I.
      • Altman D.G.
      • Moher D.
      • Schulz K.F.
      • Hoey J.
      Guidelines for reporting health research: the EQUATOR network’s survey of guideline authors.
      ,
      • Moher D.
      • Schulz K.F.
      • Simera I.
      • Altman D.G.
      Guidance for developers of health research reporting guidelines.
      ]. As of March 2022, there were 497 reporting guidelines categorized by the Enhancing the QUAlity and Transparency Of health Research (EQUATOR) network [
      Enhancing the QUAlity and Transparency of health Research. Search for reporting guidelines.
      ]. However the potential of surgical technique reporting guidelines to improve the quality of research publications is not being fully realized. One systematic review showed that 120 out of 193 surgical journals (62%) did not issue any reporting guidelines in their instructions to authors [
      • Agha R.A.
      • Barai I.
      • Rajmohan S.
      • Lee S.
      • Anwar M.O.
      • Fowler A.J.
      • et al.
      Support for reporting guidelines in surgical journals needs improvement: a systematic review.
      ]. Among the 38% of journals that did recommend using reporting guidelines, the focus was limited to guidelines specific to article types, such as Consolidated Standards of Reporting Trials (CONSORT) for randomized controlled trials, with no specific instruction on methodology for reporting surgical technique. Other studies have produced similar findings [
      • Checketts J.X.
      • Sims M.T.
      • Detweiler B.
      • Middlemist K.
      • Jones J.
      • Vassar M.
      An evaluation of reporting guidelines and clinical trial registry requirements among orthopaedic surgery journals.
      ,
      • Checketts J.X.
      • Cook C.
      • Imani S.
      • Duckett L.
      • Vassar M.
      An evaluation of reporting guidelines and clinical trial registry requirements among plastic surgery journals.
      ], and the endorsement of reporting guidelines in surgical journals has not improved over time [
      • Zhou J.
      • Li J.
      • Zhang J.
      • Geng B.
      • Chen Y.
      • Zhou X.
      Requirements for study registration and adherence to reporting guidelines in surgery journals: a cross-sectional study.
      ]. Reasons for the failure to use a reporting guideline may include a lack of suitable reporting guidelines, difficulties in using existing guidelines, and poor awareness of the matter among authors, journal editors, and reviewers.
      As of March 2022 over 41,000 articles could be identified using the search term “surgical technique” [Title/Abstract] in PubMed []. However no clear definition of surgical technique is currently provided in the literature or medical dictionaries. In our recently published study [
      • Zhang K.P.
      • Ma Y.F.
      • Shi Q.L.
      • Shen J.
      • Wu J.
      • Zhang X.
      • et al.
      Evidence on reporting guidelines for surgical technique in clinical disciplines: a scoping review protocol.
      ], we defined surgical technique as “the specific way and skills of performing a particular medical operation”. This definition specifically focuses on intraoperative implementation rather than perioperative care. To date no study has reviewed the reporting guidelines for surgical technique. Such a review is important, because the results can provide an understanding of factors that influence their successful implementation from the perspective of guideline itself.
      Therefore, we undertook this scoping review to describe (i) the current situation and (ii) the development process, and to identify (iii) the specific requirements and concerns of items related to surgical technique, with a view to proposing recommendations for areas requiring improvement.

      2. Materials and methods

      This scoping review was conducted in accordance with the Joanna Briggs Institute Reviewers' Manual [
      • Peters M.D.J.
      • Godfrey C.
      • McInerney P.
      • Munn Z.
      • Tricco A.C.
      • Khalil H.
      Chapter 11: scoping reviews (2020 version).
      ] and our preexisting protocol [
      • Zhang K.P.
      • Ma Y.F.
      • Shi Q.L.
      • Shen J.
      • Wu J.
      • Zhang X.
      • et al.
      Evidence on reporting guidelines for surgical technique in clinical disciplines: a scoping review protocol.
      ]. We followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews (PRISMA-ScR) checklist to guide the reporting [
      • Tricco A.C.
      • Lillie E.
      • Zarin W.
      • O’Brien K.K.
      • Colquhoun H.
      • Levac D.
      • et al.
      PRISMA extension for scoping reviews (PRISMA-ScR): checklist and explanation.
      ] (Supplementary Table S1). This study is not registered as there is no specific platform for registration of a scoping review.

      2.1 Search strategy

      An extensive search strategy was designed to retrieve reporting guidelines relating to surgical technique published up to December 31, 2021 from four electronic sources: MEDLINE (via PubMed), the EQUATOR Network Library (https://www.equator-network.org/), Google Scholar (https://scholar.google.com/), and the Networked Digital Library of Theses and Dissertations (http://search.ndltd.org/index.php). The search strategy included the terms “reporting guideline” AND “surgical technique” and was refined several times before the implementation. Search results were independently assessed by two reviewers (Q.L.S. and Y.F.M.); disagreements were resolved through consensus or by referral to a third reviewer (Y.L.C).

      2.2 Inclusion and exclusion criteria

      All English-language reporting guidelines related to surgical technique in human patients were included. There were no restrictions on clinical specialty, publication type (including journal articles and grey literature), or location. In this review, we followed the same definition of surgical technique from our published protocol (the specific way and skills of performing a particular medical operation) [
      • Zhang K.P.
      • Ma Y.F.
      • Shi Q.L.
      • Shen J.
      • Wu J.
      • Zhang X.
      • et al.
      Evidence on reporting guidelines for surgical technique in clinical disciplines: a scoping review protocol.
      ], which covers operations that remove abnormalities, repair affected parts or implant substitutions by cutting open, whether invasive, minimally invasive, or noninvasive. Duplicates and previous versions of updated reporting guidelines were excluded.

      2.3 Study selection and data extraction

      The reporting guideline selection process and data extraction were conducted by two independent groups (group 1: Q.L.S. and X.Z.Z.; group 2: Y.F.M. and P.P.J.). After the elimination of duplicates, all titles, abstracts, and full texts were screened to identify eligible reporting guidelines using the predefined criteria. Disagreements were resolved by consensus. Prior to the formal study selection, a pilot of 100 random sample records was conducted until sufficient agreement was reached between the four reviewers.
      The original data extraction form proposed in the protocol was modified to allow capture the most relevant aspects of the included reporting guidelines (Supplementary Table S2). Before the formal data extraction, the form was piloted on a random sample of four of the included reporting guidelines to achieve 100% agreement for each item among the four reviewers. Disagreements were resolved through discussion and consensus.

      2.4 Data analysis

      We first conducted a descriptive analysis of basic characteristics of the reporting guidelines. We then screened 17 methodology-related items (Supplementary Table S2) from the recommended development steps by the EQUATOR [
      • Moher D.
      • Schulz K.F.
      • Simera I.
      • Altman D.G.
      Guidance for developers of health research reporting guidelines.
      ], and classified them into four sections: initial, premeeting, postmeeting, and postpublication. Each item was scored according to the authors’ report as the following: (i) adequate–the activity was completely done; (ii) inadequate–the activity was not done; (iii) not reported–no information relating to the activity; (iv) unclear–unable to determine whether the activity had been done or not. Thirdly we analyzed the recommended items by these reporting guidelines from nine aspects of surgical technique (Supplementary Table S2). These nine aspects were discussed and determined by our members from multiple disciplines [
      • Zhang K.P.
      • Ma Y.F.
      • Shi Q.L.
      • Shen J.
      • Wu J.
      • Zhang X.
      • et al.
      Evidence on reporting guidelines for surgical technique in clinical disciplines: a scoping review protocol.
      ], including surgeons, methodologists, and journal editors, which covered whether authors are required to provide a detailed description of the surgical technique and other information such as surgical team, instruments or supports, and images or videos. Finally we used a bubble plot to provide an overall description of the whole number, clinical specialties, methodological processes of existing reporting guidelines, and their required items relating to surgical technique. For the methodological process we scored the included guidelines as very low, low, moderate, and high (defined as reporting 1–5, 6–10, 11–15, and 16–17 of the 17 methodology-related items); and for the recommended items of surgical technique, we scored the guidelines as low, moderate, and high (defined as containing 1–3, 4–6, and 7–9 of the nine aspects). One reviewer (Q.L.S.) conduced the scores, which was cross checked by a reviewer (Y.F.M.). Microsoft Excel 2019 was used for all data management and analyses.

      3. Results

      3.1 Search results

      The literature search identified 4,717 records for screening, of which 652 were excluded as duplicates. The title and abstract screening was conducted for 4,065 articles; 3,887 articles were subsequently excluded because they were unrelated to surgical technique reporting guidelines. The full texts of the 178 remaining records were retrieved for further evaluation, and 55 reporting guidelines related to surgical technique were ultimately included for data extraction and analysis (Fig. 1; Supplementary Table S3).
      Figure thumbnail gr1
      Fig. 1Flow of articles through scoping review. A total of 4,717 records from MEDLINE and additional sources were included in the initial search, and 55 studies were finally included after full-text screen.

      3.2 Characteristics of surgical technique reporting guidelines

      The basic characteristics of the included reporting guidelines are presented in Table 1. More than half of the reporting guidelines were led by authors from the United States of America (n = 35, 63.6%) and published before 2010 (n = 29, 52.7%; Fig. 2). The median number of authors was 10 per guideline. In terms of focus, the 55 eligible guidelines were extremely diverse, ranging from well-known general guidelines for reporting the results of specific types of research studies, such as the Surgical CAse REport guidelines for surgical case reports [
      • Agha R.A.
      • Franchi T.
      • Sohrabi C.
      • Mathew G.
      • Kerwan A.
      SCARE Group
      The SCARE 2020 guideline: updating consensus surgical CAse REport (SCARE) guidelines.
      ], to the first attempts to harmonize reporting of a particular surgical technique, such as reporting standards for lower extremity arterial endovascular procedures [
      • Ahn S.S.
      • Rutherford R.B.
      • Becker G.J.
      • Comerota A.J.
      • Johnston K.W.
      • McClean G.K.
      • et al.
      Reporting standards for lower extremity arterial endovascular procedures. Society for Vascular Surgery/International Society for Cardiovascular Surgery.
      ]. Regarding the development background, 40 (72.7%) guideline groups started their work from scratch, while others (n = 15, 27.3%) adapted existing guidelines for a new or more specialized research field. We encountered a variety of terms used for reporting guidance across the literature, the most common was “reporting standard(s)” (n = 29, 52.7%), followed by “reporting guideline(s)” (n = 11, 20%). The median number of citations per reporting guideline was 37, with the range being 2–4,528 citations.
      Table 1Characteristics of surgical technique reporting guidelines included in scoping review
      CategoryNumber (percentage)
      Year of publication
       1993–201029 (52.7)
       2011–202126 (47.3)
      Country of origin
       United States of America35 (63.6)
       United Kingdom7 (12.7)
       Belgium2 (3.6)
       Germany2 (3.6)
       Italy2 (3.6)
       Switzerland2 (3.6)
       Others
      Others included Barbados (n = 1), Canada (n = 1), Greece (n = 1), Lebanon (n = 1), Sweden (n = 1).
      5 (9.1)
      Coverage of surgical technique aspects
      47 reporting guidelines covered all surgical technique aspects of preoperative, intraoperative, and postoperative.
       Preoperative48 (87.3)
       Intraoperative50 (90.9)
       Postoperative54 (98.2)
      Specialty
       All specialties of surgery4 (7.3)
       Vascular surgery18 (32.7)
       General surgery7 (12.7)
       Oncology7 (12.7)
       Neurosurgery5 (9.1)
       Urinary surgery4 (7.3)
       Cardiac surgery3 (5.5)
       Gynecology and obstetrics3 (5.5)
       Cardiology1 (1.8)
       Plastic surgery1 (1.8)
       Spine surgery1 (1.8)
       Thoracic surgery1 (1.8)
      Developers
       Societies/associations24 (43.6)
       Working group with a specific name21 (38.2)
       Working group with no specific name1 (1.8)
       Individuals9 (16.4)
      Development background
       New reporting guidelines40 (72.7)
       Update of existing guidelines10 (18.2)
       Building on existing guidelines5 (9.1)
      Focus of reporting guidelines
       Study design not specified45 (81.8)
       Clinical trials4 (7.3)
       Case series3 (5.5)
       Multiple study designs1 (1.8)
       Observational study1 (1.8)
       Case reports1 (1.8)
      Republished since the first publication
       Yes10 (18.2)
      Indexed by the EQUATOR network
       Yes37 (67.3)
      Total citation count
      Total count includes citations of previous published version and updated version (if applicable).
      N ≥ 10018 (32.7)
      N ≥ 1,0004 (7.3)
      Abbreviations: EQUATOR, Enhancing the QUAlity and Transparency Of health Research.
      a Others included Barbados (n = 1), Canada (n = 1), Greece (n = 1), Lebanon (n = 1), Sweden (n = 1).
      b 47 reporting guidelines covered all surgical technique aspects of preoperative, intraoperative, and postoperative.
      c Total count includes citations of previous published version and updated version (if applicable).
      Figure thumbnail gr2
      Fig. 2Cumulative number of surgical technique reporting guidelines from 1993 to 2021. The total number of surgical technique reporting guidelines is increasing. ∗No surgical technique reporting guidelines were published in 1994–1996, 1998, 2000, 2002, 2008, or 2017 to 2018.
      Four guidelines were targeted for all specialties of surgery. The remaining guidelines designed for specific clinical specialties covered 11 specialties, with vascular surgery being the most common focus (n = 18, 32.7%). Forty-five (81.8%) guidelines were focused on the reporting of a specific surgical technique.

      3.3 Reporting guideline development process

      A detailed description of the development process was provided for 14 (25.5%) guidelines. Only one guideline reported following the guidance recommended by the EQUATOR. Figure 3 shows that developers generally provided little information about the development process. Of the 17 steps that were screened, 14 were reported in less than 25% of included guidelines.
      Figure thumbnail gr3
      Fig. 3Steps in the development of the surgical technique reporting guidelines (A–D). Of the 17 steps that were screened, 14 were reported in less than 25% of included guidelines. ∗(i) Adequate: the activity was completely done according to the report; (ii) Inadequate: the activity was not done according to the report; (iii) Not reported: no information relating to the activity was provided by the reporting guideline; (iv) Unclear: unable to determine if the activity had been done or not.

      3.3.1 In the initial steps

      For 13 (23.6%) guidelines, the development process included a review of the literature. These included searching for existing relevant guidance (n = 3, 5.5%) and evidence on the reporting quality of published articles (n = 11, 20%). Funding was obtained for the development of one (1.8%) guideline. Conflicts of interest were reported for 24 (43.6%) guidelines, while 23 (41.8%) guidelines had none declared.

      3.3.2 In the premeeting activities

      A clear description of the development team was provided for 6 (10.9%) guidelines. Other information provided included specialty (n = 44, 80%), country (n = 46, 83.6%), and people unsigned as authors (n = 23, 41.8%). In terms of international cooperation, 21 (38.2%) guidelines involved participants from only one country. In terms of multidisciplinary participation, content experts were involved in 83.6% (n = 46) of guidelines, while methodologists and editors were involved in 3 (5.5%) and 4 (7.3%) guidelines, respectively.

      3.3.3 In the postmeeting activities

      Thirty-one (56.4%) guidelines summarized their reporting recommendations in the form of checklist. The developers of only one guideline reported that they had conducted a pilot test. None of the guidelines had developed a separate explanatory document or described their publication strategy.

      3.3.4 In the postpublication activities

      The developers of 6 (10.9%) guidelines simply described their postpublication plans. For 2 (3.6%) guidelines, the developers planned to establish feedback dialogues through social media and seek user advice. Guideline endorsement approaches included facilitating their use through instruction to authors, seeking support from authoritative bodies, and efforts by editors and reviewers, or authors citing and following the guideline in their methods. One (1.8%) guideline reported that a prepost survey of relevant studies would be conducted in the future.

      3.4 Surgical technique related items recommended to report by the included guidelines

      We analyzed the 55 guidelines to identify reporting items related to surgical technique, and the results are presented in Figure 4 and Supplementary Table S4.
      Figure thumbnail gr4
      Fig. 4Items related to surgical technique in the reporting guidelines. We analyzed reporting items related to surgical technique from nine aspects, including whether authors are required to provide a detailed description of the surgical technique and other information such as surgical team information, instruments or supports, and images or videos. The results showed that the level of detailed description that the included reporting guidelines require to make the surgical technique more reproducible is low.

      3.4.1 Before the performance of the surgical technique

      Descriptions of preoperative evaluation and management were required by 35 (63.6%) and 27 (49.1%) guidelines, respectively. Preoperative management included patient optimization, concurrent treatments, and supportive care taken prior to the surgical procedure. Descriptions of anesthesia, patient position, and the operative location or approach were required by 22 (40%), 8 (14.5%), and 17 (30.9%) guidelines, respectively.

      3.4.2 During the performance of the surgical technique

      Of 43 (78.2%) guidelines that required detailed descriptions of the surgical technique methods, 17 (30.9%) requested only precise technical details with no further instructions, 5 (9.1%) required detailed descriptions for accurate reproduction by other researchers, and 1 (1.8%) required a description of all procedural steps, rationale for the choice of procedure, and the procedural endpoints. Of the guidelines that required the provision of adequate details, most did not have a clear structure. Examples can be found in Box 1.
      Examples of requirements for detailed descriptions of surgical technique in the included reporting guidelines.

        Adequate but without a clear structure

      • In the case of isolated stent graft implantation, basic details—such as the access site and entry method (cut down vs. percutaneous, surgical conduits for stent graft delivery and predilatation of access vessels), procedural time, fluoroscopy time, contrast volume, results of intraoperative angiography including endoleaks, stent graft apposition, length of the functional proximal and distal landing zone, degree of oversizing, conversion to open surgery, and any other intraoperative complications—should be given [
        • Rylski B.
        • Pacini D.
        • Beyersdorf F.
        • Quintana E.
        • Schachner T.
        • Tsagakis K.
        • et al.
        Standards of reporting in open and endovascular aortic surgery (STORAGE guidelines).
        ].

        Inadequate or unclear

      • Clear and detailed description of the new/planned technique/device, including necessary preprocedure and postprocedure care [
        • Bilbro N.A.
        • Hirst A.
        • Paez A.
        • Vasey B.
        • Pufulete M.
        • Sedrakyan A.
        • et al.
        The IDEAL reporting guidelines: a Delphi consensus statement stage specific recommendations for reporting the evaluation of surgical innovation.
        ].
      • Clear presentation of the surgical intervention and dosing regimen with a flow diagram outlining the pertinent study procedures [
        • Chang S.
        • Vogelbaum M.
        • Lang F.F.
        • Haines S.
        • Kunwar S.
        • Chiocca E.A.
        • et al.
        GNOSIS: guidelines for neuro-oncology: standards for investigational studies--reporting of surgically based therapeutic clinical trials.
        ].
      • Regardless of the treatment modality being reported, sufficiently clear technical details should be given to allow other investigators to replicate the study. Each treatment modality should be clearly described in the sequence utilized. The number of times the process is repeated and alterations in the sequence should be presented [
        • Gray R.J.
        • Sacks D.
        • Martin L.G.
        • Trerotola S.O.
        Reporting standards for percutaneous interventions in dialysis access. Technology Assessment Committee.
        ].
      Thirty-eight (69.1%) guidelines required the reporting of intraoperative patient management. This included pharmacologic therapy (e.g., duration, concentration, dosage, routes of administration, and medications that cannot be given concurrently), need for transfusion, adjunctive procedures, methods, and the frequency of patient safety monitoring, and imaging guidance. The duration of the surgical technique was required to be reported by 31 (56.4%) guidelines.

      3.4.3 After the surgical technique is performed

      Postoperative management or follow-up was required to be outlined by 47 (85.5%) guidelines. Details included when, where, and how the patients were followed up, the results of patient follow-up, and whether there were any specific postoperative instructions or auxiliary care.
      Forty-seven (85.5%) guidelines required a description of outcomes at the technical, clinician-assessed, or patient-reported levels; among these guidelines, 2 (3.6%) recommended that the patient's perspective on the intervention(s) they received should be reported, when appropriate. Twenty (36.4%) guidelines included the requirement to report changes during the technique process with rationale. Six (10.9%) required the reporting of risk factors for adverse surgical outcomes.
      Documentation of complications was required by 50 (90.9%) guidelines. Four guidelines (7.3%) used the term “perioperative”, 11 (20%) explicitly required the reporting of “intraoperative” and “postoperative” complications, and 6 (10.9%) only required the reporting of postoperative complications. Twenty-six (47.3%) guidelines required that authors distinguish between procedural complications and those not related to the procedure.

      3.4.4 Additional items related to surgical technique

      We classified additional items related to surgical technique into the following categories: reasoning (n = 5, 9.1%), and purpose (n = 2, 3.6%) for choosing the technique; target population (n = 38, 69.1%); technical type (n = 1, 1.8%); feasibility (n = 1, 1.8%); surgical stage (n = 3, 5.5%); tissue specimen handling (n = 1, 1.8%); and cost (n = 16, 29.1%).

      3.4.5 Items to make the surgical technique more reproducible

      Details of the person/team performing the surgical technique included the number of operators and their position, specialization, experience, and training received. A description of or reference to a statistical learning curve assessment was also recommended (n = 4, 7.3%). Regarding the instruments or supports, most are items related to describing the device, including their name, model, manufacturer, mechanism of action, reason for being chosen, methods of use, and whether they are available for routine use. Others are related to the use of a tourniquet, sutures, catheters, or relevant equipment, materials, and systems along with their type, size, diameter, length, volume, pressure, duration of application, and so on.
      Regarding quality assurance 6 (10.9%) guidelines required the reporting of specific measures taken to reduce variation, ensure quality, and maintain consistency in the delivery of the surgical technique at the individual or institutional level. Two (3.6%) guidelines required authors to report any precautionary measures taken to prevent misoperations. Among the guidelines that required the reporting of strengths and weaknesses, 4 (7.3%) focused on innovation. Two (3.6%) guidelines required the reporting of improvement plans or insight for the future of the surgical technique used.

      3.5 Mapping of existing surgical technique reporting guidelines

      Figure 5 displays the 55 reporting guidelines as bubbles. The results show that the vast majority guidelines scored very low for methodology (n = 48, 87.3%; based on reporting) and low for technique items (n = 29, 52.7%). The Idea, Development, Exploration, Assessment, Long-term study (IDEAL) recommendations scored high for methodology and for required items related to surgical technique [
      • Bilbro N.A.
      • Hirst A.
      • Paez A.
      • Vasey B.
      • Pufulete M.
      • Sedrakyan A.
      • et al.
      The IDEAL reporting guidelines: a Delphi consensus statement stage specific recommendations for reporting the evaluation of surgical innovation.
      ].
      Figure thumbnail gr5
      Fig. 5Mapping of existing reporting guidelines for surgical technique. This map contains 55 reporting guidelines. Each cell shows the number of reporting guidelines in the corresponding specialty. The results showed that the vast majority guidelines scored very low for methodology and low for technique-related items. ∗For the reference please refer to the ; For methodological process, guidelines were scored as very low (1–5 of the 17 items), low (6–10 of the 17 items), moderate (11–15 of the 17 items), and high (16–17 of the 17 items). For required items related to surgical technique, guidelines were scored as low (including 1–3 aspects), moderate (including 4–6 aspects), and high (including 7–9 aspects).

      4. Discussion

      4.1 Principal findings

      Through this scoping review, we found that there is no shortage of reporting guidelines related to surgical technique and that the existing guidelines have broad disciplinary coverage. However several challenges remain regarding the development methodology and item details of guidelines.

      4.2 Study implications for research and practice

      First the developers of the included reporting guidelines rarely followed the methodology recommended by Moher et al. [
      • Moher D.
      • Schulz K.F.
      • Simera I.
      • Altman D.G.
      Guidance for developers of health research reporting guidelines.
      ], and failed to provide sufficient details on many processes. For example, a systematic literature search is essential to determine whether there is a need to develop a new reporting guideline [
      • Simera I.
      • Altman D.G.
      • Moher D.
      • Schulz K.F.
      • Hoey J.
      Guidelines for reporting health research: the EQUATOR network’s survey of guideline authors.
      ,
      • Moher D.
      • Schulz K.F.
      • Simera I.
      • Altman D.G.
      Guidance for developers of health research reporting guidelines.
      ]. We found that parallel development of several surgical technique reporting guidelines on the same clinical topic is common, even within the same country. Examples can be found in thoracic endovascular aortic repair and bariatric surgery [
      • Turina M.I.
      • Shennib H.
      • Dunning J.
      • Cheng D.
      • Martin J.
      • Muneretto C.
      • et al.
      EACTS/ESCVS best practice guidelines for reporting treatment results in the thoracic aorta.
      ,
      • Fillinger M.F.
      • Greenberg R.K.
      • McKinsey J.F.
      • Chaikof E.L.
      Society for Vascular Surgery Ad Hoc Committee on TEVAR Reporting Standards
      Reporting standards for thoracic endovascular aortic repair (TEVAR).
      ,
      • Karmy-Jones R.
      • Ferrigno L.
      • Teso D.
      • Long WB, 3rd
      • Shackford S.
      Endovascular repair compared with operative repair of traumatic rupture of the thoracic aorta: a nonsystematic review and a plea for trauma-specific reporting guidelines.
      ,
      Guidelines for reporting results in bariatric surgery. Standards committee, American society for bariatric surgery.
      ,
      • Brethauer S.A.
      • Kim J.
      • el Chaar M.
      • Papasavas P.
      • Eisenberg D.
      • Rogers A.
      • et al.
      Standardized outcomes reporting in metabolic and bariatric surgery.
      ]. We also found that authors from the USA dominated the development of more than 60% of the reporting guidelines. This is unsurprising, but different audiences (e.g., health care providers, nurses, patients from high-, middle-, and low-income countries) view, define, and perceive what should be reported differently [
      • Simera I.
      • Altman D.G.
      • Moher D.
      • Schulz K.F.
      • Hoey J.
      Guidelines for reporting health research: the EQUATOR network’s survey of guideline authors.
      ,
      • Moher D.
      • Schulz K.F.
      • Simera I.
      • Altman D.G.
      Guidance for developers of health research reporting guidelines.
      ]. More than one-third of guidelines in this review were developed by researchers from a single country, and the engagement of methodologists and editors was very poor. It is clear that some perspectives may have been missed. Moreover, our results show that developers do not always use the Delphi method to reach a consensus and are often silent about their dissemination and implementation plans, which are similar to previous studies [
      • Banno M.
      • Tsujimoto Y.
      • Kataoka Y.
      The majority of reporting guidelines are not developed with the Delphi method: a systematic review of reporting guidelines.
      ,
      • Moher D.
      • Weeks L.
      • Ocampo M.
      • Seely D.
      • Sampson M.
      • Altman D.G.
      • et al.
      Describing reporting guidelines for health research: a systematic review.
      ,
      • Wang X.
      • Chen Y.
      • Yang N.
      • Deng W.
      • Wang Q.
      • Li N.
      • et al.
      Methodology and reporting quality of reporting guidelines: systematic review.
      ]. In this case, poor reporting may not only reflect poor methodology in conduct but a lack of transparency in development processes, which is also an important barrier in the reporting of guideline implementation [
      • Swillens J.E.M.
      • Voorham Q.J.M.
      • Nagtegaal I.D.
      • Hermens R.P.M.G.
      Improving interdisciplinary communication: barriers and facilitators for implementation of standardized structured reporting in oncology.
      ]. Although there is an undeniable trend that guidelines published after 2014—such as the Strengthening the reporting of observational studies in epidemiology (STROCSS) guideline [
      • Mathew G.
      • Agha R.
      STROCSS Group
      STROCSS 2021: strengthening the reporting of cohort, cross-sectional and case-control studies in surgery.
      ], the Preferred Reporting Of CasE Series in Surgery statement [
      • Agha R.A.
      • Sohrabi C.
      • Mathew G.
      • Franchi T.
      • Kerwan A.
      • O’Neill N.
      PROCESS Group
      The PROCESS 2020 guideline: updating consensus preferred reporting of CasESeries in surgery (PROCESS) guidelines.
      ], and the IDEAL recommendations [
      • Bilbro N.A.
      • Hirst A.
      • Paez A.
      • Vasey B.
      • Pufulete M.
      • Sedrakyan A.
      • et al.
      The IDEAL reporting guidelines: a Delphi consensus statement stage specific recommendations for reporting the evaluation of surgical innovation.
      ]—have endorsed a more explicit methodology, finding a relevant guideline for a study can be like trying to find a needle in a haystack.
      Second, the level of detailed description that the included reporting guidelines require to make the surgical technique more reproducible is low. Although generic guidelines for reporting CONSORT- nonpharmacologic treatments [
      • Boutron I.
      • Altman D.G.
      • Moher D.
      • Schulz K.F.
      • Ravaud P.
      CONSORT NPT Group
      CONSORT statement for randomized trials of nonpharmacologic treatments: a 2017 update and a CONSORT extension for nonpharmacologic trial abstracts.
      ] and intervention (template for intervention description and replication) [
      • Hoffmann T.C.
      • Glasziou P.P.
      • Boutron I.
      • Milne R.
      • Perera R.
      • Moher D.
      • et al.
      Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide.
      ] are currently available, they do not consider the specificity and all components of surgical technique. The same concern remains for guidelines we identified to assist with surgical technique reports. For example, “describe the rationale behind the treatment offered, how it was performed and time to intervention” in Surgical CAse REport [
      • Agha R.A.
      • Franchi T.
      • Sohrabi C.
      • Mathew G.
      • Kerwan A.
      SCARE Group
      The SCARE 2020 guideline: updating consensus surgical CAse REport (SCARE) guidelines.
      ], which has been cited over 4,000 times, and has probably been the most influential surgical technique reporting guideline published thus far. Such advice however is not sufficient due to a lack of awareness as to what comprises a good description, in particular, regarding the aspects that might introduce bias into the research and complex techniques. Furthermore surgical technique is not a fixed reality. Alongside the importance of acquiring surgical technical skills, factors like communication in the surgical team and quality assurance are essential for complete management of adverse or unexpected events that can occur during surgery [
      • Harris A.
      • Butterworth J.
      • Boshier P.R.
      • MacKenzie H.
      • Tokunaga M.
      • Sunagawa H.
      • et al.
      Development of a reliable surgical quality assurance system for 2-stage esophagectomy in randomized controlled trials.
      ]. However very little attention has been paid to the reporting of factors that can contribute to such variations. On the other hand innovation is an essential ingredient for the advancement of science and betterment of the human condition. Bismuth analyzed one issue of Annals of Surgery, and found that among the 40 published articles, there were no studies on new surgical techniques or on new treatments of surgical disease [
      • Bismuth H.
      Discovery and innovation in surgery: chance and necessity.
      ]. It is not coincidental that among all the reporting guidelines included in this review, future improvements of surgical technique had drawn the lowest attention. Innovation in surgical technique has been largely ignored.
      Many surgeons would argue that variation in surgical skill and outcomes may never be eliminated, and that treatment depends on the individual involved. However a reporting guideline is document designed for reporting research, not clinical procedural notes on individual patients. Since Altman's 1994 article [
      • Altman D.G.
      The scandal of poor medical research.
      ], there have been great initiatives to improve research quality, but progress has been modest. One recurring question is who should be responsible for research reporting. The answer is that we should all work together, but its implementation in practice encounters many challenges. For example as a researcher, finding and following an appropriate reporting guideline is one of the steps in submitting a draft. However we cannot deny that having another guideline to abide by and a checklist to fill can seem like one too many hurdles to overcome [
      • Barbour G.
      I’ve Got a (lot of) Little (check)lists.
      ]. Previous research illuminated that guidelines took 20 months to complete and 11 months to publish, with a lack of sufficient funding and time constraints identified as the most pressing issues [
      • Simera I.
      • Altman D.G.
      • Moher D.
      • Schulz K.F.
      • Hoey J.
      Guidelines for reporting health research: the EQUATOR network’s survey of guideline authors.
      ]. In relation to this the director of the United Kingdom EQUATOR Centre, Gary Collins, said, “international collaboration has the potential to avoid resource waste and give different people's perspectives on the writing of reporting guidelines items, which will be more easily adopted by authors and implemented by journals”.

      4.3 Strengths and limitations

      This scoping review has several strengths. First our study has systematically described the situation regarding surgical technique reporting guidelines and identified areas for improvement. Second our study strictly adhered to the Joanna Briggs Institute methodological guidance [
      • Peters M.D.J.
      • Godfrey C.
      • McInerney P.
      • Munn Z.
      • Tricco A.C.
      • Khalil H.
      Chapter 11: scoping reviews (2020 version).
      ] and PRISMA-ScR checklist [
      • Tricco A.C.
      • Lillie E.
      • Zarin W.
      • O’Brien K.K.
      • Colquhoun H.
      • Levac D.
      • et al.
      PRISMA extension for scoping reviews (PRISMA-ScR): checklist and explanation.
      ], which ensures the methodological rigour. Third our study was discussed by members from multiple disciplines, including surgeons, methodologists, and journal editors, to maximize the details and representativeness of the extracted data.
      However our study also has some limitations. For example we only included English reporting guidelines which might have resulted in publication bias and limited applicability of our findings to reporting guidelines in other languages. Also, data from the reporting guidelines were extracted verbatim, and it was assumed that if information was not documented, it did not happen, which may have led to underestimation of the true situation. Finally due to a lack of existing tools, we did not assess the quality of the included reporting guidelines.

      5. Conclusion

      We all benefit from high-quality research reports. However reporting guidelines that have not been developed appropriately may be of little use to authors and editors. Since CONSORT's publication in 1996 [
      • Begg C.
      • Cho M.
      • Eastwood S.
      • Horton R.
      • Moher D.
      • Olkin I.
      • et al.
      Improving the quality of reporting of randomized controlled trials. The CONSORT statement.
      ] the publication of reporting guidelines has grown from a trickle to a flood. However they are never simple documents to produce [
      • Moher D.
      • Altman D.G.
      • Schulz K.F.
      • Simera I.
      • Wager E.
      ,
      EQUATOR
      What is a reporting guideline?.
      ]. For surgical technique a standardized reporting guideline that is developed rigorously and focuses on its intraoperative implementation should be an urgent research priority for the future.

      Acknowledgments

      We would like to acknowledge the work of Yulong He, The First School of Clinical Medicine, Lanzhou University, who provided comments for our manuscript. We also appreciate the language polish by Jennifer Reynolds.

      Appendix A. Supplementary Data

      References

        • Hosseinpour A.R.
        The importance of surgical technique.
        J Surg Tech. 2017; 1: 1001
        • Jacquier I.
        • Boutron I.
        • Moher D.
        • Roy C.
        • Ravaud P.
        The reporting of randomized clinical trials using a surgical intervention is in need of immediate improvement: a systematic review.
        Ann Surg. 2006; 244: 677-683
        • van Eck C.F.
        • Schreiber V.M.
        • Mejia H.A.
        • Samuelsson K.
        • van Dijk C.N.
        • Karlsson J.
        • et al.
        “Anatomic” anterior cruciate ligament reconstruction: a systematic review of surgical techniques and reporting of surgical data.
        Arthroscopy. 2010; 26: S2-S12
        • Kibler W.B.
        • Sciascia A.
        Current practice for the surgical treatment of SLAP lesions: a systematic review.
        Arthroscopy. 2016; 32: 669-683
        • Birkmeyer J.D.
        • Finks J.F.
        • O’Reilly A.
        • Oerline M.
        • Carlin A.M.
        • Nunn A.R.
        • et al.
        Surgical skill and complication rates after bariatric surgery.
        N Engl J Med. 2013; 369: 1434-1442
        • Pathak S.
        • Main B.G.
        • Blencowe N.S.
        • Rees J.R.E.
        • Robertson H.F.
        • Abbadi R.A.G.
        • et al.
        A systematic review of minimally invasive trans-thoracic liver resection to examine intervention description, governance, and outcome reporting of an innovative technique.
        Ann Surg. 2021; 273: 882-889
        • Soler F.
        • Mocini F.
        • Djemeto D.T.
        • Cattaneo S.
        • Saccomanno M.F.
        • Milano G.
        No differences between conservative and surgical management of acromioclavicular joint osteoarthritis: a scoping review.
        Knee Surg Sports Traumatol Arthrosc. 2021; 29: 2194-2201
        • Poppler L.H.
        • Parikh R.P.
        • Bichanich M.J.
        • Rebehn K.
        • Bettlach C.R.
        • Mackinnon S.E.
        • et al.
        Surgical interventions for the treatment of painful neuroma: a comparative meta-analysis.
        Pain. 2018; 159: 214-223
        • Simera I.
        • Altman D.G.
        • Moher D.
        • Schulz K.F.
        • Hoey J.
        Guidelines for reporting health research: the EQUATOR network’s survey of guideline authors.
        PLoS Med. 2008; 5: e139
        • Moher D.
        • Schulz K.F.
        • Simera I.
        • Altman D.G.
        Guidance for developers of health research reporting guidelines.
        PLoS Med. 2010; 7e1000217
      1. Enhancing the QUAlity and Transparency of health Research. Search for reporting guidelines.
        (Available at)
        • Agha R.A.
        • Barai I.
        • Rajmohan S.
        • Lee S.
        • Anwar M.O.
        • Fowler A.J.
        • et al.
        Support for reporting guidelines in surgical journals needs improvement: a systematic review.
        Int J Surg. 2017; 45: 14-17
        • Checketts J.X.
        • Sims M.T.
        • Detweiler B.
        • Middlemist K.
        • Jones J.
        • Vassar M.
        An evaluation of reporting guidelines and clinical trial registry requirements among orthopaedic surgery journals.
        J Bone Joint Surg Am. 2018; 100: e15
        • Checketts J.X.
        • Cook C.
        • Imani S.
        • Duckett L.
        • Vassar M.
        An evaluation of reporting guidelines and clinical trial registry requirements among plastic surgery journals.
        Ann Plast Surg. 2018; 81: 215-219
        • Zhou J.
        • Li J.
        • Zhang J.
        • Geng B.
        • Chen Y.
        • Zhou X.
        Requirements for study registration and adherence to reporting guidelines in surgery journals: a cross-sectional study.
        World J Surg. 2021; 45: 1031-1042
      2. PubMed. Search date March 17.
        (Available at)
        • Zhang K.P.
        • Ma Y.F.
        • Shi Q.L.
        • Shen J.
        • Wu J.
        • Zhang X.
        • et al.
        Evidence on reporting guidelines for surgical technique in clinical disciplines: a scoping review protocol.
        Gland Surg. 2021; 10: 2325-2333
        • Peters M.D.J.
        • Godfrey C.
        • McInerney P.
        • Munn Z.
        • Tricco A.C.
        • Khalil H.
        Chapter 11: scoping reviews (2020 version).
        in: Aromataris E. Munn Z. Joanna Briggs Institute Reviewer's Manual, JBI. 2020 (Available at)
        https://reviewersmanual.joannabriggs.org/
        Date accessed: February 26, 2021
        • Tricco A.C.
        • Lillie E.
        • Zarin W.
        • O’Brien K.K.
        • Colquhoun H.
        • Levac D.
        • et al.
        PRISMA extension for scoping reviews (PRISMA-ScR): checklist and explanation.
        Ann Intern Med. 2018; 169: 467-473
        • Agha R.A.
        • Franchi T.
        • Sohrabi C.
        • Mathew G.
        • Kerwan A.
        • SCARE Group
        The SCARE 2020 guideline: updating consensus surgical CAse REport (SCARE) guidelines.
        Int J Surg. 2020; 84: 226-230
        • Ahn S.S.
        • Rutherford R.B.
        • Becker G.J.
        • Comerota A.J.
        • Johnston K.W.
        • McClean G.K.
        • et al.
        Reporting standards for lower extremity arterial endovascular procedures. Society for Vascular Surgery/International Society for Cardiovascular Surgery.
        J Vasc Surg. 1993; 17: 1103-1107
        • Rylski B.
        • Pacini D.
        • Beyersdorf F.
        • Quintana E.
        • Schachner T.
        • Tsagakis K.
        • et al.
        Standards of reporting in open and endovascular aortic surgery (STORAGE guidelines).
        Eur J Cardiothorac Surg. 2019; 56: 10-20
        • Bilbro N.A.
        • Hirst A.
        • Paez A.
        • Vasey B.
        • Pufulete M.
        • Sedrakyan A.
        • et al.
        The IDEAL reporting guidelines: a Delphi consensus statement stage specific recommendations for reporting the evaluation of surgical innovation.
        Ann Surg. 2021; 273: 82-85
        • Chang S.
        • Vogelbaum M.
        • Lang F.F.
        • Haines S.
        • Kunwar S.
        • Chiocca E.A.
        • et al.
        GNOSIS: guidelines for neuro-oncology: standards for investigational studies--reporting of surgically based therapeutic clinical trials.
        J Neurooncol. 2007; 82: 211-220
        • Gray R.J.
        • Sacks D.
        • Martin L.G.
        • Trerotola S.O.
        Reporting standards for percutaneous interventions in dialysis access. Technology Assessment Committee.
        J Vasc Interv Radiol. 1999; 10: 1405-1415
        • Turina M.I.
        • Shennib H.
        • Dunning J.
        • Cheng D.
        • Martin J.
        • Muneretto C.
        • et al.
        EACTS/ESCVS best practice guidelines for reporting treatment results in the thoracic aorta.
        Eur J Cardiothorac Surg. 2009; 35: 927-930
        • Fillinger M.F.
        • Greenberg R.K.
        • McKinsey J.F.
        • Chaikof E.L.
        • Society for Vascular Surgery Ad Hoc Committee on TEVAR Reporting Standards
        Reporting standards for thoracic endovascular aortic repair (TEVAR).
        J Vasc Surg. 2010; 52: 1022-1033.e15
        • Karmy-Jones R.
        • Ferrigno L.
        • Teso D.
        • Long WB, 3rd
        • Shackford S.
        Endovascular repair compared with operative repair of traumatic rupture of the thoracic aorta: a nonsystematic review and a plea for trauma-specific reporting guidelines.
        J Trauma. 2011; 71: 1059-1072
      3. Guidelines for reporting results in bariatric surgery. Standards committee, American society for bariatric surgery.
        Obes Surg. 1997; 7: 521-522
        • Brethauer S.A.
        • Kim J.
        • el Chaar M.
        • Papasavas P.
        • Eisenberg D.
        • Rogers A.
        • et al.
        Standardized outcomes reporting in metabolic and bariatric surgery.
        Surg Obes Relat Dis. 2015; 11: 489-506
        • Banno M.
        • Tsujimoto Y.
        • Kataoka Y.
        The majority of reporting guidelines are not developed with the Delphi method: a systematic review of reporting guidelines.
        J Clin Epidemiol. 2020; 124: 50-57
        • Moher D.
        • Weeks L.
        • Ocampo M.
        • Seely D.
        • Sampson M.
        • Altman D.G.
        • et al.
        Describing reporting guidelines for health research: a systematic review.
        J Clin Epidemiol. 2011; 64: 718-742
        • Wang X.
        • Chen Y.
        • Yang N.
        • Deng W.
        • Wang Q.
        • Li N.
        • et al.
        Methodology and reporting quality of reporting guidelines: systematic review.
        BMC Med Res Methodol. 2015; 15: 74
        • Swillens J.E.M.
        • Voorham Q.J.M.
        • Nagtegaal I.D.
        • Hermens R.P.M.G.
        Improving interdisciplinary communication: barriers and facilitators for implementation of standardized structured reporting in oncology.
        J Natl Compr Canc Netw. 2021; 19: 1-11
        • Mathew G.
        • Agha R.
        • STROCSS Group
        STROCSS 2021: strengthening the reporting of cohort, cross-sectional and case-control studies in surgery.
        Int J Surg. 2021; 96: 106165
        • Agha R.A.
        • Sohrabi C.
        • Mathew G.
        • Franchi T.
        • Kerwan A.
        • O’Neill N.
        • PROCESS Group
        The PROCESS 2020 guideline: updating consensus preferred reporting of CasESeries in surgery (PROCESS) guidelines.
        Int J Surg. 2020; 84: 231-235
        • Boutron I.
        • Altman D.G.
        • Moher D.
        • Schulz K.F.
        • Ravaud P.
        • CONSORT NPT Group
        CONSORT statement for randomized trials of nonpharmacologic treatments: a 2017 update and a CONSORT extension for nonpharmacologic trial abstracts.
        Ann Intern Med. 2017; 167: 40-47
        • Hoffmann T.C.
        • Glasziou P.P.
        • Boutron I.
        • Milne R.
        • Perera R.
        • Moher D.
        • et al.
        Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide.
        BMJ. 2014; 348: g1687
        • Harris A.
        • Butterworth J.
        • Boshier P.R.
        • MacKenzie H.
        • Tokunaga M.
        • Sunagawa H.
        • et al.
        Development of a reliable surgical quality assurance system for 2-stage esophagectomy in randomized controlled trials.
        Ann Surg. 2022; 275: 121-130
        • Bismuth H.
        Discovery and innovation in surgery: chance and necessity.
        Ann Surg. 2021; 274: 688-689
        • Altman D.G.
        The scandal of poor medical research.
        BMJ. 1994; 308: 283-284
        • Barbour G.
        I’ve Got a (lot of) Little (check)lists.
        (Available at)
        • Begg C.
        • Cho M.
        • Eastwood S.
        • Horton R.
        • Moher D.
        • Olkin I.
        • et al.
        Improving the quality of reporting of randomized controlled trials. The CONSORT statement.
        JAMA. 1996; 276: 637-639
        • Moher D.
        • Altman D.G.
        • Schulz K.F.
        • Simera I.
        • Wager E.
        Guidelines for Reporting Health Research: A User’s Manual. John Wiley & Sons, Ltd, Chichester, UK2014
        • EQUATOR
        What is a reporting guideline?.
        (Available at)