Top

World Journal of Surgery

Published in:

01-12-2019 | Colostomy | Scientific Review

Quality Assessment and Risk of Bias of Systematic Reviews of Prophylactic Mesh for Parastomal Hernia Prevention Using AMSTAR and ROBIS Tools

Authors: Josep M. García-Alamino, Manuel López-Cano, Leonard Kroese, Frederik Helgstrand, Filip Muysoms

Published in: World Journal of Surgery | Issue 12/2019

Abstract

Background

Systematic reviews play a crucial role in clinical decision making and resource allocation and are expected to be unbiased and consistent. The aim of this study is a review of systematic reviews on the use of prophylactic mesh to prevent parastomal hernia (PH) formation using ROBIS and AMSTAR tools to assess the risk of bias and methodological quality.

Methods

We included systematic reviews with or without meta-analysis of which the objective was to assess the use of a prophylactic mesh to prevent PH. A systematic search of the literature in five databases from inception until December 2017 was conducted. For each systematic review, methodologic quality and risk of bias were assessed using the AMSTAR and ROBIS tools, respectively. We estimated the inter-rater reliability for individual domains and for the overall methodological quality and risk of bias using Fleiss’ k.

Results

We identified 14 systematic reviews that met the inclusion criteria. Using the AMSTAR scale with a cutoff value, six reviews showed high methodologic quality and eight were of low quality. Using the ROBIS tool, the overall risk of bias was low in 50% of the reviews analyzed. In the remaining studies, the risk of bias was unclear.

Conclusions

The global evidence in favor of the use of a prophylactic mesh for preventing PH is not uniform regarding quality and risk of bias. Surgeons cannot be equally confident in the results of all systematic reviews published on this topic.

Antoniou SA, Agresta F, García Alamino JM et al (2018) European Hernia Society guidelines on prevention and treatment of parastomal hernias. Hernia 22(1):183–198CrossRef

López-Cano M, Brandsma HT, Bury K et al (2017) Prophylactic mesh to prevent parastomal hernia after end colostomy: a meta-analysis and trial sequential analysis. Hernia 21:177–189CrossRef

Djulbegovic B, Guyatt GH (2017) Progress in evidence-based medicine: a quarter century on. Lancet 390:415–423CrossRef

Djulbegovic B, Elqayam S, Dale W (2018) Rational decision making in medicine: implications for overuse and underuse. J Eval Clin Pract 24:655–665CrossRef

Higgins J, Lasserson T, Chandler J, Tovey D, Churchill R. Methodological expectations of cochrane intervention reviews (MECIR). Standards for the conduct and reporting of new cochrane intervention reviews, reporting of protocols and the planning, conduct and reporting of updates. Version 1.07 (last update November 2018). https://community.cochrane.org/mecir-manual. Accessed 8 Dec 2018

Eden J, Levit L, Berg AO, Morton S (eds.) (2011) Finding what works in health care: standards for systematic reviews. The National Academies Press, Washington, D.C

Liberati A, Altman DG, Tetzlaff J et al (2009) The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. Plos Med 6(7):e1000100CrossRef

Shea BJ, Grimshaw JM, Wells GA et al (2007) Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews. BMC Med Res Methodol 7:10CrossRef

Shea BJ, Hamel C, Wells GA et al (2009) AMSTAR is a reliable and valid measurement tool to assess the methodological quality of systematic reviews. J Clin Epidemiol 62:1013–1020CrossRef

10.

Whiting P, Savović J, Higgings JP et al (2016) ROBIS: a new tool to assess risk of bias in systematic reviews was developed. J Clin Epidemiol 69:225–234CrossRef

11.

Burda BU, Holmer HK, Norris SL (2016) Limitations of a measurement tool to assess systematic reviews (AMSTAR) and suggestions for improvement. Syst Rev 5:58CrossRef

12.

Pieper D, Buechter RB, Li L et al (2015) Systematic review found AMSTAR, but not R(evised)-AMSTAR, to have good measurement properties. J Clin Epidemiol 68:574–583CrossRef

13.

Banzi R, Cinquini M, Gonzalez-Lorenzo M et al (2018) Quality assessment versus risk of bias in systematic reviews: AMSTAR and ROBIS had similar reliability but differed in their construct and applicability. J Clin Epidemiol 99:24–32CrossRef

14.

Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33:159–174CrossRef

15.

Israelsson LA (2005) Preventing and treating parastomal hernia. World J Surg 29:1086–1089https://doi.org/10.1007/s00268-005-7973-z CrossRefPubMed

16.

Helgstrand F, Gögenur I, Rosenberg J (2008) Prevention of parastomal hernia by the placement of a mesh at the primary operation. Hernia 12:577–582CrossRef

17.

Tam KW, Wei PL, Kuo LJ et al (2010) Systematic review of the use of a mesh to prevent parastomal hernia. World J Surg 34:2723–2729https://doi.org/10.1007/s00268-010-0739-2 CrossRefPubMed

18.

Wijeyekoon SP, Gurusamy K, El-Gendy K et al (2010) Prevention of parastomal herniation with biologic/composite prosthetic mesh: a systematic review and meta-analysis of randomized controlled trials. J Am Coll Surg 211:637–645CrossRef

19.

Shabbir J, Chaudhary BN, Dawson R (2012) A systematic review on the use of prophylactic mesh during primary stoma formation to prevent parastomal hernia formation. Colorectal Dis 14:931–936CrossRef

20.

Sajid MS, Kalra L, Hutson K et al (2012) Parastomal hernia as a consequence of colorectal cancer resections can prophylactically be controlled by mesh insertion at the time of primary surgery: a literature based systematic review of published trials. Minerva Chir 67:289–296PubMed

21.

Hotouras A, Murphy J, Thaha M et al (2013) The persistent challenge of parastomal herniation: a review of the literature and future developments. Colorectal Dis 15:e202–214CrossRef

22.

Fortelny RH, Hofmann A, May C et al (2015) Prevention of a parastomal hernia by biological mesh reinforcement. Front Surg 2:53CrossRef

23.

Wang S, Wang W, Zhu B et al (2016) Efficacy of prophylactic mesh in end-colostomy construction: a systematic review and meta-analysis of randomized controlled trials. World J Surg 40:2528–2536https://doi.org/10.1007/s00268-016-3576-0 CrossRefPubMedPubMedCentral

24.

Cornille JB, Pathak S, Daniels IR et al (2017) Prophylactic mesh use during primary stoma formation to prevent parastomal hernia. Ann R Coll Surg Engl 99:2–11CrossRef

25.

Muysoms FE, Dietz UA (2016) Prophylactic meshes in the abdominal wall. German Version Chirurg 87:751–761PubMed

26.

Muysoms FE, Dietz UA (2017) Prophylactic meshes in the abdominal wall. Chirurg 88(Suppl 1):34–41CrossRef

27.

Zhu J, Pu Y, Yang X, et al. (2016) Prophylactic mesh application during colostomy to prevent parastomal hernia: a meta-analysis. Gastroenterol Res Pract 2016: Article ID 1694265PubMedPubMedCentral

28.

Chapman SJ, Wood B, Drake TM et al (2017) Systematic review and meta-analysis of prophylactic mesh during primary stoma formation to prevent parastomal hernia. Dis Colon Rectum 60:107–115CrossRef

29.

Patel SV, Zhang L, Chadi SA et al (2017) Prophylactic mesh to prevent parastomal hernia: a meta-analysis of randomized controlled studies. Tech Coloproctol 21:5–13CrossRef

30.

Cross AJ, Buchwald PL, Frizelle FA et al (2017) Meta-analysis of prophylactic mesh to prevent parastomal hernia. Br J Surg 104:179–186 https://doi.org/10.1002/bjs.10402 CrossRefPubMed

31.

Pianka F, Probst P, Keller A-V et al (2017) Prophylactic mesh placement for the PREvention of paraSTOmal hernias: the PRESTO systematic review and meta-analysis. PLoS ONE 12:e0171548CrossRef

32.

Gómez-García F, Ruano J, Gay-Mimbrera J et al (2017) Most systematic reviews of high methodological quality on psoriasis interventions are classified as high risk of bias using ROBIS tool. J Clin Epidemiol 92:79–88CrossRef

33.

Perry R, Leach V, Davies P et al (2017) An overview of systematic reviews of complementary and alternative therapies for fibromyalgia using both AMSTAR and ROBIS as quality assessment tools. Syst Rev 6:97CrossRef

34.

Parkinson F, Dafydd L, Singh R et al (2014) Preventing parastomal herniation in 2014 and beyond. Colorectal Dis 16:390CrossRef

35.

Djulbegovic B, Elqayam S (2017) Many faces of rationality: implications of the great rationality debate for clinical decision-making. J Eval Clin Pract 23:915–922CrossRef

36.

Bühn S, Mathes T, Prengel P et al (2017) The risk of bias in systematic reviews tool showed fair reliability and good construct validity. J Clin Epidemiol 91:121–128CrossRef

37.

Ioannidis JP (2016) The mass production of redundant, misleading, and conflicted systematic reviews and meta-analyses. Milbank Q 94:485–514CrossRef

38.

Jones HG, Rees M, Aboumarzouk OM, et al. (2018) Prosthetic mesh placement for the prevention of parastomal herniation. Cochrane Database Syst Rev 7:CD008905PubMed

39.

Shea BJ, Bouter LM, Peterson J et al (2007) External validation of a measurement tool to assess systematic reviews (AMSTAR). PLoS ONE 2:e1350CrossRef

40.

Shea BJ, Reeves BC, Wells G et al (2017) AMSTAR 2: a critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both. BMJ 358:j4008CrossRef

41.

Gates A, Gates M, Duarte G et al (2018) Evaluation of the reliability, usability, and applicability of AMSTAR, AMSTAR 2, and ROBIS: protocol for a descriptive analytic study. Syst Rev 7:85CrossRef

Title: Quality Assessment and Risk of Bias of Systematic Reviews of Prophylactic Mesh for Parastomal Hernia Prevention Using AMSTAR and ROBIS Tools
Authors: Josep M. García-Alamino
Manuel López-Cano
Leonard Kroese
Frederik Helgstrand
Filip Muysoms
Publication date: 01-12-2019
Publisher: Springer International Publishing
Keywords: Colostomy
Parastomale Hernie
Published in: World Journal of Surgery / Issue 12/2019
Print ISSN: 0364-2313
Electronic ISSN: 1432-2323
DOI: https://doi.org/10.1007/s00268-019-05139-z

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

Quality Assessment and Risk of Bias of Systematic Reviews of Prophylactic Mesh for Parastomal Hernia Prevention Using AMSTAR and ROBIS Tools

Abstract

Background

Methods

Results

Conclusions

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

Abstract

Background

Methods

Results

Conclusions

Please log in to get access to this content

Other articles of this Issue 12/2019

Daytime Versus Night-Time Emergency Abdominal Operations: Perspective from a Low–Middle-Income Country

Factors Influencing a Medical Student’s Decision to Pursue Surgery as a Career

Flatulence After Anti-reflux Treatment (FAART) Study

Authors’ Reply: Perioperative Mortality Rates as a Health Metric for Acute Abdominal Surgery in Low- and Middle-Income Countries: A Systematic Review and Future Recommendations

Acquisition of Surgical Skills by Final-Year Medical Students in State-Owned Medical Schools of Cameroon: Are We Doing Any Good?

Impact of Preoperative Skeletal Muscle Quality Measurement on Long-Term Survival After Curative Gastrectomy for Locally Advanced Gastric Cancer