Top

BMC Pediatrics

Published in:

Open Access 01-12-2021 | Research article

Quality of pediatric clinical practice guidelines

Authors: Yali Liu, Yuan Zhang, Shu Wang, Ling Liu, Gang Che, Jiahui Niu, Yuan Ma

Published in: BMC Pediatrics | Issue 1/2021

Abstract

Background

There is a lack of a comprehensive evaluation for pediatric clinical practice guidelines (CPGs) published in recent years. Here, we assessed the quality of pediatric CPGs, considering factors that might affect their quality. The aim of the study is to promote a more coherent development and application of CPGs.

Methods

Pediatric CPGs published in PubMed, MedLive, Guidelines International Network, National Institute for Health and Care Excellence, and World Health Organization between 2017 and 2019 were searched and collected. Paired researchers conducted screening, data extraction, and quality assessment using the Appraisal of Guidelines for Research and Evaluation II (AGREE II). Linear regression analysis determined the factors affecting CPGs’ quality.

Results

The study included a total of 216 CPGs, which achieved a mean score of 4.26 out of 7 points (60.86%) in the AGREE II assessment. Only 6.48% of the CPGs reached the “recommend” level. The remaining 69.91% should have been modified before recommendation, while the other 23.61% did not reach the recommended level at all. The overall quality of recent pediatric CPGs was higher than previously, and the proportion of CPGs with low-quality decreased over time. However, there were still too few CPGs that reached a high-quality level. The “applicability” and “rigor of development” domains had generally low scores. CPGs formulated by developing countries or regions, those that are not under an organizations or groups responsibility, and those that used non-evidence-based methods were found to be associated with poorer quality in different domains as independent or combinational factors.

Conclusions

The quality of pediatric CPGs still needs to be improved. Specifically, a quality control before applying new CPGs should be essential to ensure their quality and applicability.

Available only for authorised users

Woolf SH, Grol R, Hutchinson A, Eccles M, Grimshaw J. Clinical guidelines: potential benefits, limitations, and harms of clinical guidelines. Bmj. 1999;318(7182):527–30. https://doi.org/10.1136/bmj.318.7182.527.CrossRefPubMedPubMedCentral

Fiks AG, Ross ME, Mayne SL, Song L, Liu W, Steffes J, McCarn B, Grundmeier RW, Localio AR, Wasserman R. Preschool ADHD Diagnosis and Stimulant Use Before and After the 2011 AAP Practice Guideline. Pediatrics. 2016;138(6):e20162025. https://doi.org/10.1542/peds.2016-2025. Epub 2016 Nov 15.

Djulbegovic B, Bennett CL, Guyatt G. A unifying framework for improving health care. J Eval Clin Pract. 2019;25(3):358–62. https://doi.org/10.1111/jep.13066.CrossRefPubMed

Browman GP, Snider A, Ellis P. Negotiating for change. The healthcare manager as catalyst for evidence-based practice: changing the healthcare environment and sharing experience. Healthc Pap. 2003;3(3):10–22. https://doi.org/10.12927/hcpap..17125.CrossRefPubMed

Steinert Y, Mann K, Anderson B, Barnett BM, Centeno A, Naismith L, et al. A systematic review of faculty development initiatives designed to enhance teaching effectiveness: a 10-year update: BEME guide no. 40. Med Teach. 2016;38(8):769–86. https://doi.org/10.1080/0142159X.2016.1181851.CrossRefPubMed

Kastner M, Bhattacharyya O, Hayden L, Makarski J, Estey E, Durocher L, et al. Guideline uptake is influenced by six implementability domains for creating and communicating guidelines: a realist review. J Clin Epidemiol. 2015;68(5):498–509. https://doi.org/10.1016/j.jclinepi.2014.12.013.CrossRefPubMed

Djulbegovic B, Bennett CL, Guyatt G. Failure to place evidence at the Centre of quality improvement remains a major barrier for advances in quality improvement. J Eval Clin Pract. 2019;25(3):369–72. https://doi.org/10.1111/jep.13146.CrossRefPubMed

Jolliffe L, Lannin NA, Cadilhac DA, Hoffmann T. Systematic review of clinical practice guidelines to identify recommendations for rehabilitation after stroke and other acquired brain injuries. BMJ Open. 2018;8(2):e018791. https://doi.org/10.1136/bmjopen-2017-018791.CrossRefPubMedPubMedCentral

Le JV. Implementation of evidence-based knowledge in general practice. Dan Med J. 2017;64(12):B5405.

10.

AGREE-Collaboration. Development and validation of an international appraisal instrument for assessing the quality of clinical practice guidelines: the AGREE project. Qual Saf Health Care. 2003;12(1):18–23.CrossRef

11.

Brouwers MC, Kho ME, Browman GP, Burgers JS, Cluzeau F, Feder G, et al. AGREE II: advancing guideline development, reporting and evaluation in health care. Cmaj. 2010;182(18):E839–42. https://doi.org/10.1503/cmaj.090449.CrossRefPubMedPubMedCentral

12.

Chen Y, Yang K, Marušic A, Qaseem A, Meerpohl JJ, Flottorp S, et al. A reporting tool for practice guidelines in health care: the RIGHT statement. Ann Intern Med. 2017;166(2):128–32. https://doi.org/10.7326/M16-1565.CrossRefPubMed

13.

Watine J, Friedberg B, Nagy E, Onody R, Oosterhuis W, Bunting PS, et al. Conflict between guideline methodologic quality and recommendation validity: a potential problem for practitioners. Clin Chem. 2006;52(1):65–72. https://doi.org/10.1373/clinchem.2005.056952.CrossRefPubMed

14.

Burgers JS. Guideline quality and guideline content: are they related? Clin Chem. 2006;52(1):3–4. https://doi.org/10.1373/clinchem.2005.059345.CrossRefPubMed

15.

Watine J. Is it time to develop AGREE III? CMAJ. 2019;191(43):E1198. https://doi.org/10.1503/cmaj.73257.CrossRefPubMedPubMedCentral

16.

Siering U, Eikermann M, Hausner E, Hoffmann-Eßer W, Neugebauer EA. Appraisal tools for clinical practice guidelines: a systematic review. PLoS One. 2013;8(12):e82915. https://doi.org/10.1371/journal.pone.0082915.CrossRefPubMedPubMedCentral

17.

Appenteng R, Nelp T, Abdelgadir J, Weledji N, Haglund M, Smith E, et al. A systematic review and quality analysis of pediatric traumatic brain injury clinical practice guidelines. PLoS One. 2018;13(8):e0201550. https://doi.org/10.1371/journal.pone.0201550.CrossRefPubMedPubMedCentral

18.

The AGREE II Instrument [Electronic version] [http://www.agreetrust.org].

19.

Chiappini E, Bortone B, Galli L, de Martino M. Guidelines for the symptomatic management of fever in children: systematic review of the literature and quality appraisal with AGREE II. BMJ Open. 2017;7(7):e015404. https://doi.org/10.1136/bmjopen-2016-015404.CrossRefPubMedPubMedCentral

20.

Font-Gonzalez A, Mulder RL, Loeffen EA, Byrne J, van Dulmen-den Broeder E, van den Heuvel-Eibrink MM, et al. Fertility preservation in children, adolescents, and young adults with cancer: quality of clinical practice guidelines and variations in recommendations. Cancer. 2016;122(14):2216–23. https://doi.org/10.1002/cncr.30047.CrossRefPubMed

21.

Isaac A, Saginur M, Hartling L, Robinson JL. Quality of reporting and evidence in American Academy of Pediatrics guidelines. Pediatrics. 2013;131(4):732–8. https://doi.org/10.1542/peds.2012-2027.CrossRefPubMed

22.

Boluyt N, Lincke CR, Offringa M. Quality of evidence-based pediatric guidelines. Pediatrics. 2005;115(5):1378–91. https://doi.org/10.1542/peds.2004-0575.CrossRefPubMed

23.

Bhatt M, Nahari A, Wang PW, Kearsley E, Falzone N, Chen S, et al. The quality of clinical practice guidelines for management of pediatric type 2 diabetes mellitus: a systematic review using the AGREE II instrument. Syst Rev. 2018;7(1):193. https://doi.org/10.1186/s13643-018-0843-1.CrossRefPubMedPubMedCentral

24.

Olweny CN, Arnold P. Clinical practice guidelines in pediatric anesthesia: what constitutes high-quality guidance? Paediatr Anaesth. 2020;30(2):89–95. https://doi.org/10.1111/pan.13805.CrossRefPubMed

25.

Alonso-Coello P, Irfan A, Solà I, Gich I, Delgado-Noguera M, Rigau D, et al. The quality of clinical practice guidelines over the last two decades: a systematic review of guideline appraisal studies. Qual Saf Health Care. 2010;19(6):e58. https://doi.org/10.1136/qshc.2010.042077.CrossRefPubMed

26.

Armstrong JJ, Goldfarb AM, Instrum RS, MacDermid JC. Improvement evident but still necessary in clinical practice guideline quality: a systematic review. J Clin Epidemiol. 2017;81:13–21. https://doi.org/10.1016/j.jclinepi.2016.08.005.CrossRefPubMed

27.

Gagliardi AR, Brouwers MC. Do guidelines offer implementation advice to target users? A systematic review of guideline applicability. BMJ Open. 2015;5(2):e007047. https://doi.org/10.1136/bmjopen-2014-007047.CrossRefPubMedPubMedCentral

28.

The EndNote Team: EndNote. In., vol. EndNote 20. Philadelphia: Clarivate; 2013.

29.

Institute-of-Medicine-(US)-Committee-on-Standards-for-Developing-Trustworthy-Clinical-Practice-Guidelines. Clinical Practice Guidelines We Can Trust. Washington (DC): National Academies Press (US); 2011.

30.

Holmer HK, Ogden LA, Burda BU, Norris SL. Quality of clinical practice guidelines for glycemic control in type 2 diabetes mellitus. PLoS One. 2013;8(4):e58625. https://doi.org/10.1371/journal.pone.0058625.CrossRefPubMedPubMedCentral

31.

Hoffmann-Eßer W, Siering U, Neugebauer EAM, Lampert U, Eikermann M. Systematic review of current guideline appraisals performed with the appraisal of guidelines for Research & Evaluation II instrument-a third of AGREE II users apply a cut-off for guideline quality. J Clin Epidemiol. 2018;95:120–7. https://doi.org/10.1016/j.jclinepi.2017.12.009.CrossRefPubMed

32.

Xie Z, Wang X, Sun L, Liu J, Guo Y, Xu B, et al. Appraisal of clinical practice guidelines on community-acquired pneumonia in children with AGREE II instrument. BMC Pediatr. 2016;16(1):119. https://doi.org/10.1186/s12887-016-0651-5.CrossRefPubMedPubMedCentral

33.

Kim JK, Chua ME, Ming JM, Santos JD, Zani-Ruttenstock E, Marson A, et al. A critical review of recent clinical practice guidelines on management of cryptorchidism. J Pediatr Surg. 2018;53(10):2041–7. https://doi.org/10.1016/j.jpedsurg.2017.11.050.CrossRefPubMed

34.

Shen WQ, Yao L, Wang XQ, Hu Y, Bian ZX. Quality assessment of cancer cachexia clinical practice guidelines. Cancer Treat Rev. 2018;70:9–15. https://doi.org/10.1016/j.ctrv.2018.07.008.CrossRefPubMed

35.

Tamás G, Abrantes C, Valadas A, Radics P, Albanese A, Tijssen MAJ, et al. Quality and reporting of guidelines on the diagnosis and management of dystonia. Eur J Neurol. 2018;25(2):275–83. https://doi.org/10.1111/ene.13488.CrossRefPubMed

36.

Chen Z, Hong Y, Liu N, Zhang Z. Quality of critical care clinical practice guidelines: assessment with AGREE II instrument. J Clin Anesth. 2018;51:40–7. https://doi.org/10.1016/j.jclinane.2018.08.011.CrossRefPubMed

37.

Madera M, Franco J, Solà I, Bonfill X, Alonso-Coello P. Screening and diagnosis of oral cancer: a critical quality appraisal of clinical guidelines. Clin Oral Investig. 2019;23(5):2215–26. https://doi.org/10.1007/s00784-018-2668-7.CrossRefPubMed

38.

Annane D, Lerolle N, Meuris S, Sibilla J, Olsen KM. Academic conflict of interest. Intensive Care Med. 2019;45(1):13–20. https://doi.org/10.1007/s00134-018-5458-4.CrossRefPubMed

39.

Komesaroff PA, Kerridge I, Lipworth W. Conflicts of interest: new thinking, new processes. Intern Med J. 2019;49(5):574–7. https://doi.org/10.1111/imj.14233.CrossRefPubMed

40.

Elder K, Turner KA, Cosgrove L, Lexchin J, Shnier A, Moore A, et al. Reporting of financial conflicts of interest by Canadian clinical practice guideline producers: a descriptive study. Cmaj. 2020;192(23):E617–e625. https://doi.org/10.1503/cmaj.191737.CrossRefPubMedPubMedCentral

41.

Grundy Q, Mayes C, Holloway K, Mazzarello S, Thombs BD, Bero L. Conflict of interest as ethical shorthand: understanding the range and nature of "non-financial conflict of interest" in biomedicine. J Clin Epidemiol. 2020;120:1–7. https://doi.org/10.1016/j.jclinepi.2019.12.014.CrossRefPubMed

42.

Wiersma M, Kerridge I, Lipworth W. Dangers of neglecting non-financial conflicts of interest in health and medicine. J Med Ethics. 2018;44(5):319–22. https://doi.org/10.1136/medethics-2017-104530.CrossRefPubMed

43.

Chen Y, Wang C, Shang H, Yang K, Norris SL. Clinical practice guidelines in China. Bmj. 2018;360:j5158.CrossRefPubMedPubMedCentral

44.

Horwitz RI, Hayes-Conroy A, Caricchio R, Singer BH. From evidence based medicine to medicine based evidence. Am J Med. 2017;130(11):1246–50. https://doi.org/10.1016/j.amjmed.2017.06.012.CrossRefPubMed

45.

Djulbegovic B, Guyatt GH. Progress in evidence-based medicine: a quarter century on. Lancet. 2017;390(10092):415–23. https://doi.org/10.1016/S0140-6736(16)31592-6.CrossRefPubMed

46.

Hirsh J, Guyatt G. Clinical experts or methodologists to write clinical guidelines? Lancet. 2009;374(9686):273–5. https://doi.org/10.1016/S0140-6736(09)60787-X.CrossRefPubMed

47.

Fervers B, Burgers JS, Voellinger R, Brouwers M, Browman GP, Graham ID, et al. Guideline adaptation: an approach to enhance efficiency in guideline development and improve utilisation. BMJ Qual Saf. 2011;20(3):228–36. https://doi.org/10.1136/bmjqs.2010.043257.CrossRefPubMed

48.

Wang Z, Norris SL, Bero L. The advantages and limitations of guideline adaptation frameworks. Implement Sci. 2018;13(1):72. https://doi.org/10.1186/s13012-018-0763-4.CrossRefPubMedPubMedCentral

49.

Dizon JM, Machingaidze S, Grimmer K. To adopt, to adapt, or to contextualise? The big question in clinical practice guideline development. BMC Res Notes. 2016;9(1):442. https://doi.org/10.1186/s13104-016-2244-7.CrossRefPubMedPubMedCentral

50.

Eikermann M, Holzmann N, Siering U, Rüther A. Tools for assessing the content of guidelines are needed to enable their effective use--a systematic comparison. BMC Res Notes. 2014;7(1):853. https://doi.org/10.1186/1756-0500-7-853.CrossRefPubMedPubMedCentral

51.

Nuckols TK, Lim YW, Wynn BO, Mattke S, MacLean CH, Harber P, et al. Rigorous development does not ensure that guidelines are acceptable to a panel of knowledgeable providers. J Gen Intern Med. 2008;23(1):37–44. https://doi.org/10.1007/s11606-007-0440-9.CrossRefPubMed

Title: Quality of pediatric clinical practice guidelines
Authors: Yali Liu
Yuan Zhang
Shu Wang
Ling Liu
Gang Che
Jiahui Niu
Yuan Ma
Publication date: 01-12-2021
Publisher: BioMed Central
Published in: BMC Pediatrics / Issue 1/2021
Electronic ISSN: 1471-2431
DOI: https://doi.org/10.1186/s12887-021-02693-1

At a glance: The STEP trials

Springer Medicine

Quality of pediatric clinical practice guidelines

Abstract

Background

Methods

Results

Conclusions

At a glance: The STEP trials

Springer Medicine

Abstract

Background

Methods

Results

Conclusions

Please log in to get access to this content

Other articles of this Issue 1/2021

Burden and consequence of birth defects in Nepal-evidence from prospective cohort study

Vitamin D deficiency in children with acute bronchiolitis: a prospective cross-sectional case- control study

“Childhood Anemia in India: an application of a Bayesian geo-additive model”

Impact of systematic early tuberculosis detection using Xpert MTB/RIF Ultra in children with severe pneumonia in high tuberculosis burden countries (TB-Speed pneumonia): a stepped wedge cluster randomized trial

Case Report : Li-Fraumeni Syndrome with Central Nervous System Tumors in Two Siblings

Perinatal factors influencing the neonatal hearing screening results