Skip to main content
Top
Published in: Neurosurgical Review 1/2015

01-01-2015 | Review

Quality appraisal of clinical practice guidelines on glioma

Authors: Hongliang Tian, Yani Gou, Yawen Pan, Qiao Li, Dang Wei, Zhenwei Wang, Xiaodong Niu, Wentao Liang, Yinian Zhang

Published in: Neurosurgical Review | Issue 1/2015

Login to get access

Abstract

Clinical practice guidelines (CPGs) play an important role in healthcare. The guideline development process should be precise and rigorous to ensure that the results are reproducible and not vague. To determine the quality of guidelines, the Appraisal of Guidelines and Research and Evaluation (AGREE) instrument was developed and introduced. The aim of the present study was to assess the methodological quality of clinical practice guidelines on glioma. Eight databases (including MEDLINE and Embase) were searched till to August, 2013. The methodological quality of the guidelines was assessed by four authors independently using the AGREE II instrument. Fifteen relevant guidelines were included from 940 citations. The overall agreement among reviewers was moderate (intra-class correlation coefficient = 0.83; 95 % confidence interval [CI], 0.66–0.92). The mean scores were moderate for the domains “scope and purpose” (59.54) and “clarity of presentation” (65.46); however, there were low scores for the domains “stakeholder involvement” (43.80), “rigor of development” (39.01), “applicability” (31.89), and “editorial independence” (30.83). Only one third of the guidelines described the systematic methods for searching, and nearly half of the (47 %) guidelines did not give a specific recommendation. Only four of 15 described a procedure for updating the guideline; meanwhile, just six guidelines in this field can be considered to be evidence-based. The quality and transparency of the development process and the consistency in the reporting of glioma guidelines need to be improved. And the quality of reporting of guidelines was disappointing. Many other methodological disadvantages were identified. In the future, glioma CPGs should be based on the best available evidence and rigorously developed and reported. Greater efforts are needed to provide high-quality guidelines that serve as a useful and reliable tool for clinical decision-making in this field.
Literature
2.
go back to reference Alberta Provincial CNS Tumour Team (2012) Glioblastoma. Edmonton (Alberta): Alberta Health Services, Cancer Care. (Clinical practice guideline; no. CNS-001 version 3) Alberta Provincial CNS Tumour Team (2012) Glioblastoma. Edmonton (Alberta): Alberta Health Services, Cancer Care. (Clinical practice guideline; no. CNS-001 version 3)
3.
go back to reference Alonso-Coello P, Irfan A, Solà I, Gich I, Delgado-Noguera M, Rigau D, Tort S, Bonfill X, Burgers J, Schunemann H (2010) The quality of clinical practice guidelines over the last two decades: a systematic review of guideline appraisal studies. Qual Saf Health Care 19(6):e58. doi:10.1136/qshc.2010.042077 PubMed Alonso-Coello P, Irfan A, Solà I, Gich I, Delgado-Noguera M, Rigau D, Tort S, Bonfill X, Burgers J, Schunemann H (2010) The quality of clinical practice guidelines over the last two decades: a systematic review of guideline appraisal studies. Qual Saf Health Care 19(6):e58. doi:10.​1136/​qshc.​2010.​042077 PubMed
4.
go back to reference Australian Cancer Network (2009) Adult Brain Tumour Guidelines Working Party. Clinical practice guidelines for the management of adult gliomas: astrocytomas and oligodendrogliomas. Cancer Council Australia, Australian Cancer Network and Clinical Oncological Society of Australia Inc., Sydney Australian Cancer Network (2009) Adult Brain Tumour Guidelines Working Party. Clinical practice guidelines for the management of adult gliomas: astrocytomas and oligodendrogliomas. Cancer Council Australia, Australian Cancer Network and Clinical Oncological Society of Australia Inc., Sydney
5.
go back to reference Australian Institute of Health and Welfare and Australasian Association of Cancer Registries (2004) Cancer in Australia 2001. AIHW, Canberra Australian Institute of Health and Welfare and Australasian Association of Cancer Registries (2004) Cancer in Australia 2001. AIHW, Canberra
6.
go back to reference Berrocal A, Gil M, Gallego Ó, Balaña C, Pérez Segura P, García-Mata J, Reynes G, SEOM (Spanish Society of Clinical Oncology) (2012) SEOM guideline for the treatment of malignant glioma. Clin Transl Oncol 14(7):545–550PubMedCrossRef Berrocal A, Gil M, Gallego Ó, Balaña C, Pérez Segura P, García-Mata J, Reynes G, SEOM (Spanish Society of Clinical Oncology) (2012) SEOM guideline for the treatment of malignant glioma. Clin Transl Oncol 14(7):545–550PubMedCrossRef
7.
go back to reference Brozek JL, Akl EA, Alonso-Coello P, Lang D, Jaeschke R, Williams JW, Phillips B, Lelgemann M, Lethaby A, Bousquet J, Guyatt GH, Schünemann HJ, GRADE Working Group (2009) Grading quality of evidence and strength of recommendations in clinical practice guidelines. Part 1 of 3. An overview of the GRADE approach and grading quality of evidence about interventions. Allergy 64(5):669–677PubMedCrossRef Brozek JL, Akl EA, Alonso-Coello P, Lang D, Jaeschke R, Williams JW, Phillips B, Lelgemann M, Lethaby A, Bousquet J, Guyatt GH, Schünemann HJ, GRADE Working Group (2009) Grading quality of evidence and strength of recommendations in clinical practice guidelines. Part 1 of 3. An overview of the GRADE approach and grading quality of evidence about interventions. Allergy 64(5):669–677PubMedCrossRef
8.
go back to reference Brozek JL, Akl EA, Jaeschke R, Lang DM, Bossuyt P, Glasziou P, Helfand M, Ueffing E, Alonso-Coello P, Meerpohl J, Phillips B, Horvath AR, Bousquet J, Guyatt GH, Schünemann HJ, GRADE Working Group (2009) Grading quality of evidence and strength of recommendations in clinical practice guidelines: Part 2 of 3. The GRADE approach to grading quality of evidence about diagnostic tests and strategies. Allergy 64(8):1109–1116PubMedCrossRef Brozek JL, Akl EA, Jaeschke R, Lang DM, Bossuyt P, Glasziou P, Helfand M, Ueffing E, Alonso-Coello P, Meerpohl J, Phillips B, Horvath AR, Bousquet J, Guyatt GH, Schünemann HJ, GRADE Working Group (2009) Grading quality of evidence and strength of recommendations in clinical practice guidelines: Part 2 of 3. The GRADE approach to grading quality of evidence about diagnostic tests and strategies. Allergy 64(8):1109–1116PubMedCrossRef
9.
go back to reference Brouwers MC, Kho ME, Browman GP, Burgers JS, Cluzeau F, Feder G, Fervers B, Graham ID, Grimshaw J, Hanna SE, Littlejohns P, Makarski J, Zitzelsberger L, AGREE next steps consortium (2010) AGREE II: advancing guideline development, reporting and evaluation in health care. CMAJ 18:E839–E842CrossRef Brouwers MC, Kho ME, Browman GP, Burgers JS, Cluzeau F, Feder G, Fervers B, Graham ID, Grimshaw J, Hanna SE, Littlejohns P, Makarski J, Zitzelsberger L, AGREE next steps consortium (2010) AGREE II: advancing guideline development, reporting and evaluation in health care. CMAJ 18:E839–E842CrossRef
10.
go back to reference Burls A (2010) AGREE II—improving the quality of clinical care. Lancet 9747:1128–1129CrossRef Burls A (2010) AGREE II—improving the quality of clinical care. Lancet 9747:1128–1129CrossRef
11.
go back to reference Chamberlain MC, Kormanik PA (1998) Practical guidelines for the treatment of malignant gliomas. West J Med 168(2):114–120, 10PubMedCentralPubMed Chamberlain MC, Kormanik PA (1998) Practical guidelines for the treatment of malignant gliomas. West J Med 168(2):114–120, 10PubMedCentralPubMed
12.
go back to reference Cluzeau FA, Littlejohns P, Grimshaw JM, Feder G, Moran SE (1999) Development and application of a generic methodology to assess the quality of clinical guidelines. Int J Qual Health Care 11:21–28PubMedCrossRef Cluzeau FA, Littlejohns P, Grimshaw JM, Feder G, Moran SE (1999) Development and application of a generic methodology to assess the quality of clinical guidelines. Int J Qual Health Care 11:21–28PubMedCrossRef
13.
go back to reference Committee to advise the public health service on clinical practice guidelines, Institute of medicine (1990) In: Field MJ, Lohr KN (eds) Clinical practice guidelines: directions for a new program. National Academy Press, Washington (DC) Committee to advise the public health service on clinical practice guidelines, Institute of medicine (1990) In: Field MJ, Lohr KN (eds) Clinical practice guidelines: directions for a new program. National Academy Press, Washington (DC)
14.
go back to reference Davies E, Hopkins A (1997) Good practice in the management of adults with malignant cerebral glioma: clinical guidelines. Working Group, Royal College of Physicians. Br J Neurosurg 11(4):318–330PubMedCrossRef Davies E, Hopkins A (1997) Good practice in the management of adults with malignant cerebral glioma: clinical guidelines. Working Group, Royal College of Physicians. Br J Neurosurg 11(4):318–330PubMedCrossRef
15.
go back to reference Dutch Society for Neuro-Oncology (2008) Gliomas. Amsterdam, The Netherlands: Association of Comprehensive Cancer Centres (ACCC). 28 p Dutch Society for Neuro-Oncology (2008) Gliomas. Amsterdam, The Netherlands: Association of Comprehensive Cancer Centres (ACCC). 28 p
16.
go back to reference Easaw JC, Mason WP, Perry J, Laperrière N, Eisenstat DD, Del Maestro R, Bélanger K, Fulton D, Macdonald D, Canadian Glioblastoma Recommendations Committee (2011) Canadian recommendations for the treatment of recurrent or progressive glioblastoma multiforme. Curr Oncol 18(3):e126–e136PubMedCentralPubMedCrossRef Easaw JC, Mason WP, Perry J, Laperrière N, Eisenstat DD, Del Maestro R, Bélanger K, Fulton D, Macdonald D, Canadian Glioblastoma Recommendations Committee (2011) Canadian recommendations for the treatment of recurrent or progressive glioblastoma multiforme. Curr Oncol 18(3):e126–e136PubMedCentralPubMedCrossRef
17.
go back to reference Fervers B, Burgers JS, Haugh MC, Latreille J, Mlika-Cabanne N, Paquet L, Coulombe M, Poirier M, Burnand B (2006) Adaptation of clinical guidelines: literature review and proposition for a framework and procedure. Int J Qual Health Care 18:167–176PubMedCrossRef Fervers B, Burgers JS, Haugh MC, Latreille J, Mlika-Cabanne N, Paquet L, Coulombe M, Poirier M, Burnand B (2006) Adaptation of clinical guidelines: literature review and proposition for a framework and procedure. Int J Qual Health Care 18:167–176PubMedCrossRef
18.
go back to reference Frappaz D, Chinot O, Bataillard A, Ben Hassel M, Capelle L, Chanalet S, Chatel M, Figarella-Branger D, Guegan Y, Guyotat J, Hoang-Xuan K, Jouanneau E, Keime-Guibert F, Laforêt C, Linassier C, Loiseau H, Maire JP, Menei P, Rousmans S, Sanson M, Sunyach MP, FNCLCC, Neuro-oncology Group of the Fédération Nationale des Centres de Lutte Contre le Cancer, Association of French-speaking Neuro-oncologists (2003) Summary version of the standards, options and recommendations for the management of adult patients with intracranial glioma. Br J Cancer 89(Suppl1):S73–S83PubMedCentralPubMedCrossRef Frappaz D, Chinot O, Bataillard A, Ben Hassel M, Capelle L, Chanalet S, Chatel M, Figarella-Branger D, Guegan Y, Guyotat J, Hoang-Xuan K, Jouanneau E, Keime-Guibert F, Laforêt C, Linassier C, Loiseau H, Maire JP, Menei P, Rousmans S, Sanson M, Sunyach MP, FNCLCC, Neuro-oncology Group of the Fédération Nationale des Centres de Lutte Contre le Cancer, Association of French-speaking Neuro-oncologists (2003) Summary version of the standards, options and recommendations for the management of adult patients with intracranial glioma. Br J Cancer 89(Suppl1):S73–S83PubMedCentralPubMedCrossRef
20.
go back to reference Grilli R, Magrini N, Penna A, Mura G, Liberati A (2000) Practice guidelines developed by specialty societies: the need for a critical appraisal. Lancet 355:103–106PubMedCrossRef Grilli R, Magrini N, Penna A, Mura G, Liberati A (2000) Practice guidelines developed by specialty societies: the need for a critical appraisal. Lancet 355:103–106PubMedCrossRef
21.
go back to reference Grol R, Cluzeau FA, Burgers JS (2003) Clinical practice guidelines: towards better quality guidelines and increased international collaboration. Br J Cancer 89((suppl 1)):S4–S8PubMedCentralPubMedCrossRef Grol R, Cluzeau FA, Burgers JS (2003) Clinical practice guidelines: towards better quality guidelines and increased international collaboration. Br J Cancer 89((suppl 1)):S4–S8PubMedCentralPubMedCrossRef
22.
go back to reference Guidelines Glioma Working Group (2012) China clinical practice guidelines for diagnosis and treatment in central nervous system glioma. Natl Med J China 92(33):2309–2313 Guidelines Glioma Working Group (2012) China clinical practice guidelines for diagnosis and treatment in central nervous system glioma. Natl Med J China 92(33):2309–2313
24.
go back to reference Huang TW, Lai JH, Wu MY, Chen SL, Wu CH, Tam KW (2013) Systematic review of clinical practice guidelines in the diagnosis and management of thyroid nodules and cancer. BMC Med 11(1):191PubMedCentralPubMedCrossRef Huang TW, Lai JH, Wu MY, Chen SL, Wu CH, Tam KW (2013) Systematic review of clinical practice guidelines in the diagnosis and management of thyroid nodules and cancer. BMC Med 11(1):191PubMedCentralPubMedCrossRef
25.
go back to reference Laperriere N, Walker-Dilks C (2009) PET imaging in brain cancer. Cancer Care Ontario, Toronto, Program in Evidence-based Care PET Recommendation Report No.:10 Laperriere N, Walker-Dilks C (2009) PET imaging in brain cancer. Cancer Care Ontario, Toronto, Program in Evidence-based Care PET Recommendation Report No.:10
26.
go back to reference Mason WP, Maestro RD, Eisenstat D, Forsyth P, Fulton D, Laperrière N, Macdonald D, Perry J, Thiessen B, Canadian GBM Recommendations Committee (2007) Canadian recommendations for the treatment of glioblastoma multiforme. Curr Oncol 14(3):110–117PubMedCentralPubMedCrossRef Mason WP, Maestro RD, Eisenstat D, Forsyth P, Fulton D, Laperrière N, Macdonald D, Perry J, Thiessen B, Canadian GBM Recommendations Committee (2007) Canadian recommendations for the treatment of glioblastoma multiforme. Curr Oncol 14(3):110–117PubMedCentralPubMedCrossRef
27.
go back to reference National Comprehensive Cancer Network (2011) NCCN clinical practice guidelines in oncology. Central nervous system cancers. Version 2. NCCN.org National Comprehensive Cancer Network (2011) NCCN clinical practice guidelines in oncology. Central nervous system cancers. Version 2. NCCN.org
29.
go back to reference Oxman AD, Glasziou P, Williams JW (2008) What should clinicians do when faced with conflicting recommendations? BMJ 337:a2530PubMedCrossRef Oxman AD, Glasziou P, Williams JW (2008) What should clinicians do when faced with conflicting recommendations? BMJ 337:a2530PubMedCrossRef
30.
go back to reference Schünemann HJ, Hill SR, Kakad M, Vist GE, Bellamy R, Stockman L, Wisløff TF, Del Mar C, Hayden F, Uyeki TM, Farrar J, Yazdanpanah Y, Zucker H, Beigel J, Chotpitayasunondh T, Hien TT, Ozbay B, Sugaya N, Oxman AD (2007) Transparent development of the WHO rapid advice guidelines. PLoS Med 4:e119PubMedCentralPubMedCrossRef Schünemann HJ, Hill SR, Kakad M, Vist GE, Bellamy R, Stockman L, Wisløff TF, Del Mar C, Hayden F, Uyeki TM, Farrar J, Yazdanpanah Y, Zucker H, Beigel J, Chotpitayasunondh T, Hien TT, Ozbay B, Sugaya N, Oxman AD (2007) Transparent development of the WHO rapid advice guidelines. PLoS Med 4:e119PubMedCentralPubMedCrossRef
31.
go back to reference Schünemann HJ, Osborne M, Moss J, Manthous C, Wagner G, Sicilian L, Ohar J, McDermott S, Lucas L, Jaeschke R, ATS Ethics and Conflict of Interest Committee and the Documents Development and Implementation Committee (2009) An official American Thoracic Society Policy statement: managing conflict of interest in professional societies. Am J Respir Crit Care Med 180(6):564–580. doi:10.1164/rccm.200901-0126ST PubMedCrossRef Schünemann HJ, Osborne M, Moss J, Manthous C, Wagner G, Sicilian L, Ohar J, McDermott S, Lucas L, Jaeschke R, ATS Ethics and Conflict of Interest Committee and the Documents Development and Implementation Committee (2009) An official American Thoracic Society Policy statement: managing conflict of interest in professional societies. Am J Respir Crit Care Med 180(6):564–580. doi:10.​1164/​rccm.​200901-0126ST PubMedCrossRef
32.
go back to reference Shrout PE, Fleiss JL (1979) Intraclass correlations: uses in assessing rater reliability. Psychol Bull 2:420–428CrossRef Shrout PE, Fleiss JL (1979) Intraclass correlations: uses in assessing rater reliability. Psychol Bull 2:420–428CrossRef
34.
go back to reference Shekelle PG, Ortiz E, Rhodes S, Morton SC, Eccles MP, Grimshaw JM, Woolf SH (2001) Validity of the agency for healthcare research and quality clinical practice guidelines: how quickly do guidelines become outdated? JAMA 286:1461–1467PubMedCrossRef Shekelle PG, Ortiz E, Rhodes S, Morton SC, Eccles MP, Grimshaw JM, Woolf SH (2001) Validity of the agency for healthcare research and quality clinical practice guidelines: how quickly do guidelines become outdated? JAMA 286:1461–1467PubMedCrossRef
35.
go back to reference Soffietti R, Baumert BG, Bello L, von Deimling A, Duffau H, Frénay M, Grisold W, Grant R, Graus F, Hoang-Xuan K, Klein M, Melin B, Rees J, Siegal T, Smits A, Stupp R, Wick W, European Federation of Neurological Societies (2010) Guidelines on management of low-grade gliomas: report of an EFNS-EANO Task Force. Eur J Neurol 17(9):1124–1133. doi:10.1111/j.1468-1331.2010.03151.x PubMedCrossRef Soffietti R, Baumert BG, Bello L, von Deimling A, Duffau H, Frénay M, Grisold W, Grant R, Graus F, Hoang-Xuan K, Klein M, Melin B, Rees J, Siegal T, Smits A, Stupp R, Wick W, European Federation of Neurological Societies (2010) Guidelines on management of low-grade gliomas: report of an EFNS-EANO Task Force. Eur J Neurol 17(9):1124–1133. doi:10.​1111/​j.​1468-1331.​2010.​03151.​x PubMedCrossRef
36.
go back to reference Stupp R, Tonn JC, Brada M, Pentheroudakis G, ESMO Guidelines Working Group (2010) High-grade malignant glioma: ESMO Clinical Practice Guidelines for diagnosis, treatment and follow-up. Ann Oncol 21(Suppl 5):v190-3. doi:10.1093/annonc/mdq187 PubMed Stupp R, Tonn JC, Brada M, Pentheroudakis G, ESMO Guidelines Working Group (2010) High-grade malignant glioma: ESMO Clinical Practice Guidelines for diagnosis, treatment and follow-up. Ann Oncol 21(Suppl 5):v190-3. doi:10.​1093/​annonc/​mdq187 PubMed
Metadata
Title
Quality appraisal of clinical practice guidelines on glioma
Authors
Hongliang Tian
Yani Gou
Yawen Pan
Qiao Li
Dang Wei
Zhenwei Wang
Xiaodong Niu
Wentao Liang
Yinian Zhang
Publication date
01-01-2015
Publisher
Springer Berlin Heidelberg
Published in
Neurosurgical Review / Issue 1/2015
Print ISSN: 0344-5607
Electronic ISSN: 1437-2320
DOI
https://doi.org/10.1007/s10143-014-0569-z

Other articles of this Issue 1/2015

Neurosurgical Review 1/2015 Go to the issue

ACKNOWLEDGEMENT TO REFEREES

Referees 2014