Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2019

Open Access 01-12-2019 | Research article

Insufficient uptake of systematic search methods in oncological clinical practice guideline: a systematic review

Authors: Chiara Trevisiol, Michela Cinquini, Aline S. C. Fabricio, Massimo Gion, Anne W. S. Rutjes

Published in: BMC Medical Research Methodology | Issue 1/2019

Login to get access

Abstract

Background

The use of systematic review methods are widely recognized to be essential in the development of recommendations in clinical practice guidelines to prove their trustworthiness. The objective of this study was to assess the use of systematic search methods by authors of guidelines published in the oncology field.

Methods

We analyzed 590 guidance documents identified in PubMed, NGC, GIN and web sites for guidelines in 2009–2015 in oncology. The main outcome measure used was incidence of guidance documents supported by a systematic search of the literature. In addition to descriptive analyses, logistic regression was used to evaluate if adequate search methods were explained by guideline characteristics.

Results

Of 590 guidance documents included in the study, 305 (51.7%) declared the use of systematic search methods but only 168 (28.5%) applied methods meeting minimum standards for quality and provided sufficient details to allow classification. 164 (27.8%) guidance documents did not report any use of literature evaluation.
Guidance documents produced by a Government Agency in North America (OR 2.16, 95% CI 1.16–4.17) and those with a focused scope (OR 2.35, 95% CI 0.97–5.56) were positively associated with the use of systematic search methods. We found no association between the year of publication and use of systematic search methods.

Conclusions

A relatively small number of guidance documents was informed by scientific evidence identified through adequate systematic search methods. We observed substantial room for improvement of applied methods and reporting, especially in documents with a broad focus, or those produced by professional societies or independent expert panels in other continents than North America.
Appendix
Available only for authorised users
Literature
1.
go back to reference Graham R, Mancher M, Miller Wolman D, et al. Clinical practice guidelines we can trust. Washington: National Academies Press; 2011. Graham R, Mancher M, Miller Wolman D, et al. Clinical practice guidelines we can trust. Washington: National Academies Press; 2011.
2.
go back to reference JPT H, Green S, editors. Cochrane Handbook for Systematic Reviews of Interventions: The Cochrane Collaboration; 2011. Available from http://handbook.cochrane.org. Accessed 23 Nov 2018. (Version 5.1.0) [updated March 2011] JPT H, Green S, editors. Cochrane Handbook for Systematic Reviews of Interventions: The Cochrane Collaboration; 2011. Available from http://​handbook.​cochrane.​org. Accessed 23 Nov 2018. (Version 5.1.0) [updated March 2011]
3.
go back to reference Antman EM, Lau J, Kupelnick B, et al. A comparison of results of meta-analyses of randomized control trials and recommendations of clinical experts. Treatments for myocardial infarction. JAMA. 1992;268:240–8.CrossRef Antman EM, Lau J, Kupelnick B, et al. A comparison of results of meta-analyses of randomized control trials and recommendations of clinical experts. Treatments for myocardial infarction. JAMA. 1992;268:240–8.CrossRef
4.
go back to reference Oxman AD, Guyatt GH. The science of reviewing research. Ann N Y Acad Sci. 1993;703:125–33 discussion 33-4.CrossRef Oxman AD, Guyatt GH. The science of reviewing research. Ann N Y Acad Sci. 1993;703:125–33 discussion 33-4.CrossRef
6.
go back to reference Woolf SH, Grol R, Hutchinson A, Eccles M, Grimshaw J. Clinical guidelines: potential benefits, limitations, and harms of clinical guidelines. BMJ. 1999;318:527–30.CrossRef Woolf SH, Grol R, Hutchinson A, Eccles M, Grimshaw J. Clinical guidelines: potential benefits, limitations, and harms of clinical guidelines. BMJ. 1999;318:527–30.CrossRef
19.
go back to reference Oxman AD, Guyatt GH. Guidelines for reading literature reviews. Can Med Assoc J. 1988;138:697–703. Oxman AD, Guyatt GH. Guidelines for reading literature reviews. Can Med Assoc J. 1988;138:697–703.
20.
go back to reference Jadad AR, Enkin MW. From individual trials to groups of trials: reviews, meta-analyses, and guidelines. In: Jadad AR, Enkin MW, editors. Randomized controlled trials: questions, answers and musings. London: BMJ Books; 2007.CrossRef Jadad AR, Enkin MW. From individual trials to groups of trials: reviews, meta-analyses, and guidelines. In: Jadad AR, Enkin MW, editors. Randomized controlled trials: questions, answers and musings. London: BMJ Books; 2007.CrossRef
21.
go back to reference National Collaborating Centre for Mental Health. Eating Disorders. Core interventions in the treatment and Management of Anorexia Nervosa, bulimia nervosa and related eating disorders. (NICE clinical guidelines 9). Leicester: British Psychological Society; 2004. Available from https://www.ncbi.nlm.nih.gov/books/NBK49325/. Accessed 10 May 2019 National Collaborating Centre for Mental Health. Eating Disorders. Core interventions in the treatment and Management of Anorexia Nervosa, bulimia nervosa and related eating disorders. (NICE clinical guidelines 9). Leicester: British Psychological Society; 2004. Available from https://​www.​ncbi.​nlm.​nih.​gov/​books/​NBK49325/​. Accessed 10 May 2019
23.
go back to reference National Institute for Health and Clinical Excellence. The diagnosis and treatment of lung cancer (update). (Clinical guideline 121). London: National Institute for Health and Care Excellence; 2011. Available from http://www.nice.org.uk/guidance/ng122. Accessed 23 November 2018 National Institute for Health and Clinical Excellence. The diagnosis and treatment of lung cancer (update). (Clinical guideline 121). London: National Institute for Health and Care Excellence; 2011. Available from http://​www.​nice.​org.​uk/​guidance/​ng122. Accessed 23 November 2018
25.
go back to reference American College of Chest Physicians, editor. Diagnosis and management of lung cancer, 3rd ed: American College of Chest Physicians evidence-based clinical practice guidelines. Chest. 2013;143(Suppl 5):1–50, e1-e512. https://doi.org/10.1378/chest. American College of Chest Physicians, editor. Diagnosis and management of lung cancer, 3rd ed: American College of Chest Physicians evidence-based clinical practice guidelines. Chest. 2013;143(Suppl 5):1–50, e1-e512. https://​doi.​org/​10.​1378/​chest.
Metadata
Title
Insufficient uptake of systematic search methods in oncological clinical practice guideline: a systematic review
Authors
Chiara Trevisiol
Michela Cinquini
Aline S. C. Fabricio
Massimo Gion
Anne W. S. Rutjes
Publication date
01-12-2019
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2019
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-019-0818-5

Other articles of this Issue 1/2019

BMC Medical Research Methodology 1/2019 Go to the issue