Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2015

Open Access 01-12-2015 | Research article

Efficiency of pragmatic search strategies to update clinical guidelines recommendations

Authors: L. Martínez García, AJ. Sanabria, I. Araya, J. Lawson, I. Solà, RWM. Vernooij, D. López, E. García Álvarez, MM. Trujillo-Martín, I. Etxeandia-Ikobaltzeta, A. Kotzeva, D. Rigau, A. Louro-González, L. Barajas-Nava, P. Díaz del Campo, MD. Estrada, J. Gracia, F. Salcedo-Fernandez, RB. Haynes, P. Alonso-Coello, Updating Guidelines Working Group

Published in: BMC Medical Research Methodology | Issue 1/2015

Login to get access

Abstract

Background

A major challenge in updating clinical guidelines is to efficiently identify new, relevant evidence. We evaluated the efficiency and feasibility of two new approaches: the development of restrictive search strategies using PubMed Clinical Queries for MEDLINE and the use of the PLUS (McMaster Premium Literature Service) database.

Methods

We evaluated a random sample of recommendations from a national guideline development program and identified the references that would potentially trigger an update (key references) using an exhaustive approach.
We designed restrictive search strategies using the minimum number of Medical Subject Headings (MeSH) terms and text words required from the original exhaustive search strategies and applying broad and narrow filters. We developed PLUS search strategies, matching Medical Subject Headings (MeSH) and Systematized Nomenclature of Medicine (SNOMED) terms with guideline topics. We compared the number of key references retrieved by these approaches with those retrieved by the exhaustive approach.

Results

The restrictive approach retrieved 68.1 % fewer references than the exhaustive approach (12,486 versus 39,136), and identified 89.9 % (62/69) of key references and 88 % (22/25) of recommendation updates. The use of PLUS retrieved 88.5 % fewer references than the exhaustive approach (4,486 versus 39,136) and identified substantially fewer key references (18/69, 26.1 %) and fewer recommendation updates (10/25, 40 %).

Conclusions

The proposed restrictive approach is a highly efficient and feasible method to identify new evidence that triggers a recommendation update. Searching only in the PLUS database proved to be a suboptimal approach and suggests the need for topic-specific tailoring.
Appendix
Available only for authorised users
Literature
1.
go back to reference Martínez García L, Sanabria AJ, García Alvarez E, Trujillo-Martín MM, Etxeandia-Ikobaltzeta I, Kotzeva A, et al. The validity of recommendations from clinical guidelines: a survival analysis. CMAJ. 2014;186(16):1211–9.CrossRefPubMed Martínez García L, Sanabria AJ, García Alvarez E, Trujillo-Martín MM, Etxeandia-Ikobaltzeta I, Kotzeva A, et al. The validity of recommendations from clinical guidelines: a survival analysis. CMAJ. 2014;186(16):1211–9.CrossRefPubMed
2.
go back to reference Alderson LJ, Alderson P, Tan T. Median life span of a cohort of national institute for health and care excellence clinical guidelines was about 60 months. J Clin Epidemiol. 2014;67(1):52–5.CrossRefPubMed Alderson LJ, Alderson P, Tan T. Median life span of a cohort of national institute for health and care excellence clinical guidelines was about 60 months. J Clin Epidemiol. 2014;67(1):52–5.CrossRefPubMed
3.
go back to reference Shojania KG, Sampson M, Ansari MT, Ji J, Doucette S, Moher D. How quickly do systematic reviews go out of date? A survival analysis. Ann Intern Med. 2007;147(4):224–33.CrossRefPubMed Shojania KG, Sampson M, Ansari MT, Ji J, Doucette S, Moher D. How quickly do systematic reviews go out of date? A survival analysis. Ann Intern Med. 2007;147(4):224–33.CrossRefPubMed
4.
go back to reference Banzi R, Cinquini M, Liberati A, Moschetti I, Pecoraro V, Tagliabue L, et al. Speed of updating online evidence based point of care summaries: prospective cohort analysis. BMJ. 2011;343:d5856.CrossRefPubMedPubMedCentral Banzi R, Cinquini M, Liberati A, Moschetti I, Pecoraro V, Tagliabue L, et al. Speed of updating online evidence based point of care summaries: prospective cohort analysis. BMJ. 2011;343:d5856.CrossRefPubMedPubMedCentral
5.
go back to reference Vernooij RW, Sanabria AJ, Solà I, Alonso-Coello P, Martínez García L. Guidance for updating clinical practice guidelines: a systematic review of methodological handbooks. Implement Sci. 2014;9:3.CrossRefPubMedPubMedCentral Vernooij RW, Sanabria AJ, Solà I, Alonso-Coello P, Martínez García L. Guidance for updating clinical practice guidelines: a systematic review of methodological handbooks. Implement Sci. 2014;9:3.CrossRefPubMedPubMedCentral
6.
go back to reference Becker M, Neugebauer EA, Eikermann M. Partial updating of clinical practice guidelines often makes more sense than full updating: a systematic review on methods and the development of an updating procedure. J Clin Epidemiol. 2014;67(1):33–45.CrossRefPubMed Becker M, Neugebauer EA, Eikermann M. Partial updating of clinical practice guidelines often makes more sense than full updating: a systematic review on methods and the development of an updating procedure. J Clin Epidemiol. 2014;67(1):33–45.CrossRefPubMed
7.
go back to reference Martínez García L, Arévalo-Rodríguez I, Solà I, Haynes RB, Vandvik PO, Alonso-Coello P, et al. Strategies for monitoring and updating clinical practice guidelines: a systematic review. Implement Sci. 2012;7:109.CrossRefPubMedPubMedCentral Martínez García L, Arévalo-Rodríguez I, Solà I, Haynes RB, Vandvik PO, Alonso-Coello P, et al. Strategies for monitoring and updating clinical practice guidelines: a systematic review. Implement Sci. 2012;7:109.CrossRefPubMedPubMedCentral
8.
go back to reference Shekelle PG, Ortiz E, Rhodes S, Morton SC, Eccles MP, Grimshaw JM, et al. Validity of the agency for healthcare research and quality clinical practice guidelines: how quickly do guidelines become outdated? JAMA. 2001;286(12):1461–7.CrossRefPubMed Shekelle PG, Ortiz E, Rhodes S, Morton SC, Eccles MP, Grimshaw JM, et al. Validity of the agency for healthcare research and quality clinical practice guidelines: how quickly do guidelines become outdated? JAMA. 2001;286(12):1461–7.CrossRefPubMed
9.
go back to reference Gartlehner G, West SL, Lohr KN, Kahwati L, Johnson JG, Harris RP, et al. Assessing the need to update prevention guidelines: a comparison of two methods. Int J Qual Health Care. 2004;16(5):399–406.CrossRefPubMed Gartlehner G, West SL, Lohr KN, Kahwati L, Johnson JG, Harris RP, et al. Assessing the need to update prevention guidelines: a comparison of two methods. Int J Qual Health Care. 2004;16(5):399–406.CrossRefPubMed
10.
go back to reference Gartlehner G, West SL, Lohr KN, Kahwati L, Johnson JG, Harris RP, et al. Surveillance search techniques identified the need to update systematic reviews. J Clin Epidemiol. 2008;61(8):755–62.CrossRef Gartlehner G, West SL, Lohr KN, Kahwati L, Johnson JG, Harris RP, et al. Surveillance search techniques identified the need to update systematic reviews. J Clin Epidemiol. 2008;61(8):755–62.CrossRef
11.
go back to reference Hemens BJ, Haynes RB. McMaster Premium Literature Service (PLUS) performed well for identifying new studies for updated cochrane reviews. J Clin Epidemiol. 2012;65(1):62–72. e1.CrossRefPubMed Hemens BJ, Haynes RB. McMaster Premium Literature Service (PLUS) performed well for identifying new studies for updated cochrane reviews. J Clin Epidemiol. 2012;65(1):62–72. e1.CrossRefPubMed
12.
go back to reference Sagliocca L, De Masi S, Ferrigno L, Mele A, Traversa G. A pragmatic strategy for the review of clinical evidence. J Eval Clin Pract. 2013;19(4):689–96.CrossRefPubMed Sagliocca L, De Masi S, Ferrigno L, Mele A, Traversa G. A pragmatic strategy for the review of clinical evidence. J Eval Clin Pract. 2013;19(4):689–96.CrossRefPubMed
13.
14.
go back to reference Haynes RB, Cotoi C, Holland J, Walters L, Wilczynski N, Jedraszewski D, et al. Second-order peer review of the medical literature for clinical practitioners. JAMA. 2006;295(15):1801–8.CrossRefPubMed Haynes RB, Cotoi C, Holland J, Walters L, Wilczynski N, Jedraszewski D, et al. Second-order peer review of the medical literature for clinical practitioners. JAMA. 2006;295(15):1801–8.CrossRefPubMed
15.
go back to reference Holland J, Haynes RB, McMaster PLUS, Team Health Information Research Unit. McMaster Premium Literature Service (PLUS): an evidence-based medicine information service delivered on the Web. AMIA Annu Symp Proc. 2005;340:4. Holland J, Haynes RB, McMaster PLUS, Team Health Information Research Unit. McMaster Premium Literature Service (PLUS): an evidence-based medicine information service delivered on the Web. AMIA Annu Symp Proc. 2005;340:4.
16.
go back to reference Martínez García L, Sanabria AJ, Araya I, Lawson J, Haynes RB, Rigau D, et al. Strategies to assess the validity of recommendations: a study protocol. Implement Sci. 2013;8(1):94.CrossRefPubMedPubMedCentral Martínez García L, Sanabria AJ, Araya I, Lawson J, Haynes RB, Rigau D, et al. Strategies to assess the validity of recommendations: a study protocol. Implement Sci. 2013;8(1):94.CrossRefPubMedPubMedCentral
17.
go back to reference Montori VM, Wilczynski NL, Morgan D, Haynes RB, Hedges Team. Optimal search strategies for retrieving systematic reviews from Medline: analytical survey. BMJ. 2005;330(7482):68.CrossRefPubMedPubMedCentral Montori VM, Wilczynski NL, Morgan D, Haynes RB, Hedges Team. Optimal search strategies for retrieving systematic reviews from Medline: analytical survey. BMJ. 2005;330(7482):68.CrossRefPubMedPubMedCentral
19.
go back to reference Working Group on the Management of Major Depression in Adults. Clinical practice guideline on the management of major depression in adults, National plan for the SHN of the MHCA. Axencia de avaliación de tecnoloxías sanitarias de Galicia (avalia-t). Madrid: Clinical Practice Guidelines in the Spanish SHN: avalia-t No 2006/06; 2008. Working Group on the Management of Major Depression in Adults. Clinical practice guideline on the management of major depression in adults, National plan for the SHN of the MHCA. Axencia de avaliación de tecnoloxías sanitarias de Galicia (avalia-t). Madrid: Clinical Practice Guidelines in the Spanish SHN: avalia-t No 2006/06; 2008.
20.
go back to reference Working Group of the Guideline for the Prevention and Treatment of Childhood and Juvenile Obesity. Iberoamerican Cochrane Centre, coordinator; Clinical Practice Guideline for the Prevention and Treatment of Childhood and Juvenile Obesity; CPGs: Quality Plan for the Spanish National Healthcare System of the Spanish Ministry for Health and Social Policy; Catalan Agency for Health Technology Assessment; 2009. Clinical Practice Guideline: CAHTA no. 2007/25 Working Group of the Guideline for the Prevention and Treatment of Childhood and Juvenile Obesity. Iberoamerican Cochrane Centre, coordinator; Clinical Practice Guideline for the Prevention and Treatment of Childhood and Juvenile Obesity; CPGs: Quality Plan for the Spanish National Healthcare System of the Spanish Ministry for Health and Social Policy; Catalan Agency for Health Technology Assessment; 2009. Clinical Practice Guideline: CAHTA no. 2007/25
21.
go back to reference Working group of the Clinical Practice Guideline on Prostate Cancer Treatment. Clinical practice guidelines on prostate cancer treatment, National plan for the NHS of the MSC. Aragon institute of health sciences (I + CS). Madrid: Clinical Practice Guidelines in the NHS I + CS No 2006/02; 2008. Working group of the Clinical Practice Guideline on Prostate Cancer Treatment. Clinical practice guidelines on prostate cancer treatment, National plan for the NHS of the MSC. Aragon institute of health sciences (I + CS). Madrid: Clinical Practice Guidelines in the NHS I + CS No 2006/02; 2008.
22.
go back to reference Development group of the stroke prevention Guideline. Quality plan for the national health system of the ministry of health and consumer affairs; Catalan agency for health technology assessment and research. Madrid: Clinical Practice Guideline: AATRM Number 2006/15; 2008. Development group of the stroke prevention Guideline. Quality plan for the national health system of the ministry of health and consumer affairs; Catalan agency for health technology assessment and research. Madrid: Clinical Practice Guideline: AATRM Number 2006/15; 2008.
23.
go back to reference Lyratzopoulos G, Barnes S, Stegenga H, Peden S, Campbell B. Updating clinical practice recommendations: is it worthwhile and when? Int J Technol Assess Health Care. 2012;28(1):29–35.CrossRefPubMed Lyratzopoulos G, Barnes S, Stegenga H, Peden S, Campbell B. Updating clinical practice recommendations: is it worthwhile and when? Int J Technol Assess Health Care. 2012;28(1):29–35.CrossRefPubMed
24.
go back to reference Sampson M, McGowan J, Cogo E, Grimshaw J, Moher D, Lefebvre C. An evidence-based practice guideline for the peer review of electronic search strategies. J Clin Epidemiol. 2009;62(9):944–52.CrossRefPubMed Sampson M, McGowan J, Cogo E, Grimshaw J, Moher D, Lefebvre C. An evidence-based practice guideline for the peer review of electronic search strategies. J Clin Epidemiol. 2009;62(9):944–52.CrossRefPubMed
Metadata
Title
Efficiency of pragmatic search strategies to update clinical guidelines recommendations
Authors
L. Martínez García
AJ. Sanabria
I. Araya
J. Lawson
I. Solà
RWM. Vernooij
D. López
E. García Álvarez
MM. Trujillo-Martín
I. Etxeandia-Ikobaltzeta
A. Kotzeva
D. Rigau
A. Louro-González
L. Barajas-Nava
P. Díaz del Campo
MD. Estrada
J. Gracia
F. Salcedo-Fernandez
RB. Haynes
P. Alonso-Coello
Updating Guidelines Working Group
Publication date
01-12-2015
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2015
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-015-0058-2

Other articles of this Issue 1/2015

BMC Medical Research Methodology 1/2015 Go to the issue