Skip to main content
Top
Published in: Implementation Science 1/2008

Open Access 01-12-2008 | Research article

Production and quality of clinical practice guidelines in Argentina (1994–2004): a cross-sectional study

Authors: María Eugenia Esandi, Zulma Ortiz, Evelina Chapman, Marcelo García Dieguez, Raúl Mejía, Ricardo Bernztein

Published in: Implementation Science | Issue 1/2008

Login to get access

Abstract

Background

In the last decades, a sustained increment of Clinical Practice Guidelines (CPG) production in the world has been accompanied by a growing concern about their quality. Many studies related to quality assessment of guidelines produced in High Income Countries were published; however, evidence on this topic is scarce in Low and Middle Income Countries (LMIC). The objectives of this research were: a) to describe guideline production in Argentina at different levels of the health system (macro, meso and micro) from 1994 to 2004; and b) to assess their quality by using the AGREE instrument.

Methods

A cross-sectional study was undertaken to describe guidelines production in Argentina between 1994 and 2004. CPG were identified through Internet and electronic databases (MEDLINE and LILACS). Explicit inclusion and exclusion criteria were used to select guidelines. Each CPG was independently assessed by two reviewers using the AGREE instrument. Domain scores were calculated as recommended by the AGREE Collaboration. The internal consistency of each domain was evaluated using Cronbach's alpha and inter-observer agreement by the Intraclass Correlation Coefficient (ICC).

Results

A total amount of 431 potential CPG were identified, but only 144 were considered CPG. At the end, 101 CPG were included for further assessment. Median standardized score for each domain were: scope = 39%; stakeholder involvement = 13%; rigour of development = 10%; clarity = 42%; applicability = 6%; editorial independence = 0%. Only 22 CPG were recommended with modifications by both appraisers. ICC and Cronbach's alpha for each domain were in all cases moderate or high (greater than 0.40), except for editorial independence.

Conclusion

This study has systematically employed the AGREE instrument for the critical assessment of guidelines produced in a LMIC. Guideline development and diffusion in Argentina from 1994 to 2004 shows a constant increment, although quality of reporting did not improve; moreover, in some aspects it seemed to decline. Much room for improvement of the guideline development process was found at all levels of the health system.
Appendix
Available only for authorised users
Literature
1.
go back to reference Definitions of Key Terms. Clinical Practice Guidelines: Directions for a New Program. Edited by: Field MJ, Lohr L. 1990, Washington, DC: The National Academies Press, 33-51. 1 Definitions of Key Terms. Clinical Practice Guidelines: Directions for a New Program. Edited by: Field MJ, Lohr L. 1990, Washington, DC: The National Academies Press, 33-51. 1
2.
go back to reference Woolf SH, Grol R, Hutchinson A, Eccles M, Grimshaw J: Clinical guidelines: Potential benefits, limitations, and harms of clinical guidelines. BMJ. 1999, 318 (7182): 527-530.CrossRefPubMedPubMedCentral Woolf SH, Grol R, Hutchinson A, Eccles M, Grimshaw J: Clinical guidelines: Potential benefits, limitations, and harms of clinical guidelines. BMJ. 1999, 318 (7182): 527-530.CrossRefPubMedPubMedCentral
3.
go back to reference Burgers J, Grol R, Klazinga N, Makela M, Zaat J, for the AGREE Collaboration: Towards Evidence-Based Clinical Practices. An international survey of 18 clinical guideline programs. International Journal for Quality in Health Care. 2003, 15 (1): 31-45. 10.1093/intqhc/15.1.31.CrossRefPubMed Burgers J, Grol R, Klazinga N, Makela M, Zaat J, for the AGREE Collaboration: Towards Evidence-Based Clinical Practices. An international survey of 18 clinical guideline programs. International Journal for Quality in Health Care. 2003, 15 (1): 31-45. 10.1093/intqhc/15.1.31.CrossRefPubMed
6.
go back to reference Ollenschlager O, Marshall C, Qureshi S, Rosenbrand K, Burgers J, Makela M, Slutsky J, Board of Trustees 2002, Guidelines International Network (G-I-N): Improving the quality of health care: using international collaboration to inform guideline programmes by founding the Guidelines International Network (G-I-N). Qual Saf Health Care. 2004, 13 (6): 455-460. 10.1136/qshc.2003.009761.CrossRefPubMedPubMedCentral Ollenschlager O, Marshall C, Qureshi S, Rosenbrand K, Burgers J, Makela M, Slutsky J, Board of Trustees 2002, Guidelines International Network (G-I-N): Improving the quality of health care: using international collaboration to inform guideline programmes by founding the Guidelines International Network (G-I-N). Qual Saf Health Care. 2004, 13 (6): 455-460. 10.1136/qshc.2003.009761.CrossRefPubMedPubMedCentral
7.
go back to reference The AGREE Collaboration: Development and validation of an international appraisal instrument for assessing the quality of clinical practice guidelines: the AGREE project. Qual Saf Health Care. 2003, 12: 18-23. 10.1136/qhc.12.1.18.CrossRef The AGREE Collaboration: Development and validation of an international appraisal instrument for assessing the quality of clinical practice guidelines: the AGREE project. Qual Saf Health Care. 2003, 12: 18-23. 10.1136/qhc.12.1.18.CrossRef
8.
go back to reference Shaneyfelt T, Mayo-Smith M, Rothwangl J: Are Guidelines following guidelines? The methodological quality of Clinical Practice Guidelines in the peer-review medical literature. Jama. 1999, 285: 1900-1905. 10.1001/jama.281.20.1900.CrossRef Shaneyfelt T, Mayo-Smith M, Rothwangl J: Are Guidelines following guidelines? The methodological quality of Clinical Practice Guidelines in the peer-review medical literature. Jama. 1999, 285: 1900-1905. 10.1001/jama.281.20.1900.CrossRef
9.
go back to reference Cluzeau F, Littlejohns P, Grimshaw J, Feder G, Moran S: Development and application of a generic methodology to assess the quality of clinical guidelines. International Journal for Quality in Health Care. 1999, 11 (1): 21-28. 10.1093/intqhc/11.1.21.CrossRefPubMed Cluzeau F, Littlejohns P, Grimshaw J, Feder G, Moran S: Development and application of a generic methodology to assess the quality of clinical guidelines. International Journal for Quality in Health Care. 1999, 11 (1): 21-28. 10.1093/intqhc/11.1.21.CrossRefPubMed
10.
go back to reference Grilli R, Magrin N, Penna A, Mura G, Liberati A: Practice guidelines developed by specialty societies: the need for a critical appraisal. Lancet. 2000, 355: 103-106. 10.1016/S0140-6736(99)02171-6.CrossRefPubMed Grilli R, Magrin N, Penna A, Mura G, Liberati A: Practice guidelines developed by specialty societies: the need for a critical appraisal. Lancet. 2000, 355: 103-106. 10.1016/S0140-6736(99)02171-6.CrossRefPubMed
11.
go back to reference Graham I, Beardall S, Carter A, Glennie J, Hebert P, Tetroe J, McAlister F, Visentin S, Anderson G: What is the quality of drug therapy in Canada?. CMAJ. 2001, 165 (2): 157-163.PubMedPubMedCentral Graham I, Beardall S, Carter A, Glennie J, Hebert P, Tetroe J, McAlister F, Visentin S, Anderson G: What is the quality of drug therapy in Canada?. CMAJ. 2001, 165 (2): 157-163.PubMedPubMedCentral
12.
go back to reference Harpole L, Kelley MJ, Schreiber G, Toloza EM, Kolimaga J, McCrory DC: Assessment of the Scope and Quality of Clinical Practice Guidelines in Lung Cancer. CHEST. 2003, 123: 7S-20S. 10.1378/chest.123.1_suppl.7S.CrossRefPubMed Harpole L, Kelley MJ, Schreiber G, Toloza EM, Kolimaga J, McCrory DC: Assessment of the Scope and Quality of Clinical Practice Guidelines in Lung Cancer. CHEST. 2003, 123: 7S-20S. 10.1378/chest.123.1_suppl.7S.CrossRefPubMed
13.
go back to reference Navarro Puerto MA, Ruiz Romero F, Reyes Domínguez A, Gutiérrez Ibarlucea I, Hermosilla Gago T, Alonso Ortiz del Río C: ¿Las Guías que nos guían son fiables? Evaluación de las Guías de Práctica Clínica Españolas. Rev Clín Esp. 2005, 11: 533-40.CrossRef Navarro Puerto MA, Ruiz Romero F, Reyes Domínguez A, Gutiérrez Ibarlucea I, Hermosilla Gago T, Alonso Ortiz del Río C: ¿Las Guías que nos guían son fiables? Evaluación de las Guías de Práctica Clínica Españolas. Rev Clín Esp. 2005, 11: 533-40.CrossRef
14.
go back to reference MacDermid JC, Brooks D, Solway S, Switzer-McIntyre S, Brosseau L, Graham ID: Reliability and validity of the AGREE instrument used by physical therapists in assessment of clinical practice guidelines. BMC Health Services Research. 2005, 5: 5-18. 10.1186/1472-6963-5-18.CrossRef MacDermid JC, Brooks D, Solway S, Switzer-McIntyre S, Brosseau L, Graham ID: Reliability and validity of the AGREE instrument used by physical therapists in assessment of clinical practice guidelines. BMC Health Services Research. 2005, 5: 5-18. 10.1186/1472-6963-5-18.CrossRef
16.
go back to reference Rico Iturrioz R, Gutierrez-Ibarluzea I, Asua Batarrita J, Navarro Puerto MA, Reyes Domínguez A, Marín León I, Briones Pérez de la Blanca E: Valoración de escalas y criterios para la evaluación de Guías de Práctica Clínica. Rev Esp Salud Pública. 2004, 78: 457-467.CrossRefPubMed Rico Iturrioz R, Gutierrez-Ibarluzea I, Asua Batarrita J, Navarro Puerto MA, Reyes Domínguez A, Marín León I, Briones Pérez de la Blanca E: Valoración de escalas y criterios para la evaluación de Guías de Práctica Clínica. Rev Esp Salud Pública. 2004, 78: 457-467.CrossRefPubMed
17.
go back to reference Vlayen J, Aertgeerts B, Hannes K, Sermeus W, Ramaekers D: A systematic review of appraisal tools for clinical practice guidelines: multiple similarities and one common deficit. Int J Qual Health Care. 2005, 17 (3): 235-242. 10.1093/intqhc/mzi027.CrossRefPubMed Vlayen J, Aertgeerts B, Hannes K, Sermeus W, Ramaekers D: A systematic review of appraisal tools for clinical practice guidelines: multiple similarities and one common deficit. Int J Qual Health Care. 2005, 17 (3): 235-242. 10.1093/intqhc/mzi027.CrossRefPubMed
20.
go back to reference Institute of Medicine (IOM): Knowing what works in health care: A roadmap for the nation. 2008, Washington, DC: The National Academies Press Institute of Medicine (IOM): Knowing what works in health care: A roadmap for the nation. 2008, Washington, DC: The National Academies Press
22.
go back to reference Cook D, Greengold NL, Ellrodt G, Weingarten S: The Relation between Systematic Reviews and Practice Guidelines. Ann Intern Med. 1997, 127 (39): 210-216.CrossRefPubMed Cook D, Greengold NL, Ellrodt G, Weingarten S: The Relation between Systematic Reviews and Practice Guidelines. Ann Intern Med. 1997, 127 (39): 210-216.CrossRefPubMed
23.
go back to reference Varonen H, Jousimaa J, Helin-Salmivaara A, Kunnamo I: Electronic primary care guidelines with links to Cochrane reviews – EBM Guidelines. Family Practice. 2005, 22: 465-469. 10.1093/fampra/cmi029.CrossRefPubMed Varonen H, Jousimaa J, Helin-Salmivaara A, Kunnamo I: Electronic primary care guidelines with links to Cochrane reviews – EBM Guidelines. Family Practice. 2005, 22: 465-469. 10.1093/fampra/cmi029.CrossRefPubMed
24.
go back to reference Graham ID, Harrison MB, Brouwers M, Davies BL, Dunn S: Facilitating the Use of Evidence in Practice: Evaluating and Adapting Clinical Practice Guidelines for Local Use by Health Care Organizations. JOGNN. 2002, 31: 599-611.CrossRefPubMed Graham ID, Harrison MB, Brouwers M, Davies BL, Dunn S: Facilitating the Use of Evidence in Practice: Evaluating and Adapting Clinical Practice Guidelines for Local Use by Health Care Organizations. JOGNN. 2002, 31: 599-611.CrossRefPubMed
30.
go back to reference Burgers J: Guideline Quality and Guideline Content: Are They Related?. Clinical Chemistry. 2006, 52: 3-4. 10.1373/clinchem.2005.059345.CrossRefPubMed Burgers J: Guideline Quality and Guideline Content: Are They Related?. Clinical Chemistry. 2006, 52: 3-4. 10.1373/clinchem.2005.059345.CrossRefPubMed
Metadata
Title
Production and quality of clinical practice guidelines in Argentina (1994–2004): a cross-sectional study
Authors
María Eugenia Esandi
Zulma Ortiz
Evelina Chapman
Marcelo García Dieguez
Raúl Mejía
Ricardo Bernztein
Publication date
01-12-2008
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2008
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/1748-5908-3-43

Other articles of this Issue 1/2008

Implementation Science 1/2008 Go to the issue