Skip to main content
Top
Published in: Implementation Science 1/2018

Open Access 01-12-2018 | Methodology

Standardising evidence strength grading for recommendations from multiple clinical practice guidelines: a South African case study

Authors: K. Grimmer, Q. Louw, J. M. Dizon, S-M van Niekerk, D. Ernstzen, C. Wiysonge

Published in: Implementation Science | Issue 1/2018

Login to get access

Abstract

Background

Significant resources are required to write de novo clinical practice guidelines (CPGs). There are many freely-available CPGs internationally, for many health conditions. Developing countries rarely have the resources for de novo CPGs, and there could be efficiencies in using CPGs developed elsewhere. This paper outlines a novel process developed and tested in a resource-constrained country (South Africa) to synthesise findings from multiple international CPGs on allied health (AH) stroke rehabilitation.

Methods

Methodologists, policy-makers, content experts and consumers collaborated to describe the pathway of an ‘average’ stroke patient through the South African public healthcare system and pose questions about best-practice stroke rehabilitation along this pathway. A comprehensive search identified international guidance documents published since January 2010. These were scanned for relevance to the South African AH stroke rehabilitation questions and critically appraised for methodological quality. Recommendations were extracted from guidance documents for each question. Strength of the body of evidence (SoBE) gradings underpinning recommendations were standardised, and composite recommendations were developed using qualitative synthesis. An algorithm was developed to guide assignment of overall SoBE gradings to composite recommendations.

Results

Sixteen CPGs were identified, and all were included, as they answered different project questions differently. Methodological quality varied and was unrelated to currency. Seven clusters, outlining 20 composite recommendations were proposed (organise for best practice rehabilitation, operationalise strategies for best practice communication throughout the patient journey, admit to an acute hospital, refer to inpatient rehabilitation, action inpatient rehabilitation, discharge from inpatient rehabilitation and longer-term community-based rehabilitation).

Conclusion

The methodological development process, tested by writing a South African AH stroke rehabilitation guideline from existing evidence sources, took 9 months. The process was efficient, collaborative, effective, rewarding and positive. Using the proposed methods, similar synthesis of existing evidence could be conducted in shorter time periods, in other resource-constrained countries, avoiding the need for expensive and time-consuming de novo CPG development.
Appendix
Available only for authorised users
Literature
1.
go back to reference Coovadia H, Jewkes R, Barron P, Sanders D, McIntyre D. The health and health system of South Africa: historical roots of current public health challenges. Lancet. 2009;374(9692):817–34.CrossRefPubMed Coovadia H, Jewkes R, Barron P, Sanders D, McIntyre D. The health and health system of South Africa: historical roots of current public health challenges. Lancet. 2009;374(9692):817–34.CrossRefPubMed
2.
go back to reference Mash B, Fairall L, Adejayan O, Ikpefan O, Kumari J, Mathee S, Yogolelo W. A morbidity survey of south African primary care. PLoS One. 2012;7(3):e32358.CrossRefPubMedPubMedCentral Mash B, Fairall L, Adejayan O, Ikpefan O, Kumari J, Mathee S, Yogolelo W. A morbidity survey of south African primary care. PLoS One. 2012;7(3):e32358.CrossRefPubMedPubMedCentral
3.
go back to reference WHO. Global Disability Action Plan 2014–2021: Better health for all people with disability. Geneva: World Health Organization; 2015. WHO. Global Disability Action Plan 2014–2021: Better health for all people with disability. Geneva: World Health Organization; 2015.
4.
go back to reference Sharma R. Breakout nations: in pursuit of the Next Economic Miracles. New York: WW Norton & Company; 2012. Sharma R. Breakout nations: in pursuit of the Next Economic Miracles. New York: WW Norton & Company; 2012.
6.
go back to reference Spencer LM, Schooley MW, Anderson LA, Kochtitzky CS, DeGroff AS, Devlin HM, Mercer SL. Seeking best practices: a conceptual framework for planning and improving evidence-based practices. Prev Chronic Dis. 2013;10:130186.CrossRef Spencer LM, Schooley MW, Anderson LA, Kochtitzky CS, DeGroff AS, Devlin HM, Mercer SL. Seeking best practices: a conceptual framework for planning and improving evidence-based practices. Prev Chronic Dis. 2013;10:130186.CrossRef
7.
go back to reference Weng Y-H, Kuo KN, Yang C-Y, Lo H-L, Chen C, Chiu Y-W. Implementation of evidence-based practice across medical, nursing, pharmacological and allied healthcare professionals: a questionnaire survey in nationwide hospital settings. Implement Sci. 2013;8:112.CrossRefPubMedPubMedCentral Weng Y-H, Kuo KN, Yang C-Y, Lo H-L, Chen C, Chiu Y-W. Implementation of evidence-based practice across medical, nursing, pharmacological and allied healthcare professionals: a questionnaire survey in nationwide hospital settings. Implement Sci. 2013;8:112.CrossRefPubMedPubMedCentral
8.
go back to reference Abrahamson K, Fox R, Doebbeling B. Facilitators and barriers to clinical practice guideline use among nurses. Am J Nurs. 2012;112(7):26–35.CrossRefPubMed Abrahamson K, Fox R, Doebbeling B. Facilitators and barriers to clinical practice guideline use among nurses. Am J Nurs. 2012;112(7):26–35.CrossRefPubMed
9.
go back to reference Ploeg J, Davies B, Edwards N, Gifford W, Miller PE. Factors influencing best-practice guideline implementation: lessons learned from administrators, nursing staff, and project leaders. Worldviews Evid Based Nurs. 2007;4:210–9.CrossRefPubMed Ploeg J, Davies B, Edwards N, Gifford W, Miller PE. Factors influencing best-practice guideline implementation: lessons learned from administrators, nursing staff, and project leaders. Worldviews Evid Based Nurs. 2007;4:210–9.CrossRefPubMed
10.
go back to reference Orem JN, Mafigiri DK, Marchal B, Ssengooba F, Macq J, Criel B. Research, evidence and policymaking: the perspectives of policy actors on improving uptake of evidence in health policy development and implementation in Uganda. BMC Public Health. 2012;12:109.CrossRefPubMedPubMedCentral Orem JN, Mafigiri DK, Marchal B, Ssengooba F, Macq J, Criel B. Research, evidence and policymaking: the perspectives of policy actors on improving uptake of evidence in health policy development and implementation in Uganda. BMC Public Health. 2012;12:109.CrossRefPubMedPubMedCentral
11.
go back to reference Goyet S, Touch S, Ir P, Saman S, Fassier T, Frutos R, Tarantola A, Barennes H. Gaps between research and public health priorities in low income countries: evidence from a systematic literature review focused on Cambodia. Implement Sci. 2015;10:32.CrossRefPubMedPubMedCentral Goyet S, Touch S, Ir P, Saman S, Fassier T, Frutos R, Tarantola A, Barennes H. Gaps between research and public health priorities in low income countries: evidence from a systematic literature review focused on Cambodia. Implement Sci. 2015;10:32.CrossRefPubMedPubMedCentral
13.
go back to reference Dizon J, Grimmer K, Louw Q, Machingaidze S, Parker H, Pillen H. South African allied health clinical practice guidelines: barriers and facilitators. Health Res Policy Systems. 2017;15(1):79.CrossRef Dizon J, Grimmer K, Louw Q, Machingaidze S, Parker H, Pillen H. South African allied health clinical practice guidelines: barriers and facilitators. Health Res Policy Systems. 2017;15(1):79.CrossRef
17.
go back to reference Yaolong C, Yang K, Marušić A, Qaseem A, Meerpohl JJ, Flottorp S, Akl EA, Schünemann HJ, ESY C, Falck-Ytter Y, Ahmed F, Barber S, Chen C, Zhang M, Xu B, Tian J, Song F, Shang H, Tang K, Wang Q, Norris SL, for the RIGHT (Reporting Items for Practice Guidelines in Healthcare) Working Group. A reporting tool for practice guidelines in health care: the RIGHT Statement. Ann Intern Med. 2017;166:128–32. https://doi.org/10.7326/M16-1565.CrossRef Yaolong C, Yang K, Marušić A, Qaseem A, Meerpohl JJ, Flottorp S, Akl EA, Schünemann HJ, ESY C, Falck-Ytter Y, Ahmed F, Barber S, Chen C, Zhang M, Xu B, Tian J, Song F, Shang H, Tang K, Wang Q, Norris SL, for the RIGHT (Reporting Items for Practice Guidelines in Healthcare) Working Group. A reporting tool for practice guidelines in health care: the RIGHT Statement. Ann Intern Med. 2017;166:128–32. https://​doi.​org/​10.​7326/​M16-1565.CrossRef
19.
go back to reference Kumar S, Young A, Lizarondo LM. What’s in a name? Current case of nomenclature confusion. In: Grimmer-Somers K, Worley A, editors. Practical tips for using and developing guidelines. Manila: UST Publishing House; 2010. ISBN 978-971-506-559-7. Kumar S, Young A, Lizarondo LM. What’s in a name? Current case of nomenclature confusion. In: Grimmer-Somers K, Worley A, editors. Practical tips for using and developing guidelines. Manila: UST Publishing House; 2010. ISBN 978-971-506-559-7.
20.
go back to reference Machingaidze S, Grimmer K, Louw Q, Kredo T, Volmink J, Young T. Next generation clinical guidance for primary care in South Africa – credible, consistent and reliable. PLOS One. 2017; in press Machingaidze S, Grimmer K, Louw Q, Kredo T, Volmink J, Young T. Next generation clinical guidance for primary care in South Africa – credible, consistent and reliable. PLOS One. 2017; in press
22.
go back to reference AGREE Collaboration. Development and validation of an international appraisal instrument for assessing the quality of clinical practice guidelines: the AGREE project. Qual Saf Health Care. 2003;12:18–23.CrossRef AGREE Collaboration. Development and validation of an international appraisal instrument for assessing the quality of clinical practice guidelines: the AGREE project. Qual Saf Health Care. 2003;12:18–23.CrossRef
23.
go back to reference Brouwers M, Kho ME, Browman GP, Burgers JS, Cluzeau F, et al. AGREE II: advancing guideline development, reporting and evaluation in healthcare. Prev Med. 2010;51(5):421–4.CrossRefPubMed Brouwers M, Kho ME, Browman GP, Burgers JS, Cluzeau F, et al. AGREE II: advancing guideline development, reporting and evaluation in healthcare. Prev Med. 2010;51(5):421–4.CrossRefPubMed
24.
go back to reference Gonzalez-Suarez C, Grimmer-Somers K, Dizon J, King E, Lorenzo S, Valdecanas C, Fidel B. Contextualising western guidelines for stroke and low back pain to a developing country (Philippines): an innovative approach to putting evidence into practice efficiently. J Healthcare Leadership. 2012;4:141–56.CrossRef Gonzalez-Suarez C, Grimmer-Somers K, Dizon J, King E, Lorenzo S, Valdecanas C, Fidel B. Contextualising western guidelines for stroke and low back pain to a developing country (Philippines): an innovative approach to putting evidence into practice efficiently. J Healthcare Leadership. 2012;4:141–56.CrossRef
26.
go back to reference Schünemann HJ, Wiercioch W, Etxeandia I, et al. Guidelines 2.0: systematic development of a comprehensive checklist for a successful guideline enterprise. CAMJ. 2014;186(3):E123–42. Schünemann HJ, Wiercioch W, Etxeandia I, et al. Guidelines 2.0: systematic development of a comprehensive checklist for a successful guideline enterprise. CAMJ. 2014;186(3):E123–42.
27.
go back to reference Berkman ND, Lohr KN, Ansari MT, Balk EM, Kane R, McDonagh M, Morton SC, Viswanathan M, Bass EB, Butler M, Gartlehner G, Hartling L, McPheeters M, Morgan LC, Reston J, Sista P, Whitlock E, Chang S. Grading the strength of a body of evidence when assessing health care interventions: an EPC update. J Clin Epidemiol. 2015;68(11):1312–24. https://doi.org/10.1016/j.jclinepi.2014.11.023. Epub 2014 Dec 20CrossRefPubMed Berkman ND, Lohr KN, Ansari MT, Balk EM, Kane R, McDonagh M, Morton SC, Viswanathan M, Bass EB, Butler M, Gartlehner G, Hartling L, McPheeters M, Morgan LC, Reston J, Sista P, Whitlock E, Chang S. Grading the strength of a body of evidence when assessing health care interventions: an EPC update. J Clin Epidemiol. 2015;68(11):1312–24. https://​doi.​org/​10.​1016/​j.​jclinepi.​2014.​11.​023. Epub 2014 Dec 20CrossRefPubMed
30.
go back to reference Schutz A. The phenomenology of the social world (Walsh G., Lehnert F., trans.). Evanston: North Western University Press; 1967. (Original German work published 1932) Schutz A. The phenomenology of the social world (Walsh G., Lehnert F., trans.). Evanston: North Western University Press; 1967. (Original German work published 1932)
31.
go back to reference Patton MQ. Qualitative research and evaluation methods. 3rd ed. Thousand Oaks: Sage Publications; 2002. Patton MQ. Qualitative research and evaluation methods. 3rd ed. Thousand Oaks: Sage Publications; 2002.
32.
go back to reference Fereday J, Muir-Cochrane E. Demonstrating rigor using thematic analysis: a hybrid approach of inductive and deductive coding and theme development. Int J Qual Methods. 2006;5(1):80.CrossRef Fereday J, Muir-Cochrane E. Demonstrating rigor using thematic analysis: a hybrid approach of inductive and deductive coding and theme development. Int J Qual Methods. 2006;5(1):80.CrossRef
33.
go back to reference Horsfall D, Byrne-Armstrong H, Higgs J. Researching critical moments. In: Byrne-Armstrong H, Higgs J, Horsfall D, editors. Critical moments in qualitative research. Oxford: Butterworth Heinemann; 2001. p. 3–16. Horsfall D, Byrne-Armstrong H, Higgs J. Researching critical moments. In: Byrne-Armstrong H, Higgs J, Horsfall D, editors. Critical moments in qualitative research. Oxford: Butterworth Heinemann; 2001. p. 3–16.
35.
go back to reference Guyatt GH, Oxman AD, Kunz R, Falck-Ytter Y, Vist GE, Liberati A, Schünemann HJ. GRADE: going from evidence to recommendations. BMJ. 2008a;336:1049–51.CrossRefPubMedPubMedCentral Guyatt GH, Oxman AD, Kunz R, Falck-Ytter Y, Vist GE, Liberati A, Schünemann HJ. GRADE: going from evidence to recommendations. BMJ. 2008a;336:1049–51.CrossRefPubMedPubMedCentral
36.
go back to reference Guyatt GH, Oxman AD, Vist GE, Kunz R, Falck-Ytter Y, Schünemann HJ. GRADE: what is “quality of evidence” and why is it important to clinicians? BMJ. 2008b;336:995–8.CrossRefPubMedPubMedCentral Guyatt GH, Oxman AD, Vist GE, Kunz R, Falck-Ytter Y, Schünemann HJ. GRADE: what is “quality of evidence” and why is it important to clinicians? BMJ. 2008b;336:995–8.CrossRefPubMedPubMedCentral
37.
go back to reference Winstein CJ, Stein J, Arena R, Bates B, Cherney LR, Cramer SC, Deruyter F et al on behalf of the American Heart Association stroke council, council on cardiovascular and stroke nursing, council on clinical cardiology, and council on quality of care and outcomes research (AHA/ ASA CPG). Stroke 2016;47:31–371. DOI: https://doi.org/10.1161/STR.0000000000000098. Winstein CJ, Stein J, Arena R, Bates B, Cherney LR, Cramer SC, Deruyter F et al on behalf of the American Heart Association stroke council, council on cardiovascular and stroke nursing, council on clinical cardiology, and council on quality of care and outcomes research (AHA/ ASA CPG). Stroke 2016;47:31–371. DOI: https://​doi.​org/​10.​1161/​STR.​0000000000000098​.
40.
go back to reference Australian Commission on Safety and Quality in Health Care (ACSQHC) Stroke CPG. Evidence Sources: Acute Stroke Clinical Care Standard. Sydney: ACSQHC; 2015. ISBN 978–1–925224-16-0. Australian Commission on Safety and Quality in Health Care (ACSQHC) Stroke CPG. Evidence Sources: Acute Stroke Clinical Care Standard. Sydney: ACSQHC; 2015. ISBN 978–1–925224-16-0.
42.
go back to reference Hebert D, Lindsay MP, McIntyre A, Kirton A, Rumney PG, Bagg S, et al. Canadian stroke best practice recommendations: stroke rehabilitation practice guidelines, update 2015. Int J Stroke. 2016;11(4):459–84.CrossRefPubMed Hebert D, Lindsay MP, McIntyre A, Kirton A, Rumney PG, Bagg S, et al. Canadian stroke best practice recommendations: stroke rehabilitation practice guidelines, update 2015. Int J Stroke. 2016;11(4):459–84.CrossRefPubMed
45.
go back to reference Stroke Foundation of New Zealand (SFNZ) and New Zealand Guidelines Group (NZGG). Clinical Guidelines for Stroke Management 2010. Wellington: Stroke Foundation of New Zealand; 2010. ISBN (Electronic): 978–0–9582619-6-8. Stroke Foundation of New Zealand (SFNZ) and New Zealand Guidelines Group (NZGG). Clinical Guidelines for Stroke Management 2010. Wellington: Stroke Foundation of New Zealand; 2010. ISBN (Electronic): 978–0–9582619-6-8.
49.
go back to reference South Australian Statewide Stroke Clinical Network. Clinical Guideline - Stroke Management Procedures & Protocols. Adelaide: South Australian Dept Health; 2014. South Australian Statewide Stroke Clinical Network. Clinical Guideline - Stroke Management Procedures & Protocols. Adelaide: South Australian Dept Health; 2014.
51.
go back to reference SIGN. Management of patients with stroke: rehabilitation, prevention and management of complications, and discharge planning. A national clinical guideline. Edinburgh, Scotland: Scottish Intercollegiate Guidelines Network; 2010. http://www.sign.ac.uk/assets/sign118.pdf. Accessed 12 Aug 2018. SIGN. Management of patients with stroke: rehabilitation, prevention and management of complications, and discharge planning. A national clinical guideline. Edinburgh, Scotland: Scottish Intercollegiate Guidelines Network; 2010. http://​www.​sign.​ac.​uk/​assets/​sign118.​pdf. Accessed 12 Aug 2018.
52.
go back to reference Bryer A, Connor MD, Haug P, Cheyip B, Staub H, Tipping B, Duim W, Pinkney-Atkinson V. South African guideline for management of ischaemic stroke and transient ischaemic attack 2010: A guideline from the South African Stroke Society (SASS) and the SASS Writing Committee. S Afr Med J. 2010;100(11):750–78.CrossRef Bryer A, Connor MD, Haug P, Cheyip B, Staub H, Tipping B, Duim W, Pinkney-Atkinson V. South African guideline for management of ischaemic stroke and transient ischaemic attack 2010: A guideline from the South African Stroke Society (SASS) and the SASS Writing Committee. S Afr Med J. 2010;100(11):750–78.CrossRef
54.
go back to reference Graham ID, Harrison MB, Brouwers M, Davies BL, Dunn S. Facilitating the use of evidence in practice: evaluating and adapting clinical practice guidelines for local use by healthcare organizations. JOGNN. 2002;3:599–611.CrossRef Graham ID, Harrison MB, Brouwers M, Davies BL, Dunn S. Facilitating the use of evidence in practice: evaluating and adapting clinical practice guidelines for local use by healthcare organizations. JOGNN. 2002;3:599–611.CrossRef
Metadata
Title
Standardising evidence strength grading for recommendations from multiple clinical practice guidelines: a South African case study
Authors
K. Grimmer
Q. Louw
J. M. Dizon
S-M van Niekerk
D. Ernstzen
C. Wiysonge
Publication date
01-12-2018
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2018
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/s13012-018-0803-0

Other articles of this Issue 1/2018

Implementation Science 1/2018 Go to the issue