Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress
Clinical Collections
Advances in Alzheimer’s

Keynote webinar | Spotlight on medication adherence

LIVE: Thursday 27th June 2024, 18:00-19:30 (CEST)
Join our expert panel to discover why you need to understand the drivers of non-adherence in your patients, and how you can optimize medication adherence in your clinics to drastically improve patient outcomes.
ADVANCED SEARCH
Log in
Top
Implementation Science
Published in: Implementation Science 1/2015

Open Access 01-12-2015 | Study protocol

Evaluating the implementation of a national clinical programme for diabetes to standardise and improve services: a realist evaluation protocol

Authors: S. McHugh, M. L. Tracey, F. Riordan, K O’Neill, N. Mays, P. M. Kearney

Published in: Implementation Science | Issue 1/2015

Login to get access

Abstract

Background

Over the last three decades in response to the growing burden of diabetes, countries worldwide have developed national and regional multifaceted programmes to improve the monitoring and management of diabetes and to enhance the coordination of care within and across settings. In Ireland in 2010, against a backdrop of limited dedicated strategic planning and engrained variation in the type and level of diabetes care, a national programme was established to standardise and improve care for people with diabetes in Ireland, known as the National Diabetes Programme (NDP). The NDP comprises a range of organisational and service delivery changes to support evidence-based practices and policies. This realist evaluation protocol sets out the approach that will be used to identify and explain which aspects of the programme are working, for whom and in what circumstances to produce the outcomes intended.

Methods/design

This mixed method realist evaluation will develop theories about the relationship between the context, mechanisms and outcomes of the diabetes programme. In stage 1, to identify the official programme theories, documentary analysis and qualitative interviews were conducted with national stakeholders involved in the design, development and management of the programme. In stage 2, as part of a multiple case study design with one case per administrative region in the health system, qualitative interviews are being conducted with frontline staff and service users to explore their responses to, and reasoning about, the programme’s resources (mechanisms). Finally, administrative data will be used to examine intermediate implementation outcomes such as service uptake, acceptability, and fidelity to models of care.

Discussion

This evaluation is using the principles of realist evaluation to examine the implementation of a national programme to standardise and improve services for people with diabetes in Ireland. The concurrence of implementation and evaluation has enabled us to produce formative feedback for the NDP while also supporting the refinement and revision of initial theories about how the programme is being implemented in the dynamic and unstable context of the Irish healthcare system.
Appendix
Available only for authorised users
Literature
1.
Wild S, Roglic G, Green A, Sicree R, King H. Global prevalence of diabetes: estimates for the year 2000 and projections for 2030. Diabetes Care. 2004;27(5):1047–53.CrossRefPubMed
2.
Vos T, Barber RM, Bell B, Bertozzi-Villa A, Biryukov S, Bolliger I, Charlson F, Davis A, Degenhardt L, Dicker D, et al. Global, regional, and national incidence, prevalence, and years lived with disability for 301 acute and chronic diseases and injuries in 188 countries, 1990–2013: a systematic analysis for the Global Burden of Disease Study. Lancet. 2013;386(9995):743–800.CrossRef
3.
Franco OH, Steyerberg EW, Hu FB, Mackenbach J, Nusselder W. Associations of diabetes mellitus with total life expectancy and life expectancy with and without cardiovascular disease. Arch Intern Med. 2007;167(11):1145–51.CrossRefPubMed
4.
Wexler D, Grant R, Wittenberg E, Bosch J, Cagliero E, Delahanty L, Blais M, Meigs J. Correlates of health-related quality of life in type 2 diabetes. Diabetologia. 2006;49(7):1489–97.CrossRefPubMed
5.
Zhang P, Zhang X, Brown J, Vistisen D, Sicree R, Shaw J, Nichols G. Global healthcare expenditure on diabetes for 2010 and 2030. Diabetes Res Clin Pract. 2010;87(3):293–301.CrossRefPubMed
6.
Diabetes Care and Research in Europe. The Saint Vincent Declaration. Diabet Med. 1990;7(4):360–360.
7.
Rothe U, Müller G, Schwarz PEH, Seifert M, Kunath H, Koch R, Bergmann S, Julius U, Bornstein SR, Hanefeld M, et al. Evaluation of a diabetes management system based on practice guidelines, integrated care, and continuous quality management in a federal state of Germany: a population-based approach to health care research. Diabetes Care. 2008;31(5):863–8.CrossRefPubMed
8.
Adolfsson ET, Rosenblad A, Wikblad K. The Swedish National Survey of the Quality and Organization of Diabetes Care in Primary Healthcare—Swed-QOP. Primary Care Diabetes. 2010;4(2):91–7.CrossRefPubMed
9.
Looker HC, Nyangoma SO, Cromie DT, Olson JA, Leese GP, Black MW, Doig J, Lee N, Lindsay RS, McKnight JA, et al. Rates of referable eye disease in the Scottish National Diabetic Retinopathy Screening Programme. Br J Ophthalmol. 2014;98(6):790–5.CrossRefPubMedPubMedCentral
10.
Gudbjörnsdottir S, Cederholm J, Nilsson PM, Eliasson B. The National Diabetes Register in Sweden: an implementation of the St. Vincent Declaration for Quality Improvement in Diabetes Care. Diabetes Care. 2003;26(4):1270–6.CrossRefPubMed
11.
DCCT: The Diabetes Control and Complications Trial Research Group. The effect of intensive treatment of diabetes on the development and progression of long-term complications in insulin-dependent diabetes mellitus. N Engl J Med. 1993;329(14):977–86.CrossRef
12.
UKPDS: UK Prospective Diabetes Study Group. Intensive blood-glucose control with sulphonyureas or insulin compared with conventional treatment and risk of complications in patients with type 2 diabetes. Lancet. 1998;352(9131):837–53.CrossRef
13.
Holman R, Paul S, Bethel M, Matthews D, Neil H. 10-year follow-up of intensive glucose control in type 2 diabetes. N Engl J Med. 2008;359(15):1577–89.CrossRefPubMed
14.
Holman RR, Paul SK, Bethel MA, Neil HAW, Matthews DR. Long-term follow-up after tight control of blood pressure in type 2 diabetes. N Engl J Med. 2008;359(15):1565–76.CrossRefPubMed
15.
Cholesterol Treatment Trialists Collaborators. Efficacy and safety of cholesterol-lowering treatment: prospective meta-analysis of data from 90056 participants in 14 randomised trials of statins. Lancet. 2008;366(9493):1267–78.
16.
NICE. Type 2 diabetes in adults: management. London: National Institute for Health and Care Excellence; 2015.
17.
Harkins V. A practical guide to integrated type 2 diabetes care. Dublin: Irish College of General Practitioners; 2016.
18.
American Diabetes Association. 4. Foundations of care: education, nutrition, physical activity, smoking cessation, psychosocial care, and immunization. Diabetes Care. 2015;38(Supplement 1):S20–30.CrossRef
19.
Renders CM, Valk GD, Griffin S, Wagner E, Eijk J, Assendelft W: Interventions to improve the management of diabetes mellitus in primary care, outpatient and community settings.Cochrane Database Syst Rev. 2000;Issue 4:Art. No.: CD001481
20.
Wagner EH, Austin BT, Von Michael K. Organizing care for patients with chronic illness. Milbank Q. 1996;74(4):511–44.CrossRefPubMed
21.
Griffin S, Kinmonth AL. Diabetes care: the effectiveness of systems for routine surveillance for people with diabetes. Cochrane Database Syst Rev. 2000;2:CD000541.
22.
23.
Tricco AC, Ivers NM, Grimshaw JM, Moher D, Turner L, Galipeau J, Halperin I, Vachon B, Ramsay T, Manns B, et al. Effectiveness of quality improvement strategies on the management of diabetes: a systematic review and meta-analysis. Lancet. 2012;379(9833):2252–61.CrossRefPubMed
24.
Mc Hugh SM, Perry IJ, Bradley C, Brugha R. Developing recommendations to improve the quality of diabetes care in Ireland: a policy analysis. Health Res Policy Syst. 2014;12(1):53.CrossRefPubMedPubMedCentral
25.
Mc Hugh S, O’Mullane M, Perry IJ, Bradley C. Barriers to, and facilitators in, introducing integrated diabetes care in Ireland: a qualitative study of views in general practice. BMJ Open. 2013;3(8):e003217.CrossRefPubMedPubMedCentral
26.
Mc Hugh S, O’Keeffe J, Fitzpatrick A, de Siún A, O’Mullane M, Perry I, Bradley C. Diabetes care in Ireland: a survey of general practitioners. Prim Care Diabetes. 2009;3(4):225–31.CrossRefPubMed
27.
O’Donnell M, de Siún A, O’Mullane M, Smith D, Bradley C, Finucane F, Dinneen S. Differences in the structure of outpatient diabetes care between endocrinologist-led and general physician-led services. BMC Health Serv Res. 2013;13(1):493–8.CrossRefPubMedPubMedCentral
28.
Mc Hugh SM, Marsden P, Brennan C, Murphy K, Croarkin C, Moran J, Harkins V, Perry I. Counting on commitment; the quality of primary care-led diabetes management in a system with minimal incentives. BMC Health Serv Res. 2011;11(1):384–93.CrossRef
29.
Brennan C, Harkins V, Perry I. Management of diabetes in primary care: a structured-care approach. Eur J Gen Pract. 2008;14(3):117–22.CrossRefPubMed
30.
Smith S, Bury G, O’Leary M, Shannon W, Tynan A, Staines A, Thompson C. The North Dublin randomized controlled trial of structured diabetes shared care. Fam Pract. 2004;21(1):39–45.CrossRefPubMed
31.
Collins MM, O’Sullivan T, Harkins V, Perry IJ. Quality of life and quality of care in patients with diabetes experiencing different models of care. Diabetes Care. 2009;32(4):603–5.CrossRefPubMedPubMedCentral
32.
33.
34.
Greenhalgh T, Humphrey C, Hughes J, Macfarlane F, Butler C, Pawson R. How do you modernize a health service? A realist evaluation of whole-scale transformation in London. Milbank Q. 2009;87.
35.
Lamont T, Barber N, Pury JD, Fulop N, Garfield-Birkbeck S, Lilford R, Mear L, Raine R, Fitzpatrick R. New approaches to evaluating complex health and care systems. BMJ. 2016;352. i154.
36.
Pawson R, Tilley N. Realistic evaluation. London: Sage; 1997.
37.
Pawson R. The science of evaluation: a realist manifesto. London: Sage; 2013.CrossRef
38.
Ranmuthugala G, Cunningham FC, Plumb JJ, Long J, Georgiou A, Westbrook JI, Braithwaite J. A realist evaluation of the role of communities of practice in changing healthcare practice. Implement Sci. 2011;6:49.CrossRefPubMedPubMedCentral
39.
Pawson R, Greenhalgh T, Harvey G, Walshe K. Realist review—a new method of systematic review designed for complex policy interventions. J Health Serv Res Policy. 2005;10 suppl 1:21–34.CrossRefPubMed
40.
Dalkin SM, Greenhalgh J, Jones D, Cunningham B, Lhussier M. What’s in a mechanism? Development of a key concept in realist evaluation. Implement Sci. 2015;10(1):1–7.CrossRef
41.
Dalkin SM, Jones D, Lhussier M, Cunningham B. Understanding integrated care pathways in palliative care using realist evaluation: a mixed methods study protocol. BMJ Open. 2012;2:e001533. doi:10.​1136/​bmjopen-2012-001533.
42.
Abhyankar P, Cheyne H, Maxwell M, Harris FM, McCourt C. A realist evaluation of a normal birth programme. Evid Based Midwifery. 2013;11(4):112–9.
43.
Rycroft-Malone J, Fontenla M, Bick D, Seers K. A realistic evaluation: the case of protocol-based care. Implement Sci. 2010;5(1):38–52.
44.
Goicolea I, Hurtig AK, San Sebastian M, Vives-Cases C, Marchal B. Developing a programme theory to explain how primary health care teams learn to respond to intimate partner violence: a realist case-study. BMC Health Serv Res. 2015;15:228.CrossRefPubMedPubMedCentral
45.
QSR International Pty Ltd. NVivo qualitative data analysis software, Version 10. 2012.
46.
Ritchie J, Lewis J. Qualitative research practice: a guide for social science students & researchers. Thousand Oaks: Sage Publications; 2003.
47.
Mays N, Pope C. Qualitative research in health care, 3rd edn. Malden, MA: Blackwell Publishing; 2006
48.
Charmaz K. Constructing Grounded Theory: a practical guide through qualitative analysis. London: Sage Publications Ltd; 2006.
49.
Cheyne H, Abhyankar P, McCourt C. Empowering change: realist evaluation of a Scottish Government programme to support normal birth. Midwifery. 2013;29(10):1110–21.CrossRefPubMed
50.
Tremblay D, Touati N, Roberge D, Denis J-L, Turcotte A, Samson B. Conditions for production of interdisciplinary teamwork outcomes in oncology teams: protocol for a realist evaluation. Implement Sci. 2014;9(1):1–11.CrossRef
51.
Schierhout G, Hains J, Si D, Kennedy C, Cox R, Kwedza R, O’Donoghue L, Fittock M, Brands J, Lonergan K, et al. Evaluating the effectiveness of a multifaceted, multilevel continuous quality improvement program in primary health care: developing a realist theory of change. Implement Sci. 2013;8(1):1–15.CrossRef
52.
Yin RK. Case study research: design and methods. 4th ed. Thousand Oaks, CA: Sage; 2009.
53.
54.
Randell R, Greenhalgh J, Hindmarsh J, Dowding D, Jayne D, Pearman A, Gardner P, Croft J, Kotze A. Integration of robotic surgery into routine practice and impacts on communication, collaboration, and decision making: a realist process evaluation protocol. Implement Sci. 2014;9(1):52.CrossRefPubMedPubMedCentral
55.
Miles MB, Huberman AM. Qualitative data analysis: an expanded sourcebook: Sage; 1994
56.
O’Cathain A, Murphy E, Nicholl J. Three techniques for integrating data in mixed methods studies. BMJ. 2010;341:c4587.CrossRefPubMed
57.
O’Cathain A, Murphy E, Nicholl J. Multidisciplinary, interdisciplinary, or dysfunctional? Team working in mixed-methods research. Qual Health Res. 2008;18(11):1574–85.CrossRefPubMed
58.
Stake R. Case Studies. In: Denzin N, Lincoln Y, editors. Strategies of qualitative inquiry. Thousand Oaks: Sage Publications; 1998.
59.
Farmer T, Robinson K, Elliott SJ, Eyles J. Developing and implementing a triangulation protocol for qualitative health research. Qual Health Res. 2006;16(3):377–94.CrossRefPubMed
60.
Morse JM, Barrett M, Mayan M, Olson K, Spiers J. Verification strategies for establishing reliability and validity in qualitative research. Int J Qual Methods. 2008;1(2):13–22.CrossRef
61.
Bartlett YK, Haywood A, Bentley CL, Parker J, Hawley MS, Mountain GA, Mawson S. The SMART personalised self-management system for congestive heart failure: results of a realist evaluation. BMC Medical Informatics and Decision Making. 2014;14(1):1–13.CrossRef
62.
Raaijmakers LGM, Kremers SPJ, Schaper NC, de Weerdt I, Martens MK, Hesselink AE, de Vries NK. The implementation of national action program diabetes in the Netherlands: lessons learned. BMC Health Serv Res. 2015;15(1):1–8.CrossRef
63.
Marchal B, Belle S, Olmen J, Hoerée T, Kegels G. Is realist evaluation keeping its promise? A literature review of methodological practice in health systems research. Evaluation 2012;18.
Metadata
Title
Evaluating the implementation of a national clinical programme for diabetes to standardise and improve services: a realist evaluation protocol
Authors
S. McHugh
M. L. Tracey
F. Riordan
K O’Neill
N. Mays
P. M. Kearney
Publication date
01-12-2015
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2015
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/s13012-016-0464-9

Other articles of this Issue 1/2015

Implementation Science 1/2015 Go to the issue

Systematic review

Knowledge brokering for healthy aging: a scoping review of potential approaches

Study protocol

A mixed methods evaluation of the maternal-newborn dashboard in Ontario: dashboard attributes, contextual factors, and facilitators and barriers to use: a study protocol

Research

How providers influence the implementation of provider-initiated HIV testing and counseling in Botswana: a qualitative study

Debate

Implementation, context and complexity

Study protocol

Reorganising specialist cancer surgery for the twenty-first century: a mixed methods evaluation (RESPECT-21)

Research

Printed educational messages fail to increase use of thiazides as first-line medication for hypertension in primary care: a cluster randomized controlled trial [ISRCTN72772651]