Skip to main content
Top
Published in: BMC Primary Care 1/2018

Open Access 01-12-2018 | Debate

Small-scale implementation with pragmatic process evaluation: a model developed in primary health care

Authors: Kirsti Malterud, Aase Aamland, Kristina Riis Iden

Published in: BMC Primary Care | Issue 1/2018

Login to get access

Abstract

Background

Research often fails to impose substantial shifts in clinical practice. Evidence-based health care requires implementation of documented interventions, with implementation research as a science-informed strategy to identify core experiences from the process and share preconditions for achievement. Evidence developed in hospital contexts is often neither relevant nor feasible for primary care. Different evidence types may constitute a point of departure, stretching and testing the transferability of the intervention by piloting it in primary care. Comprehensive descriptions of aims, context and procedures can be a more useful outcome than traditional effect studies.

Main text

We present a model for small-scale implementation of relevant research evidence, monitored by pragmatic evaluation. The model, which is applicable in primary care, is supported by Weiner’s theory about organizational readiness for change and consists of four steps: 1) recognize the problem – identify a workable intervention, 2) assess the context – prepare for inception, 3) pilot the intervention on site, and 4) upscale and accomplish the intervention. The process is evaluated by exploring selected relevant aspects of experiences and outcomes from the first to the last step. Process evaluation is a logical precondition for outcome evaluation – attempting to assess either the efficacy or the effectiveness of a “black box” intervention makes no sense. We argue why evidence beyond effect studies and evaluation beyond randomized controlled trials may be adequate for science-informed evaluation of a small-scale implementation project such as is often conducted by primary health care practitioners. The model is illustrated by an ongoing project, in which a strategy for upgrading the management of depression in nursing homes in Norway is currently being implemented.

Conclusions

A flexible and manageable approach is suggested, in which the inevitable unpredictability of clinical practice is incorporated. Finding the appropriate middle ground between rigour and flexibility, some compromises must be made. Our model recognizes the skills of practical knowing as something other than traditional medical research, while maintaining academic values such as systematic and transparent reflection, using adequate tools. Considering the purpose and context of our model, we argue that these priorities, emphasizing relevance and feasibility, are strengths, not limitations.
Literature
1.
go back to reference Greenhalgh T. How to implement evidence-based healthcare. Oxford: Wiley Blackwell; 2018. Greenhalgh T. How to implement evidence-based healthcare. Oxford: Wiley Blackwell; 2018.
3.
go back to reference Pathirana T, Clark J, Moynihan R. Mapping the drivers of overdiagnosis to potential solutions. BMJ. 2017;358:j3879.CrossRefPubMed Pathirana T, Clark J, Moynihan R. Mapping the drivers of overdiagnosis to potential solutions. BMJ. 2017;358:j3879.CrossRefPubMed
4.
go back to reference Vaccarella S, Franceschi S, Bray F, Wild CP, Plummer M, Dal Maso L. Worldwide thyroid-cancer epidemic? The increasing impact of overdiagnosis. N Engl J Med. 2016;375(7):614–7.CrossRefPubMed Vaccarella S, Franceschi S, Bray F, Wild CP, Plummer M, Dal Maso L. Worldwide thyroid-cancer epidemic? The increasing impact of overdiagnosis. N Engl J Med. 2016;375(7):614–7.CrossRefPubMed
5.
go back to reference Grol R, Baker R, Moss F. Quality improvement research: the science of change in health care. In: Grol R, Baker R, Moss F, editors. Quality improvement research: understanding the science of change in health care. London, BMJ Books; 2004. p. 1–5. Grol R, Baker R, Moss F. Quality improvement research: the science of change in health care. In: Grol R, Baker R, Moss F, editors. Quality improvement research: understanding the science of change in health care. London, BMJ Books; 2004. p. 1–5.
7.
go back to reference Malterud K. The legitimacy of clinical knowledge: towards a medical epistemology embracing the art of medicine. Theor Med. 1995;16(2):183–98.CrossRefPubMed Malterud K. The legitimacy of clinical knowledge: towards a medical epistemology embracing the art of medicine. Theor Med. 1995;16(2):183–98.CrossRefPubMed
8.
go back to reference Malterud K. The art and science of clinical knowledge: evidence beyond measures and numbers. Lancet. 2001;358(9279):397–400.CrossRefPubMed Malterud K. The art and science of clinical knowledge: evidence beyond measures and numbers. Lancet. 2001;358(9279):397–400.CrossRefPubMed
9.
go back to reference De Maeseneer JM, van Driel ML, Green LA, van Weel C. The need for research in primary care. Lancet. 2003;362(9392):1314–9.CrossRefPubMed De Maeseneer JM, van Driel ML, Green LA, van Weel C. The need for research in primary care. Lancet. 2003;362(9392):1314–9.CrossRefPubMed
10.
go back to reference Carlsen B, Glenton C, Pope C. Thou shalt versus thou shalt not: a meta-synthesis of GPs’ attitudes to clinical practice guidelines. Br J Gen Pract. 2007;57(545):971–8.CrossRefPubMedPubMedCentral Carlsen B, Glenton C, Pope C. Thou shalt versus thou shalt not: a meta-synthesis of GPs’ attitudes to clinical practice guidelines. Br J Gen Pract. 2007;57(545):971–8.CrossRefPubMedPubMedCentral
11.
go back to reference Lugtenberg M, Zegers-van Schaick JM, Westert GP, Burgers JS. Why don't physicians adhere to guideline recommendations in practice? An analysis of barriers among Dutch general practitioners. Implement Sci. 2009;4:54.CrossRefPubMedPubMedCentral Lugtenberg M, Zegers-van Schaick JM, Westert GP, Burgers JS. Why don't physicians adhere to guideline recommendations in practice? An analysis of barriers among Dutch general practitioners. Implement Sci. 2009;4:54.CrossRefPubMedPubMedCentral
12.
go back to reference Austad B, Hetlevik I, Mjolstad BP, Helvik AS. Applying clinical guidelines in general practice: a qualitative study of potential complications. BMC Fam Pract. 2016;17:92.CrossRefPubMedPubMedCentral Austad B, Hetlevik I, Mjolstad BP, Helvik AS. Applying clinical guidelines in general practice: a qualitative study of potential complications. BMC Fam Pract. 2016;17:92.CrossRefPubMedPubMedCentral
13.
go back to reference Flottorp S, Oxman AD, Håvelsrud K, Treweek S, Herrin J. Cluster randomised controlled trial of tailored interventions to improve the management of urinary tract infections in women and sore throat. BMJ. 2002;325(7360):367.CrossRefPubMedPubMedCentral Flottorp S, Oxman AD, Håvelsrud K, Treweek S, Herrin J. Cluster randomised controlled trial of tailored interventions to improve the management of urinary tract infections in women and sore throat. BMJ. 2002;325(7360):367.CrossRefPubMedPubMedCentral
15.
go back to reference Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337:a1655.CrossRefPubMedPubMedCentral Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337:a1655.CrossRefPubMedPubMedCentral
16.
go back to reference Peters DH, Adam T, Alonge O, Agyepong IA, Tran N. Implementation research: what it is and how to do it. BMJ. 2013;347:f6753.CrossRefPubMed Peters DH, Adam T, Alonge O, Agyepong IA, Tran N. Implementation research: what it is and how to do it. BMJ. 2013;347:f6753.CrossRefPubMed
17.
go back to reference Grol R, Wensing M, Eccles M. Improving patient care. The implementation of change in clinical practice. Hoboken: Wiley; 2005. Grol R, Wensing M, Eccles M. Improving patient care. The implementation of change in clinical practice. Hoboken: Wiley; 2005.
18.
go back to reference Graham R, Mancher M, Wolman DM, Greenfield S, Steinberg E: Clinical practice guidelines we can trust Washington: Institute of medicine, The National Academies Press; 2011. Graham R, Mancher M, Wolman DM, Greenfield S, Steinberg E: Clinical practice guidelines we can trust Washington: Institute of medicine, The National Academies Press; 2011.
19.
go back to reference Fixsen DL, Naaom SF, Blase KA, Friedman RM, Wallace F. Implementation research: a synthesis of the literature. Tampa, FA: University of South Florida; 2005. Fixsen DL, Naaom SF, Blase KA, Friedman RM, Wallace F. Implementation research: a synthesis of the literature. Tampa, FA: University of South Florida; 2005.
20.
go back to reference Patton MQ. Utilization-focused evaluation. Thousand Oaks, CA: SAGE Publications; 2008. Patton MQ. Utilization-focused evaluation. Thousand Oaks, CA: SAGE Publications; 2008.
21.
go back to reference Haraway D. Situated knowledges; the science question in feminism and the privilege of partial perspective. In: Haraway D, editor. Simians, cyborgs, and women The reinvention of nature. New York: Routledge; 1991. p. 183–201. Haraway D. Situated knowledges; the science question in feminism and the privilege of partial perspective. In: Haraway D, editor. Simians, cyborgs, and women The reinvention of nature. New York: Routledge; 1991. p. 183–201.
22.
go back to reference Östlund U, Kidd L, Wengström Y, Rowa-Dewar N. Combining qualitative and quantitative research within mixed method research designs: a methodological review. Int J Nurs Stud. 2011;48(3):369–83.CrossRefPubMed Östlund U, Kidd L, Wengström Y, Rowa-Dewar N. Combining qualitative and quantitative research within mixed method research designs: a methodological review. Int J Nurs Stud. 2011;48(3):369–83.CrossRefPubMed
23.
go back to reference Patton MQ. Qualitative research & evaluation methods: integrating theory and practice. 4th ed. Thousand Oaks, CA: SAGE; 2015. Patton MQ. Qualitative research & evaluation methods: integrating theory and practice. 4th ed. Thousand Oaks, CA: SAGE; 2015.
24.
go back to reference Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, Griffey R, Hensley M. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Admin Pol Ment Health. 2011;38(2):65–76.CrossRef Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, Griffey R, Hensley M. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Admin Pol Ment Health. 2011;38(2):65–76.CrossRef
25.
go back to reference Nygaard HA, Ruths S, Straand J, Naik M. Not less but different: psychotropic drug utilization trends in Norwegian nursing homes during a 12-year period. The Bergen District nursing home (BEDNURS) study. Aging Clin Exp Res. 2004;16(4):277–82.CrossRefPubMed Nygaard HA, Ruths S, Straand J, Naik M. Not less but different: psychotropic drug utilization trends in Norwegian nursing homes during a 12-year period. The Bergen District nursing home (BEDNURS) study. Aging Clin Exp Res. 2004;16(4):277–82.CrossRefPubMed
26.
go back to reference Onder G, Liperoti R, Fialova D, Topinkova E, Tosato M, Danese P, Gallo PF, Carpenter I, Finne-Soveri H, Gindin J, et al. Polypharmacy in nursing home in Europe: results from the SHELTER study. J Gerontol A Biol Sci Med Sci. 2012;67(6):698–704.CrossRefPubMed Onder G, Liperoti R, Fialova D, Topinkova E, Tosato M, Danese P, Gallo PF, Carpenter I, Finne-Soveri H, Gindin J, et al. Polypharmacy in nursing home in Europe: results from the SHELTER study. J Gerontol A Biol Sci Med Sci. 2012;67(6):698–704.CrossRefPubMed
27.
go back to reference Coupland C, Dhiman P, Morriss R, Arthur A, Barton G, Hippisley-Cox J. Antidepressant use and risk of adverse outcomes in older people: population based cohort study. BMJ. 2011;343:d4551.CrossRefPubMedPubMedCentral Coupland C, Dhiman P, Morriss R, Arthur A, Barton G, Hippisley-Cox J. Antidepressant use and risk of adverse outcomes in older people: population based cohort study. BMJ. 2011;343:d4551.CrossRefPubMedPubMedCentral
28.
go back to reference Bakken MS, Engeland A, Engesaeter LB, Ranhoff AH, Hunskaar S, Ruths S. Increased risk of hip fracture among older people using antidepressant drugs: data from the Norwegian prescription database and the Norwegian hip fracture registry. Age Ageing. 2013;42(4):514–20.CrossRefPubMed Bakken MS, Engeland A, Engesaeter LB, Ranhoff AH, Hunskaar S, Ruths S. Increased risk of hip fracture among older people using antidepressant drugs: data from the Norwegian prescription database and the Norwegian hip fracture registry. Age Ageing. 2013;42(4):514–20.CrossRefPubMed
29.
go back to reference Banerjee S, Hellier J, Dewey M, Romeo R, Ballard C, Baldwin R, Bentham P, Fox C, Holmes C, Katona C, et al. Sertraline or mirtazapine for depression in dementia (HTA-SADD): a randomised, multicentre, double-blind, placebo-controlled trial. Lancet. 2011;378(9789):403–11.CrossRefPubMed Banerjee S, Hellier J, Dewey M, Romeo R, Ballard C, Baldwin R, Bentham P, Fox C, Holmes C, Katona C, et al. Sertraline or mirtazapine for depression in dementia (HTA-SADD): a randomised, multicentre, double-blind, placebo-controlled trial. Lancet. 2011;378(9789):403–11.CrossRefPubMed
30.
go back to reference Iden KR, Hjorleifsson S, Ruths S. Treatment decisions on antidepressants in nursing homes: a qualitative study. Scand J Prim Health Care. 2011;29(4):252–6.CrossRefPubMedPubMedCentral Iden KR, Hjorleifsson S, Ruths S. Treatment decisions on antidepressants in nursing homes: a qualitative study. Scand J Prim Health Care. 2011;29(4):252–6.CrossRefPubMedPubMedCentral
31.
go back to reference Iden KR, Engedal K, Hjorleifsson S, Ruths S. Prevalence of depression among recently admitted long-term care patients in Norwegian nursing homes: associations with diagnostic workup and use of antidepressants. Dement Geriatr Cogn Disord. 2014;37(3–4):154–62.CrossRefPubMed Iden KR, Engedal K, Hjorleifsson S, Ruths S. Prevalence of depression among recently admitted long-term care patients in Norwegian nursing homes: associations with diagnostic workup and use of antidepressants. Dement Geriatr Cogn Disord. 2014;37(3–4):154–62.CrossRefPubMed
33.
go back to reference Stensland P, Malterud K. New gateways to dialogue in general practice. Development of an illness diary to expand communication. Scand J Prim Health Care. 1997;15(4):175–9.CrossRefPubMed Stensland P, Malterud K. New gateways to dialogue in general practice. Development of an illness diary to expand communication. Scand J Prim Health Care. 1997;15(4):175–9.CrossRefPubMed
34.
go back to reference Alexopoulos GS, Abrams RC, Young RC, Shamoian CA. Cornell scale for depression in dementia. Biol Psychiatry. 1988;23(3):271–84.CrossRefPubMed Alexopoulos GS, Abrams RC, Young RC, Shamoian CA. Cornell scale for depression in dementia. Biol Psychiatry. 1988;23(3):271–84.CrossRefPubMed
35.
go back to reference Barca ML, Engedal K, Selbaek G. A reliability and validity study of the Cornell scale among elderly inpatients, using various clinical criteria. Dement Geriatr Cogn Disord. 2010;29(5):438–47.CrossRefPubMed Barca ML, Engedal K, Selbaek G. A reliability and validity study of the Cornell scale among elderly inpatients, using various clinical criteria. Dement Geriatr Cogn Disord. 2010;29(5):438–47.CrossRefPubMed
36.
go back to reference Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004;82(4):581–629.CrossRefPubMedPubMedCentral Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004;82(4):581–629.CrossRefPubMedPubMedCentral
37.
go back to reference Morgan D. Focus groups as qualitative research. Thousand Oaks, CA: SAGE; 1997.CrossRef Morgan D. Focus groups as qualitative research. Thousand Oaks, CA: SAGE; 1997.CrossRef
38.
go back to reference Rosemond CA, Hanson LC, Ennett ST, Schenck AP, Weiner BJ. Implementing person-centered care in nursing homes. Health Care Manag Rev. 2012;37(3):257–66.CrossRef Rosemond CA, Hanson LC, Ennett ST, Schenck AP, Weiner BJ. Implementing person-centered care in nursing homes. Health Care Manag Rev. 2012;37(3):257–66.CrossRef
39.
go back to reference Van Manen M. Researching lived experience : human science for an action sensitive pedagogy. London: Ont: Althouse press; 1990. Van Manen M. Researching lived experience : human science for an action sensitive pedagogy. London: Ont: Althouse press; 1990.
40.
go back to reference Creswell JW, Clark VLP. Designing and conducting mixed methods research. Los Angeles, CA: SAGE; 2011. Creswell JW, Clark VLP. Designing and conducting mixed methods research. Los Angeles, CA: SAGE; 2011.
41.
42.
go back to reference Eccles MP, Mittman BS: Welcome to implementation science. Implementation Science 2006, 1(1):1. Eccles MP, Mittman BS: Welcome to implementation science. Implementation Science 2006, 1(1):1.
43.
go back to reference Greenhalgh T, Wieringa S. Is it time to drop the ‘knowledge translation’ metaphor? A critical literature review. J R Soc Med. 2011;104(12):501–9.CrossRefPubMedPubMedCentral Greenhalgh T, Wieringa S. Is it time to drop the ‘knowledge translation’ metaphor? A critical literature review. J R Soc Med. 2011;104(12):501–9.CrossRefPubMedPubMedCentral
44.
go back to reference Finlay L. Introducing Reflexivity. In: Finlay L, Gough B, editors. Reflexivity - A practical guide for researchers in health and social sciences. Oxford: Wiley; 2008. p. 1–49. Finlay L. Introducing Reflexivity. In: Finlay L, Gough B, editors. Reflexivity - A practical guide for researchers in health and social sciences. Oxford: Wiley; 2008. p. 1–49.
45.
go back to reference Cochrane AL. Effectiveness and efficiency: random reflections on health services. London: Nuffield Provincial Hospitals Trust; 1972. Cochrane AL. Effectiveness and efficiency: random reflections on health services. London: Nuffield Provincial Hospitals Trust; 1972.
46.
go back to reference Rothwell PM. External validity of randomised controlled trials: “to whom do the results of this trial apply?”. Lancet. 2005;365(9453):82–93.CrossRefPubMed Rothwell PM. External validity of randomised controlled trials: “to whom do the results of this trial apply?”. Lancet. 2005;365(9453):82–93.CrossRefPubMed
48.
go back to reference Glasziou P, Meats E, Heneghan C, Shepperd S. What is missing from descriptions of treatment in trials and reviews? Br Med J. 2008;336(7659):1472–4.CrossRef Glasziou P, Meats E, Heneghan C, Shepperd S. What is missing from descriptions of treatment in trials and reviews? Br Med J. 2008;336(7659):1472–4.CrossRef
49.
go back to reference Harvey G, Wensing M. Methods for evaluation of small scale quality improvement projects. Quality & safety in health care. 2003;12(3):210–4.CrossRef Harvey G, Wensing M. Methods for evaluation of small scale quality improvement projects. Quality & safety in health care. 2003;12(3):210–4.CrossRef
Metadata
Title
Small-scale implementation with pragmatic process evaluation: a model developed in primary health care
Authors
Kirsti Malterud
Aase Aamland
Kristina Riis Iden
Publication date
01-12-2018
Publisher
BioMed Central
Published in
BMC Primary Care / Issue 1/2018
Electronic ISSN: 2731-4553
DOI
https://doi.org/10.1186/s12875-018-0778-6

Other articles of this Issue 1/2018

BMC Primary Care 1/2018 Go to the issue