Skip to main content
Top
Published in: BMC Health Services Research 1/2019

Open Access 01-12-2019 | Research article

Process evaluation of a behaviour change approach to improving clinical practice for detecting hereditary cancer

Authors: Janet C. Long, Teresa Winata, Deborah Debono, Kim-Chi Phan-Thien, Christine Zhu, Natalie Taylor

Published in: BMC Health Services Research | Issue 1/2019

Login to get access

Abstract

Background

This retrospective process evaluation reports on the application of a 1-year implementation program to increase identification and management of patients at high risk of a hereditary cancer syndrome. The project used the Theoretical Domains Framework Implementation (TDFI) approach, a promising implementation methodology, used successfully in the United Kingdom to address patient safety issues. This Australian project run at two large public hospitals aimed to increase referrals of patients flagged as being at risk of Lynch syndrome on the basis of a screening test to genetic services. At the end of the project, the pathologists’ processes had changed, but the referral rate remained inconsistent and low.

Methods

Semi-structured interviews explored participants’ perceptions of the TDFI approach and Health services researchers wrote structured reflections. Interview transcripts and reflections were coded initially against implementation outcomes for the various TDFI approach activities: acceptability, appropriateness, feasibility, value for time cost, and adoption. On a second pass, themes were coded around challenges to the approach.

Results

Interviews were held with nine key project participants including pathologists, oncologists, surgeons, genetic counsellors and an administrative officer. Two health services researchers wrote structured reflections. The first of two major themes was ‘Theory-related challenges’, with subthemes of accessibility of theory underpinning the TDFI, commitment to that theory-based approach, and the problem of complexity. The second theme was ‘Practical challenges’ with subthemes of stakeholder management, navigating the system, and perceptions of the problem.
Health services researchers reflected on the benefits of bridging professional divides and facilitating collective learning and problem solving, but noted frustrations around clinicians’ time constraints that led to sparse interactions with the team, and lack of authority to effect change themselves.

Conclusions

Mixed success of adoption as an outcome was attributed to the complexity and highly nuanced nature of the setting. This made identifying the target behaviour, a key step in the TDFI approach, challenging. Introduced changes in the screening process led to new, unexpected issues yet to be addressed. Strategies to address challenges are presented, including using an internal facilitator with a focus on applying a theory-based implementation approach.
Appendix
Available only for authorised users
Literature
1.
go back to reference Taylor N, Lawton R, Moore S, Craig J, Slater B, Cracknell A, et al. Collaborating with front-line healthcare professionals: the clinical and cost effectiveness of a theory based approach to the implementation of a national guideline. BMC Health Serv Res. 2014;14(1):1–10.CrossRef Taylor N, Lawton R, Moore S, Craig J, Slater B, Cracknell A, et al. Collaborating with front-line healthcare professionals: the clinical and cost effectiveness of a theory based approach to the implementation of a national guideline. BMC Health Serv Res. 2014;14(1):1–10.CrossRef
2.
go back to reference Taylor N, Lawton R, Slater B, Foy R. The demonstration of a theory-based approach to the design of localized patient safety interventions. Implement Sci. 2013;8(1):123.CrossRef Taylor N, Lawton R, Slater B, Foy R. The demonstration of a theory-based approach to the design of localized patient safety interventions. Implement Sci. 2013;8(1):123.CrossRef
3.
go back to reference Taylor N, Parveen S, Robins V, Slater B, Lawton R. Development and initial validation of the influences on patient safety Behaviours questionnaire. Implement Sci. 2013;8(1):81.CrossRef Taylor N, Parveen S, Robins V, Slater B, Lawton R. Development and initial validation of the influences on patient safety Behaviours questionnaire. Implement Sci. 2013;8(1):81.CrossRef
4.
go back to reference Colquhoun H, Leeman J, Michie S, Lokker C, Bragge P, Hempel S, et al. Towards a common terminology: a simplified framework of interventions to promote and integrate evidence into health practices, systems, and policies. Implement Sci. 2014;9:51.PubMedPubMedCentral Colquhoun H, Leeman J, Michie S, Lokker C, Bragge P, Hempel S, et al. Towards a common terminology: a simplified framework of interventions to promote and integrate evidence into health practices, systems, and policies. Implement Sci. 2014;9:51.PubMedPubMedCentral
5.
go back to reference Moore G, Audrey S, Barker M, Bond L, Bonell C, Cooper C, et al. Process evaluation in complex public health intervention studies: the need for guidance. J Epidemiol Community Health. 2014;68(2):101–2.CrossRef Moore G, Audrey S, Barker M, Bond L, Bonell C, Cooper C, et al. Process evaluation in complex public health intervention studies: the need for guidance. J Epidemiol Community Health. 2014;68(2):101–2.CrossRef
6.
go back to reference Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337. Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337.
7.
go back to reference Long JC, Debono D, Williams R, Salisbury E, O’Neill S, Eykman E, et al. Using behaviour change and implementation science to address low referral rates in oncology. BMC Health Serv Res. 2018;18:904.CrossRef Long JC, Debono D, Williams R, Salisbury E, O’Neill S, Eykman E, et al. Using behaviour change and implementation science to address low referral rates in oncology. BMC Health Serv Res. 2018;18:904.CrossRef
8.
go back to reference Stoffel E, Mangu P, Gruber S, Hamilton K, MF LM, et al. Hereditary colorectal cancer syndromes: American Society of Clinical Oncology clinical practice guideline endorsement of the familial risk-colorectal cancer: European Society for Medical Oncology clinical practice guidelines. J Clin Oncol. 2015;33(2):209–17.CrossRef Stoffel E, Mangu P, Gruber S, Hamilton K, MF LM, et al. Hereditary colorectal cancer syndromes: American Society of Clinical Oncology clinical practice guideline endorsement of the familial risk-colorectal cancer: European Society for Medical Oncology clinical practice guidelines. J Clin Oncol. 2015;33(2):209–17.CrossRef
9.
go back to reference Barrow P, Khan M, Lalloo F, Evans DG, Hill J. Systematic review of the impact of registration and screening on colorectal cancer incidence and mortality in familial adenomatous polyposis and lynch syndrome. Br J Med Surg. 2013;100(13):1719–31.CrossRef Barrow P, Khan M, Lalloo F, Evans DG, Hill J. Systematic review of the impact of registration and screening on colorectal cancer incidence and mortality in familial adenomatous polyposis and lynch syndrome. Br J Med Surg. 2013;100(13):1719–31.CrossRef
10.
go back to reference Frayling I, Ward R. Should we consider introducing systematic screening for lynch syndrome? Cancer Forum. 2014;38(3):229–32. Frayling I, Ward R. Should we consider introducing systematic screening for lynch syndrome? Cancer Forum. 2014;38(3):229–32.
11.
go back to reference Ward RL, Hicks S, Hawkins NJ. Population-based molecular screening for lynch syndrome: implications for personalized medicine. J Clin Oncol. 2013;31(20):2554–62.CrossRef Ward RL, Hicks S, Hawkins NJ. Population-based molecular screening for lynch syndrome: implications for personalized medicine. J Clin Oncol. 2013;31(20):2554–62.CrossRef
12.
go back to reference Michie S, Johnston M, Abraham C, Lawton R, Parker D, Walker A. Making psychological theory useful for implementing evidence based practice: a consensus approach. Qual Saf Health Care. 2005;14(1):26–33.CrossRef Michie S, Johnston M, Abraham C, Lawton R, Parker D, Walker A. Making psychological theory useful for implementing evidence based practice: a consensus approach. Qual Saf Health Care. 2005;14(1):26–33.CrossRef
13.
go back to reference Braithwaite J, Marks D, Taylor N. Harnessing implementation science to improve care quality and patient safety: a systematic review of targeted literature. Int J Qual Health Care. 2014;26(3):321–9.CrossRef Braithwaite J, Marks D, Taylor N. Harnessing implementation science to improve care quality and patient safety: a systematic review of targeted literature. Int J Qual Health Care. 2014;26(3):321–9.CrossRef
15.
go back to reference Taylor N, Long JC, Debono D, Williams R, Salisbury E, O’Neill S, et al. Achieving behaviour change for detection and management of lynch syndrome using the theoretical domains framework implementation (TDFI) approach: a study protocol. BMC Health Serv Res. 2016;16:89.CrossRef Taylor N, Long JC, Debono D, Williams R, Salisbury E, O’Neill S, et al. Achieving behaviour change for detection and management of lynch syndrome using the theoretical domains framework implementation (TDFI) approach: a study protocol. BMC Health Serv Res. 2016;16:89.CrossRef
16.
go back to reference Long JC, Debono D, Williams R, Salisbury E, O'Neill S, Eykman E, et al. Using behaviour change and implementation science to address low referral rates in oncology. BMC Health Serv Res. 2018;18(1):904.CrossRef Long JC, Debono D, Williams R, Salisbury E, O'Neill S, Eykman E, et al. Using behaviour change and implementation science to address low referral rates in oncology. BMC Health Serv Res. 2018;18(1):904.CrossRef
17.
go back to reference Proctor E, Landsverk J, Aarons G, Chambers D, Glisson C, Mittman B. Implementation research in menetal health services: an emerging science with conceptual, methodological, and training challenges. Adm Policy Ment Health. 2009;36(1):24–34.CrossRef Proctor E, Landsverk J, Aarons G, Chambers D, Glisson C, Mittman B. Implementation research in menetal health services: an emerging science with conceptual, methodological, and training challenges. Adm Policy Ment Health. 2009;36(1):24–34.CrossRef
18.
go back to reference Proctor E, Silmere H, Raghavan R, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research questions. Adm Policy Ment Health. 2011;38:65–76.CrossRef Proctor E, Silmere H, Raghavan R, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research questions. Adm Policy Ment Health. 2011;38:65–76.CrossRef
19.
go back to reference Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Admin Pol Ment Health. 2011;38(2):65–76.CrossRef Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Admin Pol Ment Health. 2011;38(2):65–76.CrossRef
20.
go back to reference Glaser BG. The constant comparative method of qualitative analysis. Soc Probl. 2014;12(4):436–45.CrossRef Glaser BG. The constant comparative method of qualitative analysis. Soc Probl. 2014;12(4):436–45.CrossRef
21.
go back to reference Clay-Williams R, Baysari M, Taylor N, Zalitis D, Georgiou A, Robinson M, et al. Service provider perceptions of transitioning from audio to video capability in a telehealth system: a qualitative evaluation. BMC Health Serv Res. 2017;17(1):558.CrossRef Clay-Williams R, Baysari M, Taylor N, Zalitis D, Georgiou A, Robinson M, et al. Service provider perceptions of transitioning from audio to video capability in a telehealth system: a qualitative evaluation. BMC Health Serv Res. 2017;17(1):558.CrossRef
22.
go back to reference Abraham C, Michie S. A taxonomy of behavior change techniques used in interventions. Health Psychol. 2008;27(3):379–87.CrossRef Abraham C, Michie S. A taxonomy of behavior change techniques used in interventions. Health Psychol. 2008;27(3):379–87.CrossRef
23.
go back to reference Brainard J, Hunter PR. Do complexity-informed health interventions work? A scoping review. Implement Sci. 2016;11(1):127.CrossRef Brainard J, Hunter PR. Do complexity-informed health interventions work? A scoping review. Implement Sci. 2016;11(1):127.CrossRef
24.
go back to reference Davidoff F, Dixon-Woods M, Leviton L, Michie S. Demystifying theory and its use in improvement. BMJ Qual Saf. 2015;24(3):228–38.CrossRef Davidoff F, Dixon-Woods M, Leviton L, Michie S. Demystifying theory and its use in improvement. BMJ Qual Saf. 2015;24(3):228–38.CrossRef
25.
go back to reference Foy R, Ovretveit J, Shekelle PG, Pronovost PJ, Taylor SL, Dy S, et al. The role of theory in research to develop and evaluate the implementation of patient safety practices. BMJ Qual Saf. 2011;20(5):453.CrossRef Foy R, Ovretveit J, Shekelle PG, Pronovost PJ, Taylor SL, Dy S, et al. The role of theory in research to develop and evaluate the implementation of patient safety practices. BMJ Qual Saf. 2011;20(5):453.CrossRef
26.
go back to reference Greenhalgh T, Robert G, MacFarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004;82(4):581–629.CrossRef Greenhalgh T, Robert G, MacFarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004;82(4):581–629.CrossRef
27.
go back to reference Grol R, Bosch MC, Hulscher ME, Eccles MP, Wensing M. Planning and studying improvement in patient care: the use of theoretical perspectives. Milbank Q. 2007;85(1):93–138.CrossRef Grol R, Bosch MC, Hulscher ME, Eccles MP, Wensing M. Planning and studying improvement in patient care: the use of theoretical perspectives. Milbank Q. 2007;85(1):93–138.CrossRef
28.
go back to reference Grol R, Wensing M, Eccles M, Davis D. Improving patient care: the implementation of change in health care: Wiley; 2013. Grol R, Wensing M, Eccles M, Davis D. Improving patient care: the implementation of change in health care: Wiley; 2013.
29.
go back to reference Kimberly J, Evanisko M. Organizational innovation: the influence of individual, organizational, and contextual factors on hospital adoption of technological and administrative innovations. Acad Manag J. 1981;34(3):689–713. Kimberly J, Evanisko M. Organizational innovation: the influence of individual, organizational, and contextual factors on hospital adoption of technological and administrative innovations. Acad Manag J. 1981;34(3):689–713.
30.
go back to reference Knoben J, Oerlemans LAG. Proximity and inter-organizational collaboration: a literature review. Int J Manag Rev. 2006;8(2):71–89.CrossRef Knoben J, Oerlemans LAG. Proximity and inter-organizational collaboration: a literature review. Int J Manag Rev. 2006;8(2):71–89.CrossRef
31.
go back to reference Leistikow IP, Kalkman CJ, de Bruijn H. Why patient safety is such a tough nut to crack. BMJ. 2011;342:d3447.CrossRef Leistikow IP, Kalkman CJ, de Bruijn H. Why patient safety is such a tough nut to crack. BMJ. 2011;342:d3447.CrossRef
32.
go back to reference Long JC, Cunningham FC, Braithwaite J. Bridges, brokers and boundary spanners in collaborative networks: a systematic review. BMC Health Serv Res. 2013;13(1):158.CrossRef Long JC, Cunningham FC, Braithwaite J. Bridges, brokers and boundary spanners in collaborative networks: a systematic review. BMC Health Serv Res. 2013;13(1):158.CrossRef
33.
go back to reference Marshall M, Pronovost P, Dixon-Woods M. Promotion of improvement as a science. Lancet. 2013;381(9864):419–21.CrossRef Marshall M, Pronovost P, Dixon-Woods M. Promotion of improvement as a science. Lancet. 2013;381(9864):419–21.CrossRef
34.
go back to reference Michie S, Richardson M, Johnston M, Abraham C, Francis J, Hardeman W, et al. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Behav Med. 2013;46(1):81–95.CrossRef Michie S, Richardson M, Johnston M, Abraham C, Francis J, Hardeman W, et al. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Behav Med. 2013;46(1):81–95.CrossRef
35.
go back to reference Michie S, Van Stralen MM, West R. The behaviour change wheel: a new method for characterising and designing behaviour change interventions. Implement Sci. 2011;6(1):42.CrossRef Michie S, Van Stralen MM, West R. The behaviour change wheel: a new method for characterising and designing behaviour change interventions. Implement Sci. 2011;6(1):42.CrossRef
36.
go back to reference Rogers EM. Diffusion of innovations. New York: Free Press; 1983. Rogers EM. Diffusion of innovations. New York: Free Press; 1983.
37.
go back to reference Scott I. What are the most effective strategies for improving quality and safety of health care? Intern Med J. 2009;39(6):389–400.CrossRef Scott I. What are the most effective strategies for improving quality and safety of health care? Intern Med J. 2009;39(6):389–400.CrossRef
38.
go back to reference Walsh J, McDonald KM, Shojania KG, Sundaram V, Nayak S, Davies S, et al. Closing the quality gap: a critical analysis of quality improvement strategies (Vol. 3: hypertension care). 2005. Walsh J, McDonald KM, Shojania KG, Sundaram V, Nayak S, Davies S, et al. Closing the quality gap: a critical analysis of quality improvement strategies (Vol. 3: hypertension care). 2005.
39.
go back to reference Michie S, Johnston M, Abraham C, Lawton R, Parker D, Walker A. Making psychological theory useful for implementing evidence based practice: a consensus approach. BMJ Qual Saf. 2005;14(1):26–33.CrossRef Michie S, Johnston M, Abraham C, Lawton R, Parker D, Walker A. Making psychological theory useful for implementing evidence based practice: a consensus approach. BMJ Qual Saf. 2005;14(1):26–33.CrossRef
40.
go back to reference Foy R, Ovretveit J, Shekelle PG, Pronovost PJ, Taylor SL, Dy S, et al. The role of theory in research to develop and evaluate the implementation of patient safety practices. BMJ Qual Saf. 2011;20(5):453–9.CrossRef Foy R, Ovretveit J, Shekelle PG, Pronovost PJ, Taylor SL, Dy S, et al. The role of theory in research to develop and evaluate the implementation of patient safety practices. BMJ Qual Saf. 2011;20(5):453–9.CrossRef
41.
go back to reference Clay-Williams R, Taylor N, Braithwaite J. Potential solutions to improve the governance of multicentre health services research. Med J Aust. 2018;208(4):152–4.CrossRef Clay-Williams R, Taylor N, Braithwaite J. Potential solutions to improve the governance of multicentre health services research. Med J Aust. 2018;208(4):152–4.CrossRef
42.
go back to reference Aldrich H, Herker D. Boundry spanning roles and organizational structure. Acad Manag Rev. 1977;2:217–30.CrossRef Aldrich H, Herker D. Boundry spanning roles and organizational structure. Acad Manag Rev. 1977;2:217–30.CrossRef
44.
go back to reference Pogue RE, Cavalcanti DP, Shanker S, Andrade RV, Aguiar LR, de Carvalho JL, et al. Rare genetic diseases: update on diagnosis, treatment and online resources. Drug Discov Today. 2018;23(1):187–95.CrossRef Pogue RE, Cavalcanti DP, Shanker S, Andrade RV, Aguiar LR, de Carvalho JL, et al. Rare genetic diseases: update on diagnosis, treatment and online resources. Drug Discov Today. 2018;23(1):187–95.CrossRef
45.
go back to reference Ivers NM, Grimshaw JM. Reducing research waste with implementation laboratories. Lancet. 2016;388(10044):547–8.CrossRef Ivers NM, Grimshaw JM. Reducing research waste with implementation laboratories. Lancet. 2016;388(10044):547–8.CrossRef
46.
go back to reference Atkins L, Francis J, Islam R, O’Connor D, Patey A, Ivers N, et al. A guide to using the theoretical domains framework of behaviour change to investigate implementation problems. Implement Sci. 2017;12(1). Atkins L, Francis J, Islam R, O’Connor D, Patey A, Ivers N, et al. A guide to using the theoretical domains framework of behaviour change to investigate implementation problems. Implement Sci. 2017;12(1).
47.
go back to reference Plsek PE, Greenhalgh T. The challenge of complexity in health care. BMJ. 2001;323(7313):625.CrossRef Plsek PE, Greenhalgh T. The challenge of complexity in health care. BMJ. 2001;323(7313):625.CrossRef
48.
go back to reference Braithwaite J, Churruca K, Long JC, Ellis LA, Herkes J. When complexity science meets implementation science: a theoretical and empirical analysis of systems change. BMC Med. 2018;16:63.CrossRef Braithwaite J, Churruca K, Long JC, Ellis LA, Herkes J. When complexity science meets implementation science: a theoretical and empirical analysis of systems change. BMC Med. 2018;16:63.CrossRef
49.
go back to reference Michie S, Fixsen D, Grimshaw JM, Eccles MP. Specifying and reporting complex behaviour change interventions: the need for a scientific method. Implement Sci. 2009;4(1):40.CrossRef Michie S, Fixsen D, Grimshaw JM, Eccles MP. Specifying and reporting complex behaviour change interventions: the need for a scientific method. Implement Sci. 2009;4(1):40.CrossRef
50.
go back to reference Sekhon M, Cartwright M, Francis JJ. Acceptability of healthcare interventions: an overview of reviews and development of a theoretical framework. BMC Health Serv Res. 2017;17(1):88.CrossRef Sekhon M, Cartwright M, Francis JJ. Acceptability of healthcare interventions: an overview of reviews and development of a theoretical framework. BMC Health Serv Res. 2017;17(1):88.CrossRef
51.
go back to reference Klein K, Sorra J. The challenge of innovation implementation. Acad Manag Rev. 1996;21(4):1055–81.CrossRef Klein K, Sorra J. The challenge of innovation implementation. Acad Manag Rev. 1996;21(4):1055–81.CrossRef
52.
go back to reference Proctor E, Brownson R. Measurement issues in dissemination and implementation research. In: Brownson R, Colditz G, Proctor E, editors. Dissemination and implementation research in health: translating science to practice. Oxford: Oxford University Press; 2012. p. 261–80.CrossRef Proctor E, Brownson R. Measurement issues in dissemination and implementation research. In: Brownson R, Colditz G, Proctor E, editors. Dissemination and implementation research in health: translating science to practice. Oxford: Oxford University Press; 2012. p. 261–80.CrossRef
Metadata
Title
Process evaluation of a behaviour change approach to improving clinical practice for detecting hereditary cancer
Authors
Janet C. Long
Teresa Winata
Deborah Debono
Kim-Chi Phan-Thien
Christine Zhu
Natalie Taylor
Publication date
01-12-2019
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2019
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-019-3985-5

Other articles of this Issue 1/2019

BMC Health Services Research 1/2019 Go to the issue