Skip to main content
Top
Published in: BMC Health Services Research 1/2011

Open Access 01-12-2011 | Research article

Evaluating complex interventions and health technologies using normalization process theory: development of a simplified approach and web-enabled toolkit

Authors: Carl R May, Tracy Finch, Luciana Ballini, Anne MacFarlane, Frances Mair, Elizabeth Murray, Shaun Treweek, Tim Rapley

Published in: BMC Health Services Research | Issue 1/2011

Login to get access

Abstract

Background

Normalization Process Theory (NPT) can be used to explain implementation processes in health care relating to new technologies and complex interventions. This paper describes the processes by which we developed a simplified version of NPT for use by clinicians, managers, and policy makers, and which could be embedded in a web-enabled toolkit and on-line users manual.

Methods

Between 2006 and 2010 we undertook four tasks. (i) We presented NPT to potential and actual users in multiple workshops, seminars, and presentations. (ii) Using what we discovered from these meetings, we decided to create a simplified set of statements and explanations expressing core constructs of the theory (iii) We circulated these statements to a criterion sample of 60 researchers, clinicians and others, using SurveyMonkey to collect qualitative textual data about their criticisms of the statements. (iv) We then reconstructed the statements and explanations to meet users' criticisms, embedded them in a web-enabled toolkit, and beta tested this 'in the wild'.

Results

On-line data collection was effective: over a four week period 50/60 participants responded using SurveyMonkey (40/60) or direct phone and email contact (10/60). An additional nine responses were received from people who had been sent the SurveyMonkey form by other respondents. Beta testing of the web enabled toolkit produced 13 responses, from 327 visits to http://​www.​normalizationpro​cess.​org. Qualitative analysis of both sets of responses showed a high level of support for the statements but also showed that some statements poorly expressed their underlying constructs or overlapped with others. These were rewritten to take account of users' criticisms and then embedded in a web-enabled toolkit. As a result we were able translate the core constructs into a simplified set of statements that could be utilized by non-experts.

Conclusion

Normalization Process Theory has been developed through transparent procedures at each stage of its life. The theory has been shown to be sufficiently robust to merit formal testing. This project has provided a user friendly version of NPT that can be embedded in a web-enabled toolkit and used as a heuristic device to think through implementation and integration problems.
Appendix
Available only for authorised users
Literature
1.
go back to reference Campbell M, Fitzpatrick R, Haines A, Kinmonth A, Sandercock P, Spiegelhalter D, Tyrer P: Framework for design and evaluation of complex interventions to improve health. BMJ. 2000, 321: 694-696. 10.1136/bmj.321.7262.694.CrossRefPubMedPubMedCentral Campbell M, Fitzpatrick R, Haines A, Kinmonth A, Sandercock P, Spiegelhalter D, Tyrer P: Framework for design and evaluation of complex interventions to improve health. BMJ. 2000, 321: 694-696. 10.1136/bmj.321.7262.694.CrossRefPubMedPubMedCentral
2.
go back to reference Campbell NC, Murray E, Darbyshire J, Emery J, Farmer A, Griffiths F, Guthrie B, Lester H, Wilson P, Kinmonth AL: Designing and evaluating complex interventions to improve health care. Brit Med J. 2007, 334 (7591): 455-459. 10.1136/bmj.39108.379965.BE.CrossRefPubMedPubMedCentral Campbell NC, Murray E, Darbyshire J, Emery J, Farmer A, Griffiths F, Guthrie B, Lester H, Wilson P, Kinmonth AL: Designing and evaluating complex interventions to improve health care. Brit Med J. 2007, 334 (7591): 455-459. 10.1136/bmj.39108.379965.BE.CrossRefPubMedPubMedCentral
3.
go back to reference Angus D, Brouwers M, Driedger M, Eccles M, Francis J, Godin G, Graham I, Grimshaw J, Hanna S, Harrison MB, et al: Designing theoretically-informed implementation interventions The Improved Clinical Effectiveness through Behavioural Research Group (ICEBeRG). Implement Sci. 2006, 1. Angus D, Brouwers M, Driedger M, Eccles M, Francis J, Godin G, Graham I, Grimshaw J, Hanna S, Harrison MB, et al: Designing theoretically-informed implementation interventions The Improved Clinical Effectiveness through Behavioural Research Group (ICEBeRG). Implement Sci. 2006, 1.
4.
go back to reference Grol RP, Bosch M, Hulscher M, Eccles M, Wensing M: Planning and studying improvement in patient care: the use of theoretical perspectives. Milbank Quarterly. 2007, 85 (1): 93-138. 10.1111/j.1468-0009.2007.00478.x.CrossRefPubMedPubMedCentral Grol RP, Bosch M, Hulscher M, Eccles M, Wensing M: Planning and studying improvement in patient care: the use of theoretical perspectives. Milbank Quarterly. 2007, 85 (1): 93-138. 10.1111/j.1468-0009.2007.00478.x.CrossRefPubMedPubMedCentral
5.
go back to reference Goldthorpe JH: On Sociology: Critique and Program. 2006, Stanford: Stanford University Press Goldthorpe JH: On Sociology: Critique and Program. 2006, Stanford: Stanford University Press
6.
go back to reference Hechter M, Horne C: Theory is explanation. Theories of social order. Edited by: Hechter M, Horne C. 2003, Stanford CA, Stanford University Press Hechter M, Horne C: Theory is explanation. Theories of social order. Edited by: Hechter M, Horne C. 2003, Stanford CA, Stanford University Press
7.
go back to reference May C, Finch T: Implementation, embedding, and integration: an outline of Normalization Process Theory. Sociology. 2009, 43 (3): 535-554.CrossRef May C, Finch T: Implementation, embedding, and integration: an outline of Normalization Process Theory. Sociology. 2009, 43 (3): 535-554.CrossRef
8.
go back to reference May C: 2006 A rational model for assessing and evaluating complex interventions in health care. BMC Health Services Research. 2006, 6: 86-10.1186/1472-6963-6-86.CrossRefPubMedPubMedCentral May C: 2006 A rational model for assessing and evaluating complex interventions in health care. BMC Health Services Research. 2006, 6: 86-10.1186/1472-6963-6-86.CrossRefPubMedPubMedCentral
9.
go back to reference May C, Finch T, Mair F, Ballini L, Dowrick C, Eccles M, Gask L, MacFarlane A, Murray E, Rapley T, Rogers A, Treweek S, Wallace P, Anderson G, Burns J, Heaven B: Understanding the implementation of complex interventions in health care: the normalization process model. BMC Health Services Research. 2007, 7: 148-10.1186/1472-6963-7-148.CrossRefPubMedPubMedCentral May C, Finch T, Mair F, Ballini L, Dowrick C, Eccles M, Gask L, MacFarlane A, Murray E, Rapley T, Rogers A, Treweek S, Wallace P, Anderson G, Burns J, Heaven B: Understanding the implementation of complex interventions in health care: the normalization process model. BMC Health Services Research. 2007, 7: 148-10.1186/1472-6963-7-148.CrossRefPubMedPubMedCentral
10.
go back to reference Ajzen I: The theory of planned behavior. Organizational Behavior and Human Decision Processes. 1991, 50: 179-211. 10.1016/0749-5978(91)90020-T.CrossRef Ajzen I: The theory of planned behavior. Organizational Behavior and Human Decision Processes. 1991, 50: 179-211. 10.1016/0749-5978(91)90020-T.CrossRef
11.
go back to reference Rogers EM: The Diffusion of Innovations. 1995, New York: Free Press, 4 Rogers EM: The Diffusion of Innovations. 1995, New York: Free Press, 4
12.
go back to reference Latour B: Reassembling the Social: An Introduction to Actor Network Theory. 2005, Oxford: Oxford University Press Latour B: Reassembling the Social: An Introduction to Actor Network Theory. 2005, Oxford: Oxford University Press
13.
go back to reference Bunge M: How does it work? The search for explanatory mechanisms. Philosophy of the Social Sciences. 2004, 34 (2): 182-210. 10.1177/0048393103262550.CrossRef Bunge M: How does it work? The search for explanatory mechanisms. Philosophy of the Social Sciences. 2004, 34 (2): 182-210. 10.1177/0048393103262550.CrossRef
14.
go back to reference Gerring J: The mechanismic worldview: Thinking inside the box. British Journal of Political Science. 2008, 38: 161-179.CrossRef Gerring J: The mechanismic worldview: Thinking inside the box. British Journal of Political Science. 2008, 38: 161-179.CrossRef
15.
go back to reference Lieberson S, Lynn FB: Barking up the wrong branch: Scientific alternatives to the current model of sociological science. Annual Review of Sociology. 2002, 28: 1-19. 10.1146/annurev.soc.28.110601.141122.CrossRef Lieberson S, Lynn FB: Barking up the wrong branch: Scientific alternatives to the current model of sociological science. Annual Review of Sociology. 2002, 28: 1-19. 10.1146/annurev.soc.28.110601.141122.CrossRef
16.
go back to reference Gask L, Lever-Green G, Hays R: Dissemination and implementation of suicide prevention training in one Scottish region. BMC Health Serv Res. 2008, 8. Gask L, Lever-Green G, Hays R: Dissemination and implementation of suicide prevention training in one Scottish region. BMC Health Serv Res. 2008, 8.
17.
go back to reference Gask L, Rogers A, Campbell S, Sheaff R: Beyond the limits of clinical governance? The case of mental health in English primary care. BMC Health Serv Res. 2008, 8. Gask L, Rogers A, Campbell S, Sheaff R: Beyond the limits of clinical governance? The case of mental health in English primary care. BMC Health Serv Res. 2008, 8.
18.
go back to reference May CR, Montori VM, Mair F: Understanding patients' experiences of treatment burden in chronic heart failure using normalization process theory. Annals of Family Medicine. May CR, Montori VM, Mair F: Understanding patients' experiences of treatment burden in chronic heart failure using normalization process theory. Annals of Family Medicine.
19.
go back to reference Coburn NG, Guller U, Baxter NN, Kiss A, Ringash J, Swallow CJ, Law CHL: Adjuvant therapy for resected gastric cancer-rapid, yet incomplete adoption following results of intergroup 0116 trial. Int J Radiat Oncol Biol Phys. 2008, 70 (4): 1073-1080. 10.1016/j.ijrobp.2007.07.2378.CrossRefPubMed Coburn NG, Guller U, Baxter NN, Kiss A, Ringash J, Swallow CJ, Law CHL: Adjuvant therapy for resected gastric cancer-rapid, yet incomplete adoption following results of intergroup 0116 trial. Int J Radiat Oncol Biol Phys. 2008, 70 (4): 1073-1080. 10.1016/j.ijrobp.2007.07.2378.CrossRefPubMed
20.
go back to reference Kirsh S, Lawrence R, Aron D: Tailoring an intervention to the context and system redesign related to the intervention: A case study of implementing shared medical appointments for diabetes. Implementation Science. 2008, 3: article 34.CrossRef Kirsh S, Lawrence R, Aron D: Tailoring an intervention to the context and system redesign related to the intervention: A case study of implementing shared medical appointments for diabetes. Implementation Science. 2008, 3: article 34.CrossRef
21.
go back to reference May C, Mair F, Dowrick C, Finch T: Process evaluation for complex interventions in primary care: understanding trials using the normalization process model. BMC Family Practice. 2007, 8: 42-10.1186/1471-2296-8-42.CrossRefPubMedPubMedCentral May C, Mair F, Dowrick C, Finch T: Process evaluation for complex interventions in primary care: understanding trials using the normalization process model. BMC Family Practice. 2007, 8: 42-10.1186/1471-2296-8-42.CrossRefPubMedPubMedCentral
22.
go back to reference Speed C, Heaven B, Adamson A, Bond J, Corbett S, Lake AA, May C, Vanoli A, McMeekin P, Moynihan P, et al: LIFELAX - diet and LIFEstyle versus LAXatives in the management of chronic constipation in older people: randomised controlled trial. Health Technol Assess. 2010, 14 (52): 1-+.CrossRefPubMed Speed C, Heaven B, Adamson A, Bond J, Corbett S, Lake AA, May C, Vanoli A, McMeekin P, Moynihan P, et al: LIFELAX - diet and LIFEstyle versus LAXatives in the management of chronic constipation in older people: randomised controlled trial. Health Technol Assess. 2010, 14 (52): 1-+.CrossRefPubMed
23.
go back to reference Gask L, Bower P, Lovell K, Escott D, Archer J, Gilbody S, Lankshear A, Simpson A, Richards D: What work has to be done to implement collaborative care for depression? Process evaluation of a trial utilizing the Normalization Process Model. Implement Sci. 2010, 5 (15). Gask L, Bower P, Lovell K, Escott D, Archer J, Gilbody S, Lankshear A, Simpson A, Richards D: What work has to be done to implement collaborative care for depression? Process evaluation of a trial utilizing the Normalization Process Model. Implement Sci. 2010, 5 (15).
24.
go back to reference Gunn JM, Palmer VJ, Dowrick CF, Herrman HE, Griffiths FE, Kokanovic R, Blashki GA, Hegarty KL, Johnson CL, Potiriadis M, et al: Embedding effective depression care: using theory for primary care organisational and systems change. Implement Sci. 2010, 5. Gunn JM, Palmer VJ, Dowrick CF, Herrman HE, Griffiths FE, Kokanovic R, Blashki GA, Hegarty KL, Johnson CL, Potiriadis M, et al: Embedding effective depression care: using theory for primary care organisational and systems change. Implement Sci. 2010, 5.
25.
go back to reference Kennedy A, Chew-Graham CA, Blakeman T, Bowen A, Gardner C, Protheroe J, Rogers A, Gask L: Delivering the WISE (Whole Systems Informing Self-Management Engagement) training package in primary care: learning from formative evaluation. Implement Sci. 2010, 5 (7). Kennedy A, Chew-Graham CA, Blakeman T, Bowen A, Gardner C, Protheroe J, Rogers A, Gask L: Delivering the WISE (Whole Systems Informing Self-Management Engagement) training package in primary care: learning from formative evaluation. Implement Sci. 2010, 5 (7).
26.
go back to reference Pencille LJ, Campbell ME, Van Houten HK, Shah ND, Mullan RJ, Swiglo BA, Breslin M, Kesman RL, Tulledge-Scheitel SM, Jaeger TM, et al: Protocol for the Osteoporosis Choice trial. A pilot randomized trial of a decision aid in primary care practice. Trials. 2009, 10. Pencille LJ, Campbell ME, Van Houten HK, Shah ND, Mullan RJ, Swiglo BA, Breslin M, Kesman RL, Tulledge-Scheitel SM, Jaeger TM, et al: Protocol for the Osteoporosis Choice trial. A pilot randomized trial of a decision aid in primary care practice. Trials. 2009, 10.
27.
go back to reference Elwyn G, Légaré F, van der Weijden T, Edwards A, May C: Arduous implementation: does the Normalisation Process Model explain why it's so difficult to embed decision support technologies for patients in routine clinical practice. Implement Science. 2008, 3: 57-10.1186/1748-5908-3-57.CrossRef Elwyn G, Légaré F, van der Weijden T, Edwards A, May C: Arduous implementation: does the Normalisation Process Model explain why it's so difficult to embed decision support technologies for patients in routine clinical practice. Implement Science. 2008, 3: 57-10.1186/1748-5908-3-57.CrossRef
28.
go back to reference Mair FS, Hiscock J, Beaton SC: Understanding factors that inhibit or promote the utilization of telecare in chronic lung disease. Chronic Illness. 2008, 4 (2): 110-7. 10.1177/1742395308092482.CrossRefPubMed Mair FS, Hiscock J, Beaton SC: Understanding factors that inhibit or promote the utilization of telecare in chronic lung disease. Chronic Illness. 2008, 4 (2): 110-7. 10.1177/1742395308092482.CrossRefPubMed
29.
go back to reference King G, Richards H, Godden D: Adoption of telemedicine in Scottish remote and rural general practices: a qualitative study. Journal of Telemedicine and Telecare. 2007, 13 (8): 382-6. 10.1258/135763307783064430.CrossRefPubMed King G, Richards H, Godden D: Adoption of telemedicine in Scottish remote and rural general practices: a qualitative study. Journal of Telemedicine and Telecare. 2007, 13 (8): 382-6. 10.1258/135763307783064430.CrossRefPubMed
30.
go back to reference Gagnon M-P, Legare F, Fortin J-P, Labrecque M, Lamothe L, Duplantie J: An integrated strategy of knowledge application for optimal e-health implementation: A multi method study protocol. BMC Medical Informatics and Decision Making. 2008, 8: article 17.CrossRef Gagnon M-P, Legare F, Fortin J-P, Labrecque M, Lamothe L, Duplantie J: An integrated strategy of knowledge application for optimal e-health implementation: A multi method study protocol. BMC Medical Informatics and Decision Making. 2008, 8: article 17.CrossRef
31.
go back to reference Obstfelder A, Engeseth KH, Wynn R: Characteristics of successfully implemented telemedical applications. Implementation Science. 2007, 2: article 25.CrossRef Obstfelder A, Engeseth KH, Wynn R: Characteristics of successfully implemented telemedical applications. Implementation Science. 2007, 2: article 25.CrossRef
32.
go back to reference Boddy D, King G, Clark J, Heaney D, Mair F: The influence of context and process when implementing e-health. BMC Medical Informatics and Decision Making. 2009, 9 (1): 9-10.1186/1472-6947-9-9.CrossRefPubMedPubMedCentral Boddy D, King G, Clark J, Heaney D, Mair F: The influence of context and process when implementing e-health. BMC Medical Informatics and Decision Making. 2009, 9 (1): 9-10.1186/1472-6947-9-9.CrossRefPubMedPubMedCentral
33.
go back to reference Murray E, Burns J, May C, Finch T, O'Donnell C, Wallace P, Mair F: Why is it difficult to implement e-health initiatives? A qualitative study. Implementation Science. Murray E, Burns J, May C, Finch T, O'Donnell C, Wallace P, Mair F: Why is it difficult to implement e-health initiatives? A qualitative study. Implementation Science.
34.
go back to reference Gagnon MP, Legare F, Fortin JP, Lamothe L, Labrecque M, Duplantie J: An integrated strategy of knowledge application for optimal e-health implementation: A multi-method study protocol. BMC Med Inform Decis Mak. 2008, 8. Gagnon MP, Legare F, Fortin JP, Lamothe L, Labrecque M, Duplantie J: An integrated strategy of knowledge application for optimal e-health implementation: A multi-method study protocol. BMC Med Inform Decis Mak. 2008, 8.
35.
go back to reference Halford S, Obstfelder A, Lotherington AT: Changing the record: the inter-professional, subjective and embodied effects of electronic patient records. New Technol Work Employ. 2010, 25 (3): 210-222. 10.1111/j.1468-005X.2010.00249.x.CrossRef Halford S, Obstfelder A, Lotherington AT: Changing the record: the inter-professional, subjective and embodied effects of electronic patient records. New Technol Work Employ. 2010, 25 (3): 210-222. 10.1111/j.1468-005X.2010.00249.x.CrossRef
36.
go back to reference King G, Richards H, Godden D: Adoption of telemedicine in Scottish remote and rural general practices: a qualitative study. J Telemed Telecare. 2007, 13 (8): 382-386. 10.1258/135763307783064430.CrossRefPubMed King G, Richards H, Godden D: Adoption of telemedicine in Scottish remote and rural general practices: a qualitative study. J Telemed Telecare. 2007, 13 (8): 382-386. 10.1258/135763307783064430.CrossRefPubMed
37.
go back to reference Boddy D, King G, Clark J, Heaney D, Mair F: The influence of context and process when implementing e-health. Bmc Med Inform Decis. 2009, 9 (1): 9-10.1186/1472-6947-9-9.CrossRef Boddy D, King G, Clark J, Heaney D, Mair F: The influence of context and process when implementing e-health. Bmc Med Inform Decis. 2009, 9 (1): 9-10.1186/1472-6947-9-9.CrossRef
38.
go back to reference Murray E, Burns J, May C, Finch T, O'Donnell C, Wallace P, Mair F: Why is it difficult to implement e-health initiatives? A qualitative study. Implement Sci. 2011, 6. Murray E, Burns J, May C, Finch T, O'Donnell C, Wallace P, Mair F: Why is it difficult to implement e-health initiatives? A qualitative study. Implement Sci. 2011, 6.
39.
go back to reference Stinchcombe A: Constructing social theories. 1968, New York: Harcourt, Brace and World Stinchcombe A: Constructing social theories. 1968, New York: Harcourt, Brace and World
40.
go back to reference May C, Mair FS, Finch T, MacFarlane A, Dowrick C, Treweek S, Rapley T, Ballini L, Ong BN, Rogers A, et al: Development of a theory of implementation and integration: Normalization Process Theory. Implement Sci. 2009, 4 (29). May C, Mair FS, Finch T, MacFarlane A, Dowrick C, Treweek S, Rapley T, Ballini L, Ong BN, Rogers A, et al: Development of a theory of implementation and integration: Normalization Process Theory. Implement Sci. 2009, 4 (29).
41.
go back to reference Mair F, May C, Murray E, Finch T, Anderson G, O'Donnell C, Wallace P, Sullivan F: Understanding the Implementation and Integration of E-Health Services London: National Co-ordinating. 2009, Centre for the National Institute for Health Research Service Delivery and Organisation Programme (NCCSDO) Mair F, May C, Murray E, Finch T, Anderson G, O'Donnell C, Wallace P, Sullivan F: Understanding the Implementation and Integration of E-Health Services London: National Co-ordinating. 2009, Centre for the National Institute for Health Research Service Delivery and Organisation Programme (NCCSDO)
42.
go back to reference May C, Finch T, Cornford J, Exley C, Gately C, Kirk S, Jenkings KN, Mair FS, Osbourne J, Robinson AL, et al: Integrating Telecare for Chronic Disease Management in the Community: What Needs to be Done?. 2009, London: NIHR May C, Finch T, Cornford J, Exley C, Gately C, Kirk S, Jenkings KN, Mair FS, Osbourne J, Robinson AL, et al: Integrating Telecare for Chronic Disease Management in the Community: What Needs to be Done?. 2009, London: NIHR
43.
go back to reference Ritchie J, Spencer L: Qualitative data analysis for applied policy research. Analysing Qualitative Data. Edited by: Bryman A, Burgess R. 1994, London: Routledge, 173-194.CrossRef Ritchie J, Spencer L: Qualitative data analysis for applied policy research. Analysing Qualitative Data. Edited by: Bryman A, Burgess R. 1994, London: Routledge, 173-194.CrossRef
44.
go back to reference Banister P, Burman E, Parker I, Taylor M, Tindall C: Qualitative methods in psychology. 1994, Buckingham: Open University Press Banister P, Burman E, Parker I, Taylor M, Tindall C: Qualitative methods in psychology. 1994, Buckingham: Open University Press
45.
go back to reference Murray E, May C, Mair F: Development and formative evaluation of the e-Health Implementation Toolkit (e-HIT). BMC Medical Informatics and Decision Making. 2010, 10 (61). Murray E, May C, Mair F: Development and formative evaluation of the e-Health Implementation Toolkit (e-HIT). BMC Medical Informatics and Decision Making. 2010, 10 (61).
46.
go back to reference Murray E, Treweek S, Pope C, MacFarlane A, Ballini L, Dowrick C, Finch T, Kennedy A, Mair F, O'Donnell C, et al: Normalisation Process Theory: a framework for developing, evaluating and implementing complex interventions. BMC Medicine. 2010, 8 (63). Murray E, Treweek S, Pope C, MacFarlane A, Ballini L, Dowrick C, Finch T, Kennedy A, Mair F, O'Donnell C, et al: Normalisation Process Theory: a framework for developing, evaluating and implementing complex interventions. BMC Medicine. 2010, 8 (63).
Metadata
Title
Evaluating complex interventions and health technologies using normalization process theory: development of a simplified approach and web-enabled toolkit
Authors
Carl R May
Tracy Finch
Luciana Ballini
Anne MacFarlane
Frances Mair
Elizabeth Murray
Shaun Treweek
Tim Rapley
Publication date
01-12-2011
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2011
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/1472-6963-11-245

Other articles of this Issue 1/2011

BMC Health Services Research 1/2011 Go to the issue