Skip to main content
Top
Published in: BMC Medicine 1/2018

Open Access 01-12-2018 | Research article

Analysing the role of complexity in explaining the fortunes of technology programmes: empirical application of the NASSS framework

Authors: Trisha Greenhalgh, Joe Wherton, Chrysanthi Papoutsi, Jenni Lynch, Gemma Hughes, Christine A’Court, Sue Hinder, Rob Procter, Sara Shaw

Published in: BMC Medicine | Issue 1/2018

Login to get access

Abstract

Background

Failures and partial successes are common in technology-supported innovation programmes in health and social care. Complexity theory can help explain why. Phenomena may be simple (straightforward, predictable, few components), complicated (multiple interacting components or issues) or complex (dynamic, unpredictable, not easily disaggregated into constituent components). The recently published NASSS framework applies this taxonomy to explain Non-adoption or Abandonment of technology by individuals and difficulties achieving Scale-up, Spread and Sustainability. This paper reports the first empirical application of the NASSS framework.

Methods

Six technology-supported programmes were studied using ethnography and action research for up to 3 years across 20 health and care organisations and 10 national-level bodies. They comprised video outpatient consultations, GPS tracking technology for cognitive impairment, pendant alarm services, remote biomarker monitoring for heart failure, care organising software and integrated case management via data warehousing. Data were collected at three levels: micro (individual technology users), meso (organisational processes and systems) and macro (national policy and wider context). Data analysis and synthesis were guided by socio-technical theories and organised around the seven NASSS domains: (1) the condition or illness, (2) the technology, (3) the value proposition, (4) the adopter system (professional staff, patients and lay carers), (5) the organisation(s), (6) the wider (institutional and societal) system and (7) interaction and mutual adaptation among all these domains over time.

Results

The study generated more than 400 h of ethnographic observation, 165 semi-structured interviews and 200 documents. The six case studies raised multiple challenges across all seven domains. Complexity was a common feature of all programmes. In particular, individuals’ health and care needs were often complex and hence unpredictable and ‘off algorithm’. Programmes in which multiple domains were complicated proved difficult, slow and expensive to implement. Those in which multiple domains were complex did not become mainstreamed (or, if mainstreamed, did not deliver key intended outputs).

Conclusion

The NASSS framework helped explain the successes, failures and changing fortunes of this diverse sample of technology-supported programmes. Since failure is often linked to complexity across multiple NASSS domains, further research should systematically address ways to reduce complexity and/or manage programme implementation to take account of it.
Literature
2.
go back to reference Honeyman M, Dunn P, McKenna H. A Digital NHS? An introduction to the digital agenda and plans for implementation. London: King's Fund; 2014. Honeyman M, Dunn P, McKenna H. A Digital NHS? An introduction to the digital agenda and plans for implementation. London: King's Fund; 2014.
3.
go back to reference Wachter R. Making IT Work: harnessing the power of health information technology to improve care in England. Report to the National Advisory Group on Health Information Technology in England. London: The Stationery Office; 2016. Wachter R. Making IT Work: harnessing the power of health information technology to improve care in England. Report to the National Advisory Group on Health Information Technology in England. London: The Stationery Office; 2016.
4.
go back to reference National Information Board. Personalised health and care 2020: using data andtechnology to transform outcomes for patients and citizens. London: The Stationery Office; 2014. National Information Board. Personalised health and care 2020: using data andtechnology to transform outcomes for patients and citizens. London: The Stationery Office; 2014.
5.
go back to reference Department of Health. Digital strategy: leading the culture change in health and care. London: DH; 2012. Department of Health. Digital strategy: leading the culture change in health and care. London: DH; 2012.
6.
go back to reference Lehoux P, Miller F, Daudelin G, Urbach D. How venture capitalists decide which new medical technologies come to exist. Sci Public Policy. 2016;43(3):375–85.CrossRef Lehoux P, Miller F, Daudelin G, Urbach D. How venture capitalists decide which new medical technologies come to exist. Sci Public Policy. 2016;43(3):375–85.CrossRef
7.
go back to reference Greenhalgh T, Procter R, Wherton J, Sugarhood P, Hinder S, Rouncefield M. What is quality in assisted living technology? The ARCHIE framework for effective telehealth and telecare services. BMC Med. 2015;13:91.CrossRefPubMedPubMedCentral Greenhalgh T, Procter R, Wherton J, Sugarhood P, Hinder S, Rouncefield M. What is quality in assisted living technology? The ARCHIE framework for effective telehealth and telecare services. BMC Med. 2015;13:91.CrossRefPubMedPubMedCentral
8.
go back to reference Bentley CL, Powell LA, Orrell A, Mountain GA. Addressing design and suitability barriers to Telecare use: has anything changed? Technol Disabil. 2014;26(4):221–35. Bentley CL, Powell LA, Orrell A, Mountain GA. Addressing design and suitability barriers to Telecare use: has anything changed? Technol Disabil. 2014;26(4):221–35.
9.
go back to reference Clark J, McGee-Lennon M. A stakeholder-centred exploration of the current barriers to the uptake of home care technology in the UK. J Assist Technol. 2011;5(1):12–25.CrossRef Clark J, McGee-Lennon M. A stakeholder-centred exploration of the current barriers to the uptake of home care technology in the UK. J Assist Technol. 2011;5(1):12–25.CrossRef
11.
go back to reference Harrison MI, Koppel R, Bar-Lev S. Unintended consequences of information technologies in health care—an interactive sociotechnical analysis. J Am Med Inform Assoc. 2007;14(5):542–9.CrossRefPubMedPubMedCentral Harrison MI, Koppel R, Bar-Lev S. Unintended consequences of information technologies in health care—an interactive sociotechnical analysis. J Am Med Inform Assoc. 2007;14(5):542–9.CrossRefPubMedPubMedCentral
12.
go back to reference Symon G, Long K, Ellis J. The coordination of work activities: cooperation and conflict in a hospital context. Comput Supported Coop Work (CSCW). 1996;5(1):1–31.CrossRef Symon G, Long K, Ellis J. The coordination of work activities: cooperation and conflict in a hospital context. Comput Supported Coop Work (CSCW). 1996;5(1):1–31.CrossRef
13.
go back to reference Han YY, Carcillo JA, Venkataraman ST, Clark RS, Watson RS, Nguyen TC, Bayir H, Orr RA. Unexpected increased mortality after implementation of a commercially sold computerized physician order entry system. Pediatrics. 2005;116(6):1506–12.CrossRefPubMed Han YY, Carcillo JA, Venkataraman ST, Clark RS, Watson RS, Nguyen TC, Bayir H, Orr RA. Unexpected increased mortality after implementation of a commercially sold computerized physician order entry system. Pediatrics. 2005;116(6):1506–12.CrossRefPubMed
14.
go back to reference van Limburg M, van Gemert-Pijnen JE, Nijland N, Ossebaard HC, Hendrix RM, Seydel ER. Why business modeling is crucial in the development of eHealth technologies. J Med Internet Res. 2011;13(4):e124.CrossRefPubMedPubMedCentral van Limburg M, van Gemert-Pijnen JE, Nijland N, Ossebaard HC, Hendrix RM, Seydel ER. Why business modeling is crucial in the development of eHealth technologies. J Med Internet Res. 2011;13(4):e124.CrossRefPubMedPubMedCentral
15.
go back to reference Grin J, Rotmans J, Schot J. Transitions to sustainable development: new directions in the study of long term transformative change. New York: Routledge; 2010.CrossRef Grin J, Rotmans J, Schot J. Transitions to sustainable development: new directions in the study of long term transformative change. New York: Routledge; 2010.CrossRef
16.
go back to reference Greenhalgh T, Wherton J, Papoutsi C, Lynch J, Hughes G, A'Court C, Hinder S, Fahy N, Procter R, Shaw S. Beyond adoption: a new framework for theorizing and evaluating nonadoption, abandonment, and challenges to the scale-up, spread, and sustainability of health and care technologies. J Med Internet Res. 2017;19(11):e367.CrossRefPubMedPubMedCentral Greenhalgh T, Wherton J, Papoutsi C, Lynch J, Hughes G, A'Court C, Hinder S, Fahy N, Procter R, Shaw S. Beyond adoption: a new framework for theorizing and evaluating nonadoption, abandonment, and challenges to the scale-up, spread, and sustainability of health and care technologies. J Med Internet Res. 2017;19(11):e367.CrossRefPubMedPubMedCentral
17.
go back to reference Rogers EM. Diffusion of innovations. New York: Simon and Schuster; 2010. Rogers EM. Diffusion of innovations. New York: Simon and Schuster; 2010.
18.
go back to reference Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. The Milbank quarterly. 2004;82(4):581–629.CrossRefPubMedPubMedCentral Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. The Milbank quarterly. 2004;82(4):581–629.CrossRefPubMedPubMedCentral
19.
go back to reference Lehoux P, Miller FA, Daudelin G, Denis J-L. Providing value to new health technology: the early contribution of entrepreneurs, investors, and regulatory agencies. Int J Health Policy Manag. 2017;6(x):1–10. Lehoux P, Miller FA, Daudelin G, Denis J-L. Providing value to new health technology: the early contribution of entrepreneurs, investors, and regulatory agencies. Int J Health Policy Manag. 2017;6(x):1–10.
20.
go back to reference May CR, Eton DT, Boehmer K, Gallacher K, Hunt K, MacDonald S, Mair FS, May CM, Montori VM, Richardson A. Rethinking the patient: using Burden of Treatment Theory to understand the changing dynamics of illness. BMC Health Serv Res. 2014;14(1):1.CrossRef May CR, Eton DT, Boehmer K, Gallacher K, Hunt K, MacDonald S, Mair FS, May CM, Montori VM, Richardson A. Rethinking the patient: using Burden of Treatment Theory to understand the changing dynamics of illness. BMC Health Serv Res. 2014;14(1):1.CrossRef
21.
go back to reference Greenhalgh T, Swinglehurst D, Stones R. Rethinking ‘resistance’ to big IT: a sociological study of why and when healthcare staff do not use nationally mandated information and communication technologies. Health Services and Delivery Research. 2014;39(2):1–86.CrossRef Greenhalgh T, Swinglehurst D, Stones R. Rethinking ‘resistance’ to big IT: a sociological study of why and when healthcare staff do not use nationally mandated information and communication technologies. Health Services and Delivery Research. 2014;39(2):1–86.CrossRef
22.
go back to reference May C, Finch T. Implementing, embedding, and integrating practices: an outline of normalization process theory. Sociology. 2009;43(3):535–54.CrossRef May C, Finch T. Implementing, embedding, and integrating practices: an outline of normalization process theory. Sociology. 2009;43(3):535–54.CrossRef
23.
go back to reference Weick KE. Technology as equivoque: sensemaking in new technologies. In: Goodman PS, Sproull LS, editors. Technology and organizations. San Francisco: Jossey-Bass; 1990. p. 1–44. Weick KE. Technology as equivoque: sensemaking in new technologies. In: Goodman PS, Sproull LS, editors. Technology and organizations. San Francisco: Jossey-Bass; 1990. p. 1–44.
24.
go back to reference Cherns A. Principles of sociotechnical design revisted. Human relations. 1987;40(3):153–61.CrossRef Cherns A. Principles of sociotechnical design revisted. Human relations. 1987;40(3):153–61.CrossRef
25.
go back to reference Berg M. Patient care information systems and health care work: a sociotechnical approach. Int J Med Inform. 1999;55(2):87–101.CrossRefPubMed Berg M. Patient care information systems and health care work: a sociotechnical approach. Int J Med Inform. 1999;55(2):87–101.CrossRefPubMed
26.
go back to reference Nemeth C, Wears R, Woods D, Hollnagel E, Cook R: Minding the gaps: creating resilience in health care. In: Henriksen K, Battles JB, Keyes MA, Grady ML, Advances in patient safety: new directions and alternative approaches. Vol. 3. Rockville: Agency for Healthcare Research and Quality; 2008. Nemeth C, Wears R, Woods D, Hollnagel E, Cook R: Minding the gaps: creating resilience in health care. In: Henriksen K, Battles JB, Keyes MA, Grady ML, Advances in patient safety: new directions and alternative approaches. Vol. 3. Rockville: Agency for Healthcare Research and Quality; 2008.
27.
go back to reference Chambers DA, Glasgow RE, Stange KC. The dynamic sustainability framework: addressing the paradox of sustainment amid ongoing change. Implement Sci. 2013;8(1):117.CrossRefPubMedPubMedCentral Chambers DA, Glasgow RE, Stange KC. The dynamic sustainability framework: addressing the paradox of sustainment amid ongoing change. Implement Sci. 2013;8(1):117.CrossRefPubMedPubMedCentral
28.
go back to reference Cho S, Mathiassen L, Robey D. The dialectics of resilience: a multilevel analysis of a telehealth innovation. The Transfer and Diffusion of Information Technology for Organizational Resilience; 2006. p. 339–57.CrossRef Cho S, Mathiassen L, Robey D. The dialectics of resilience: a multilevel analysis of a telehealth innovation. The Transfer and Diffusion of Information Technology for Organizational Resilience; 2006. p. 339–57.CrossRef
30.
go back to reference van Gemert-Pijnen JE, Nijland N, van Limburg M, Ossebaard HC, Kelders SM, Eysenbach G, Seydel ER. A holistic framework to improve the uptake and impact of eHealth technologies. J Med Internet Res. 2011;13(4):e111.CrossRefPubMedPubMedCentral van Gemert-Pijnen JE, Nijland N, van Limburg M, Ossebaard HC, Kelders SM, Eysenbach G, Seydel ER. A holistic framework to improve the uptake and impact of eHealth technologies. J Med Internet Res. 2011;13(4):e111.CrossRefPubMedPubMedCentral
31.
go back to reference Greenhalgh T, Vijayaraghavan S, Wherton J, Shaw S, Byrne E, Campbell-Richards D, Bhattacharya S, Hanson P, Ramoutar S, Gutteridge C, et al. Virtual online consultations: advantages and limitations (VOCAL) study. BMJ Open. 2016;6(1):e009388.CrossRefPubMedPubMedCentral Greenhalgh T, Vijayaraghavan S, Wherton J, Shaw S, Byrne E, Campbell-Richards D, Bhattacharya S, Hanson P, Ramoutar S, Gutteridge C, et al. Virtual online consultations: advantages and limitations (VOCAL) study. BMJ Open. 2016;6(1):e009388.CrossRefPubMedPubMedCentral
32.
go back to reference Greenhalgh T, Shaw S, Wherton J, Hughes G, Lynch J, A'Court C, Hinder S, Fahy N, Byrne E, Finlayson A, et al. SCALS: a fourth-generation study of assisted living technologies in their organisational, social, political and policy context. BMJ Open. 2016;6(2):e010208.CrossRefPubMedPubMedCentral Greenhalgh T, Shaw S, Wherton J, Hughes G, Lynch J, A'Court C, Hinder S, Fahy N, Byrne E, Finlayson A, et al. SCALS: a fourth-generation study of assisted living technologies in their organisational, social, political and policy context. BMJ Open. 2016;6(2):e010208.CrossRefPubMedPubMedCentral
34.
go back to reference Cohn S, Clinch M, Bunn C, Stronge P. Entangled complexity: why complex interventions are just not complicated enough. J Health Serv Res Policy. 2013;18(1):40–3.CrossRefPubMed Cohn S, Clinch M, Bunn C, Stronge P. Entangled complexity: why complex interventions are just not complicated enough. J Health Serv Res Policy. 2013;18(1):40–3.CrossRefPubMed
35.
go back to reference Tsoukas H. Don't simplify, complexify: from disjunctive to conjunctive theorizing in organization and management studies. J Manag Stud. 2017;54(2):132–53.CrossRef Tsoukas H. Don't simplify, complexify: from disjunctive to conjunctive theorizing in organization and management studies. J Manag Stud. 2017;54(2):132–53.CrossRef
36.
go back to reference Maylor H, Turner N. Understand, reduce, respond: project complexity management theory and practice. Int J Oper Prod Manag. 2017;37(8):1076–93.CrossRef Maylor H, Turner N. Understand, reduce, respond: project complexity management theory and practice. Int J Oper Prod Manag. 2017;37(8):1076–93.CrossRef
37.
go back to reference Fitzgerald L, McDermott A. Challenging perspectives on organizational change in health care. London: Routledge; 2016. Fitzgerald L, McDermott A. Challenging perspectives on organizational change in health care. London: Routledge; 2016.
38.
go back to reference Shaw S, Wherton J, Vijayaraghavan S, Morris J, Bhattacharya S, Hanson P, Campbell-Richards D, Ramoutar S, Collard A, Hodkinson I et al: Virtual online consultations: advantages and limitations (VOCAL). A mixed-method study at micro, meso and macro level. Health Serv Deliv Res. 2017. In press. Shaw S, Wherton J, Vijayaraghavan S, Morris J, Bhattacharya S, Hanson P, Campbell-Richards D, Ramoutar S, Collard A, Hodkinson I et al: Virtual online consultations: advantages and limitations (VOCAL). A mixed-method study at micro, meso and macro level. Health Serv Deliv Res. 2017. In press.
39.
go back to reference Greenhalgh T, Shaw S, Wherton J, Vijayaraghavan S, Morris J, Bhattacharya S, Hanson P, Campbell-Richards D, Ramoutar S, Collard A, et al. Video outpatient consultations: a case study of real-world implementation at macro, meso and micro level. J Med Internet Res. 2018; in press Greenhalgh T, Shaw S, Wherton J, Vijayaraghavan S, Morris J, Bhattacharya S, Hanson P, Campbell-Richards D, Ramoutar S, Collard A, et al. Video outpatient consultations: a case study of real-world implementation at macro, meso and micro level. J Med Internet Res. 2018; in press
40.
go back to reference Procter R, Wherton J, Greenhalgh T, Sugarhood P, Rouncefield M, Hinder S. Telecare call centre work and ageing in place. Comput Supported Coop Work (CSCW); 2016;25(1):79-105. Procter R, Wherton J, Greenhalgh T, Sugarhood P, Rouncefield M, Hinder S. Telecare call centre work and ageing in place. Comput Supported Coop Work (CSCW); 2016;25(1):79-105.
41.
go back to reference Procter R, Greenhalgh T, Wherton J, Sugarhood P, Rouncefield M, Hinder S. The day-to-day co-production of ageing in place. Comput Supported Coop Work. 2014;23(3):245–67.CrossRef Procter R, Greenhalgh T, Wherton J, Sugarhood P, Rouncefield M, Hinder S. The day-to-day co-production of ageing in place. Comput Supported Coop Work. 2014;23(3):245–67.CrossRef
42.
go back to reference Triantafyllidis A, Velardo C, Chantler T, Shah SA, Paton C, Khorshidi R, Tarassenko L, Rahimi K. A personalised mobile-based home monitoring system for heart failure: the SUPPORT-HF Study. Int J Med Inform. 2015;84(10):743–53.CrossRefPubMed Triantafyllidis A, Velardo C, Chantler T, Shah SA, Paton C, Khorshidi R, Tarassenko L, Rahimi K. A personalised mobile-based home monitoring system for heart failure: the SUPPORT-HF Study. Int J Med Inform. 2015;84(10):743–53.CrossRefPubMed
43.
go back to reference Department of Health. Supporting people with long term conditions. London: Stationery Office; 2005. Department of Health. Supporting people with long term conditions. London: Stationery Office; 2005.
44.
go back to reference Stake RE. The art of case study research. Thousand Oaks: Sage; 1995. Stake RE. The art of case study research. Thousand Oaks: Sage; 1995.
45.
go back to reference Yin RK. Case study research: design and methods. Thousand Oaks: Sage Publications; 2013. Yin RK. Case study research: design and methods. Thousand Oaks: Sage Publications; 2013.
46.
49.
go back to reference Taylor J, Coates E, Brewster L, Mountain G, Wessels B, Hawley MS. Examining the use of telehealth in community nursing: identifying the factors affecting frontline staff acceptance and telehealth adoption. J Adv Nurs. 2015;71(2):326–37.CrossRefPubMed Taylor J, Coates E, Brewster L, Mountain G, Wessels B, Hawley MS. Examining the use of telehealth in community nursing: identifying the factors affecting frontline staff acceptance and telehealth adoption. J Adv Nurs. 2015;71(2):326–37.CrossRefPubMed
50.
go back to reference Llewellyn S, Procter R, Harvey G, Maniatopoulos G, Boyd A: Facilitating technology adoption in the NHS: negotiating the organisational and policy context—a qualitative study. 2014. Llewellyn S, Procter R, Harvey G, Maniatopoulos G, Boyd A: Facilitating technology adoption in the NHS: negotiating the organisational and policy context—a qualitative study. 2014.
51.
go back to reference Maniatopoulos G, Procter R, Llewellyn S, Harvey G, Boyd A. Moving beyond local practice: reconfiguring the adoption of a breast cancer diagnostic technology. Soc Sci Med. 2015;131:98–106.CrossRefPubMed Maniatopoulos G, Procter R, Llewellyn S, Harvey G, Boyd A. Moving beyond local practice: reconfiguring the adoption of a breast cancer diagnostic technology. Soc Sci Med. 2015;131:98–106.CrossRefPubMed
52.
go back to reference Hollnagel E, Braithwaite J, Wears RL. Resilient health care. New York: Ashgate Publishing, Ltd.; 2013. Hollnagel E, Braithwaite J, Wears RL. Resilient health care. New York: Ashgate Publishing, Ltd.; 2013.
55.
go back to reference Hartswood M, Procter R, Rouchy P, Rouncefield M, Slack R, Voss A. Working IT out in medical practice: IT systems design and development as co-realisation. Methods Inf Med. 2003;42(4):392–7.CrossRefPubMed Hartswood M, Procter R, Rouchy P, Rouncefield M, Slack R, Voss A. Working IT out in medical practice: IT systems design and development as co-realisation. Methods Inf Med. 2003;42(4):392–7.CrossRefPubMed
56.
go back to reference Williams R, Stewart J, Slack R. Social learning in technological innovation: experimenting with information and communication technologies. Northampton: Edward Elgar Publishing; 2005. Williams R, Stewart J, Slack R. Social learning in technological innovation: experimenting with information and communication technologies. Northampton: Edward Elgar Publishing; 2005.
57.
go back to reference Procter R, Rouncefield M, Poschen M, Lin Y, Voss A. Agile project management: a case study of a virtual research environment development project. Comput Supported Coop Work (CSCW). 2011;20(3):197–225.CrossRef Procter R, Rouncefield M, Poschen M, Lin Y, Voss A. Agile project management: a case study of a virtual research environment development project. Comput Supported Coop Work (CSCW). 2011;20(3):197–225.CrossRef
59.
go back to reference Wittgenstein L. Philosophical investigations (Manuscript, 1945–1949). Transl. from Philosophische Untersuchungen. Transl. by GEM Anscombe. Oxford: Basil Blackwell Publishers; 1958. Wittgenstein L. Philosophical investigations (Manuscript, 1945–1949). Transl. from Philosophische Untersuchungen. Transl. by GEM Anscombe. Oxford: Basil Blackwell Publishers; 1958.
60.
go back to reference Janssen M, Van Der Voort H, van Veenstra AF. Failure of large transformation projects from the viewpoint of complex adaptive systems: management principles for dealing with project dynamics. Inf Syst Front. 2015;17(1):15–29.CrossRef Janssen M, Van Der Voort H, van Veenstra AF. Failure of large transformation projects from the viewpoint of complex adaptive systems: management principles for dealing with project dynamics. Inf Syst Front. 2015;17(1):15–29.CrossRef
Metadata
Title
Analysing the role of complexity in explaining the fortunes of technology programmes: empirical application of the NASSS framework
Authors
Trisha Greenhalgh
Joe Wherton
Chrysanthi Papoutsi
Jenni Lynch
Gemma Hughes
Christine A’Court
Sue Hinder
Rob Procter
Sara Shaw
Publication date
01-12-2018
Publisher
BioMed Central
Published in
BMC Medicine / Issue 1/2018
Electronic ISSN: 1741-7015
DOI
https://doi.org/10.1186/s12916-018-1050-6

Other articles of this Issue 1/2018

BMC Medicine 1/2018 Go to the issue