Skip to main content
Top
Published in: BMC Health Services Research 1/2019

Open Access 01-12-2019 | Care | Research article

The impact of a combinatorial digital and organisational intervention on the management of long-term conditions in UK primary care: a non-randomised evaluation

Authors: David G. Lugo-Palacios, Jonathan Hammond, Thomas Allen, Sarah Darley, Ruth McDonald, Thomas Blakeman, Peter Bower

Published in: BMC Health Services Research | Issue 1/2019

Login to get access

Abstract

Background

Better management of long-term conditions remains a policy priority, with a focus on improving outcomes and reducing use of expensive hospital services. A number of interventions have been tested, but many have failed to show benefit in rigorous comparative research. In 2016, the NHS Test Beds scheme was launched to implement and test interventions combining digital technologies and pathway redesign in routine health care settings, with each intervention comprising multiple innovations to better realise benefit from their ‘combinatorial’ effect. We present the evaluation of one of the NHS Test Beds, which combined risk stratification algorithms, practice-based quality improvement and health monitoring and coaching to improve management of long-term conditions in a single health economy in the north-west of England.

Methods

The NHS Test Bed was implemented in one clinical commissioning group in the north-west of England (patient population 235,800 served by 36 general practices). Routine administrative data on hospital use (the primary outcome) and a selection of secondary outcomes (data from both hospital and primary care) were collected in the intervention site, and from a comparator area in the same region. We used difference-in-differences analysis to compare outcomes in the NHS Test Bed area and the comparator after initiation of the combinatorial intervention.

Results

Tests confirmed the existence of parallel trends in the intervention and comparator sites for hospital outcomes for the period April 2016 to March 2017, and for some of the planned primary care outcomes. Based on 10 months of post-intervention secondary care data and 13 months post-intervention primary care data, we found no significant impact on primary outcomes between the intervention and comparator site, and a significant impact on only one secondary outcome.

Conclusion

A combinatorial digital and organisational intervention to improve the management of long-term conditions was implemented across a whole health economy, but we found no evidence of a positive impact on health care utilisation outcomes in hospital and primary care.
Appendix
Available only for authorised users
Literature
1.
go back to reference Stevens S. Five year forward view: NHS England; 2014. Stevens S. Five year forward view: NHS England; 2014.
2.
go back to reference Moussavi S, Chatterji S, Verdes E, Tandon A, Patel V, Ustun B. Depression, chronic diseases, and decrements in health: results from the world health surveys. Lancet. 2007;370:851–8.CrossRef Moussavi S, Chatterji S, Verdes E, Tandon A, Patel V, Ustun B. Depression, chronic diseases, and decrements in health: results from the world health surveys. Lancet. 2007;370:851–8.CrossRef
3.
go back to reference World Health Organisation. The global burden of disease: 2004 update. Geneva; 2009. World Health Organisation. The global burden of disease: 2004 update. Geneva; 2009.
4.
5.
go back to reference Campbell S, Hann M, Hacker J, Burns C, Oliver D, Thapar A, Mead N, Gelb Safran D, Roland M. Identifying predictors of high quality care in English general practice: observational study. Br Med J. 2001;323:784–7.CrossRef Campbell S, Hann M, Hacker J, Burns C, Oliver D, Thapar A, Mead N, Gelb Safran D, Roland M. Identifying predictors of high quality care in English general practice: observational study. Br Med J. 2001;323:784–7.CrossRef
7.
go back to reference Rick J, Rowe K, Hann M, Sibbald B, Reeves D, Roland M, Bower P. The patient assessment of chronic illness care measure: acceptability, reliability and validity in United Kingdom patients with long-term conditions. BMC Health Serv Res. 2012;12:293.CrossRef Rick J, Rowe K, Hann M, Sibbald B, Reeves D, Roland M, Bower P. The patient assessment of chronic illness care measure: acceptability, reliability and validity in United Kingdom patients with long-term conditions. BMC Health Serv Res. 2012;12:293.CrossRef
8.
go back to reference Roland M, Abel G. Reducing emergency admissions: are we on the right track? BMJ. 2012;345:e6017.CrossRef Roland M, Abel G. Reducing emergency admissions: are we on the right track? BMJ. 2012;345:e6017.CrossRef
9.
go back to reference Kennedy A, Reeves D, Bower P, Lee V, Middleton E, Richardson G, Gardner C, Gately C, Rogers A. The effectiveness and cost effectiveness of a national lay led self care support programme for patients with long-term conditions: a pragmatic randomised controlled trial. J Epidemiol Community Health. 2007;61:254–61.CrossRef Kennedy A, Reeves D, Bower P, Lee V, Middleton E, Richardson G, Gardner C, Gately C, Rogers A. The effectiveness and cost effectiveness of a national lay led self care support programme for patients with long-term conditions: a pragmatic randomised controlled trial. J Epidemiol Community Health. 2007;61:254–61.CrossRef
10.
go back to reference Reeves D, Hann M, Rick J, Rowe K, Small N, Burt J, Roland M, Protheroe J, Blakeman T, Richardson G, et al. Care plans and care planning in the management of long-term conditions in the United Kingdom: a controlled prospective cohort study. Br J Gen Pract. 2014;64(626):568–75.CrossRef Reeves D, Hann M, Rick J, Rowe K, Small N, Burt J, Roland M, Protheroe J, Blakeman T, Richardson G, et al. Care plans and care planning in the management of long-term conditions in the United Kingdom: a controlled prospective cohort study. Br J Gen Pract. 2014;64(626):568–75.CrossRef
11.
go back to reference Gravelle H, Dusheiko M, Sheaff R, Sargent P, Boaden R, Pickard S, Parker S, Roland M. Impact of case management (Evercare) on frail elderly patients: controlled before and after analysis of quantitative outcome data. BMJ. 2007;334:31.CrossRef Gravelle H, Dusheiko M, Sheaff R, Sargent P, Boaden R, Pickard S, Parker S, Roland M. Impact of case management (Evercare) on frail elderly patients: controlled before and after analysis of quantitative outcome data. BMJ. 2007;334:31.CrossRef
12.
go back to reference Campbell S, Reeves D, Kontopantelis E, Middleton E, Sibbald B, Roland M. Quality of primary care in England with the introduction of pay for performance. N Engl J Med. 2007;357(2):181–90.CrossRef Campbell S, Reeves D, Kontopantelis E, Middleton E, Sibbald B, Roland M. Quality of primary care in England with the introduction of pay for performance. N Engl J Med. 2007;357(2):181–90.CrossRef
13.
go back to reference Henderson C, Knapp M, Fernández J, Beecham J, Hirani S, Cartwright M, Rixon L, Beynon M, Rogers A, Bower P, et al. Cost effectiveness of telehealth for patients with long term conditions (whole systems demonstrator telehealth questionnaire study): nested economic evaluation in a pragmatic, cluster randomised controlled trial. BMJ. 2013;346:f1035.CrossRef Henderson C, Knapp M, Fernández J, Beecham J, Hirani S, Cartwright M, Rixon L, Beynon M, Rogers A, Bower P, et al. Cost effectiveness of telehealth for patients with long term conditions (whole systems demonstrator telehealth questionnaire study): nested economic evaluation in a pragmatic, cluster randomised controlled trial. BMJ. 2013;346:f1035.CrossRef
14.
go back to reference Baxter S, Johnson M, Chambers D, Sutton A, Goyder E, Booth A. Understanding new models of integrated care in developed countries: a systematic review. Health Serv Del Res. 2018;6:29. Baxter S, Johnson M, Chambers D, Sutton A, Goyder E, Booth A. Understanding new models of integrated care in developed countries: a systematic review. Health Serv Del Res. 2018;6:29.
15.
go back to reference Snooks H, Bailey-Jones K, Burge-Jones D, Dale J, Davies J, Evans B, Farr A, Fitzsimmons D, Harrison J, Heaven M, et al. Predictive risk stratification model: a randomised stepped-wedge trial in primary care (PRISMATIC). Health Serv Deliv Res. 2018;6:1.CrossRef Snooks H, Bailey-Jones K, Burge-Jones D, Dale J, Davies J, Evans B, Farr A, Fitzsimmons D, Harrison J, Heaven M, et al. Predictive risk stratification model: a randomised stepped-wedge trial in primary care (PRISMATIC). Health Serv Deliv Res. 2018;6:1.CrossRef
16.
go back to reference Stokes J, Panagioti M, Alam R, Checkland K, Cheraghi-Sohi S, Bower P. Effectiveness of case management for ‘at risk’ patients in primary care: a systematic review and meta-analysis. PLoS One. 2015;10(7):e0132340.CrossRef Stokes J, Panagioti M, Alam R, Checkland K, Cheraghi-Sohi S, Bower P. Effectiveness of case management for ‘at risk’ patients in primary care: a systematic review and meta-analysis. PLoS One. 2015;10(7):e0132340.CrossRef
19.
go back to reference Kennedy A, Rogers A, Bower P. Support for self care for patients with chronic disease. BMJ. 2007;335(7627):968–70.CrossRef Kennedy A, Rogers A, Bower P. Support for self care for patients with chronic disease. BMJ. 2007;335(7627):968–70.CrossRef
21.
go back to reference Ivers N, Jamtvedt G, Flottorp S, Young JM, Odgaard-Jensen J, French SD, O’Brien MA, Johansen M, Grimshaw J, Oxman AD. Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2012:6. Ivers N, Jamtvedt G, Flottorp S, Young JM, Odgaard-Jensen J, French SD, O’Brien MA, Johansen M, Grimshaw J, Oxman AD. Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2012:6.
22.
go back to reference Alagoz E, Chih M-Y, Hitchcock M, Brown R, Quanbeck A. The use of external change agents to promote quality improvement and organizational change in healthcare organizations: a systematic review. BMC Health Serv Res. 2018;18(1):42.CrossRef Alagoz E, Chih M-Y, Hitchcock M, Brown R, Quanbeck A. The use of external change agents to promote quality improvement and organizational change in healthcare organizations: a systematic review. BMC Health Serv Res. 2018;18(1):42.CrossRef
23.
go back to reference Irwin R, Stokes T, Marshall T. Practice-level quality improvement interventions in primary care: a review of systematic reviews. Prim Health Care Res Dev. 2015;16(6):556–77.CrossRef Irwin R, Stokes T, Marshall T. Practice-level quality improvement interventions in primary care: a review of systematic reviews. Prim Health Care Res Dev. 2015;16(6):556–77.CrossRef
24.
go back to reference Härter M, Dirmaier J, Dwinger S, Kriston L, Herbarth L, Siegmund-Schultze E, Bermejo I, Matschinger H, Heider D, König H-H. Effectiveness of telephone-based health coaching for patients with chronic conditions: a randomised controlled trial. PLoS One. 2016;11(9):e0161269.CrossRef Härter M, Dirmaier J, Dwinger S, Kriston L, Herbarth L, Siegmund-Schultze E, Bermejo I, Matschinger H, Heider D, König H-H. Effectiveness of telephone-based health coaching for patients with chronic conditions: a randomised controlled trial. PLoS One. 2016;11(9):e0161269.CrossRef
25.
go back to reference McLean S, Protti D, Sheikh A. Telehealthcare for long term conditions. BMJ. 2011;342:d120.CrossRef McLean S, Protti D, Sheikh A. Telehealthcare for long term conditions. BMJ. 2011;342:d120.CrossRef
26.
go back to reference McLean S, Nurmatov U, Liu JLY, Pagliari C, Car J, Sheikh A. Telehealthcare for chronic obstructive pulmonary disease. Cochrane Database Syst Rev. 2011;7. McLean S, Nurmatov U, Liu JLY, Pagliari C, Car J, Sheikh A. Telehealthcare for chronic obstructive pulmonary disease. Cochrane Database Syst Rev. 2011;7.
27.
go back to reference Hirani SP, Beynon M, Cartwright M, Rixon L, Doll H, Henderson C, Bardsley M, Steventon A, Knapp M, Rogers A, et al. The effect of telecare on the quality of life and psychological well-being of elderly recipients of social care over a 12-month period: the whole systems demonstrator cluster randomised trial. Age Ageing. 2014;43(3):334–41.CrossRef Hirani SP, Beynon M, Cartwright M, Rixon L, Doll H, Henderson C, Bardsley M, Steventon A, Knapp M, Rogers A, et al. The effect of telecare on the quality of life and psychological well-being of elderly recipients of social care over a 12-month period: the whole systems demonstrator cluster randomised trial. Age Ageing. 2014;43(3):334–41.CrossRef
28.
go back to reference Steventon A, Bardsley M, Billings J, Dixon J, Doll H, Hirani S, Cartwright M, Rixon L, Knapp M, Henderson C, et al. Effect of telehealth on use of secondary care and mortality: findings from the whole system demonstrator cluster randomised trial. BMJ. 2012;344:e3874.CrossRef Steventon A, Bardsley M, Billings J, Dixon J, Doll H, Hirani S, Cartwright M, Rixon L, Knapp M, Henderson C, et al. Effect of telehealth on use of secondary care and mortality: findings from the whole system demonstrator cluster randomised trial. BMJ. 2012;344:e3874.CrossRef
29.
go back to reference Jonk Y, Lawson K, O'Connor H, Riise K, Eisenberg D, Bryan D, Kreitzer M. How effective is health coaching in reducing health services expenditures? Med Care. 2015;53(2). Jonk Y, Lawson K, O'Connor H, Riise K, Eisenberg D, Bryan D, Kreitzer M. How effective is health coaching in reducing health services expenditures? Med Care. 2015;53(2).
30.
go back to reference Kivelä K, Elo S, Kyngäs H, Kääriäinen M. The effects of health coaching on adult patients with chronic diseases: a systematic review. Patient Educ Couns. 2014;97(2):147–57.CrossRef Kivelä K, Elo S, Kyngäs H, Kääriäinen M. The effects of health coaching on adult patients with chronic diseases: a systematic review. Patient Educ Couns. 2014;97(2):147–57.CrossRef
31.
go back to reference Ogrinc G, Davies L, Goodman D, Batalden P, Davidoff F, Stevens D. SQUIRE 2.0 (standards for QUality improvement reporting excellence): revised publication guidelines from a detailed consensus process. BMJ Qual Saf. 2015. Ogrinc G, Davies L, Goodman D, Batalden P, Davidoff F, Stevens D. SQUIRE 2.0 (standards for QUality improvement reporting excellence): revised publication guidelines from a detailed consensus process. BMJ Qual Saf. 2015.
32.
go back to reference Hibbard J, Gilburt H. Supporting people to manage their health: an introduction to patient activation. London; 2014. Hibbard J, Gilburt H. Supporting people to manage their health: an introduction to patient activation. London; 2014.
33.
go back to reference Craig P, Cooper C, Gunnell D, Haw S, Lawson K, Macintyre S, Ogilvie D, Petticrew M, Reeves B, Sutton M, et al. Using natural experiments to evaluate population health interventions: new Medical Research Council guidance. J Epidemiol Community Health. 2012;66(12):1182–6.CrossRef Craig P, Cooper C, Gunnell D, Haw S, Lawson K, Macintyre S, Ogilvie D, Petticrew M, Reeves B, Sutton M, et al. Using natural experiments to evaluate population health interventions: new Medical Research Council guidance. J Epidemiol Community Health. 2012;66(12):1182–6.CrossRef
35.
go back to reference Robinson D, Schulz E, Brown P, Price C. Updating the read codes: user-interactive maintenance of a dynamic clinical vocabulary. J Am Med Inform Assoc. 1997;4(6):465–72.CrossRef Robinson D, Schulz E, Brown P, Price C. Updating the read codes: user-interactive maintenance of a dynamic clinical vocabulary. J Am Med Inform Assoc. 1997;4(6):465–72.CrossRef
36.
go back to reference Bower P, Reeves.D., Sutton M, Lovell K, Bakemore A, Hann M, Howells H, Meacock R, Munford L, Panagioti M et al: Comprehensive longitudinal assessment of Salford integrated care (CLASSIC): a mixed methods study of the implementation and effectiveness of a new model of care for long-term conditions. Health Serv Deliv Res 2018. Bower P, Reeves.D., Sutton M, Lovell K, Bakemore A, Hann M, Howells H, Meacock R, Munford L, Panagioti M et al: Comprehensive longitudinal assessment of Salford integrated care (CLASSIC): a mixed methods study of the implementation and effectiveness of a new model of care for long-term conditions. Health Serv Deliv Res 2018.
37.
go back to reference Loudon K, Treweek S, Sullivan F, Donnan P, Thorpe KE, Zwarenstein M. The PRECIS-2 tool: designing trials that are fit for purpose. BMJ. 2015;350. Loudon K, Treweek S, Sullivan F, Donnan P, Thorpe KE, Zwarenstein M. The PRECIS-2 tool: designing trials that are fit for purpose. BMJ. 2015;350.
38.
go back to reference Smith SM, Wallace E, O'Dowd T, Fortin M. Interventions for improving outcomes in patients with multimorbidity in primary care and community settings. Cochrane Database Syst Rev. 2016;3. Smith SM, Wallace E, O'Dowd T, Fortin M. Interventions for improving outcomes in patients with multimorbidity in primary care and community settings. Cochrane Database Syst Rev. 2016;3.
39.
go back to reference Salisbury C, Man M-S, Bower P, Guthrie B, Chaplin K, Gaunt DM, Brookes S, Fitzpatrick B, Gardner C, Hollinghurst S, et al. Management of multimorbidity using a patient-centred care model: a pragmatic cluster-randomised trial of the 3D approach. Lancet. 2018;392(10141):41–50.CrossRef Salisbury C, Man M-S, Bower P, Guthrie B, Chaplin K, Gaunt DM, Brookes S, Fitzpatrick B, Gardner C, Hollinghurst S, et al. Management of multimorbidity using a patient-centred care model: a pragmatic cluster-randomised trial of the 3D approach. Lancet. 2018;392(10141):41–50.CrossRef
Metadata
Title
The impact of a combinatorial digital and organisational intervention on the management of long-term conditions in UK primary care: a non-randomised evaluation
Authors
David G. Lugo-Palacios
Jonathan Hammond
Thomas Allen
Sarah Darley
Ruth McDonald
Thomas Blakeman
Peter Bower
Publication date
01-12-2019
Publisher
BioMed Central
Keyword
Care
Published in
BMC Health Services Research / Issue 1/2019
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-019-3984-6

Other articles of this Issue 1/2019

BMC Health Services Research 1/2019 Go to the issue