Top

Published in:

Open Access 01-12-2018 | Research

Relating process evaluation measures to complex intervention outcomes: findings from the PACE-UP primary care pedometer-based walking trial

Authors: Cheryl Furness, Emma Howard, Elizabeth Limb, Derek G. Cook, Sally Kerry, Charlotte Wahlich, Christina Victor, Ulf Ekelund, Steve Iliffe, Michael Ussher, Peter Whincup, Julia Fox-Rushby, Judith Ibison, Stephen DeWilde, Tess Harris

Published in: Trials | Issue 1/2018

Abstract

Background

The PACE-UP trial demonstrated positive effects of a pedometer-based walking intervention on objective physical activity (PA) outcomes at three and 12 months in 45–75-year-old primary care patients, in postal and nurse-supported trial arms compared with controls. We explored associations between process evaluation measures and change in PA outcomes.

Methods

The MRC framework guided process evaluation. Three quantitative measures (nurse session attendance [dose delivered], PA diary completion [fidelity] and pedometer use [fidelity]) were selected as independent variables in multi-level models estimating intervention effectiveness on PA outcomes (changes in step-counts and time in moderate-to-vigorous PA [MVPA] levels in ≥ 10-min bouts).

Results

Dose: attending all three nurse sessions compared with 0–2 sessions was associated with an increase in steps/day at three and 12 months of 1197 (95% confidence interval [CI] = 627–1766) and 605 (95% CI = 74–1137), respectively; and MVPA in bouts (min/week) at three and 12 months by 74 (95% CI = 45–103) and 30 (95% CI = 3–57), respectively. Fidelity: postal and nurse groups showed strong positive associations of diary return with steps/day at three months: postal 1458 (95% CI = 854–2061), nurse 873 (95% CI = 190–1555). MVPA in bouts (min/week): postal 64 (95% CI = 33–94), nurse 50 (95% CI = 15–85). At 12 months, only the postal group effects remained statistically significant: steps/day 1114 (95% CI = 538–1689), MVPA 47 (95% CI = 18–75). Regular pedometer use in the postal group only was associated with higher three-month and 12-month steps/day: 1029 (95% CI = 383–1675) and 606 (95% CI = 22–1190), respectively, and with MVPA in bouts at three months: 40 (95% CI = 6–73).

Conclusion

Process evaluation measures demonstrated significant associations with PA outcomes at three and 12 months. We cannot infer causality, but the associations between the process measures and PA outcomes suggest that they were important in enabling the trial changes observed and should be considered core components of the PACE-UP nurse and postal interventions. We have shown the MRC framework to be a useful tool for process evaluation of intervention implementation.

Trial registration

ISRCTN Registry, ISRCTN98538934. Registered on 2 March 2012.

Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, et al. Process evaluation of complex interventions: Medical Research Council guidance. BMJ. 2015;350:h1258. https://doi.org/10.1136/bmj.h1258.CrossRefPubMedPubMedCentral

Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M, et al. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337:a1655. https://doi.org/10.1136/bmj.a1655.CrossRefPubMedPubMedCentral

Carroll C, Patterson M, Wood S, Booth A, Rick J, Balain S. A conceptual framework for implementation fidelity. Implement Sci. 2007;2:40. https://doi.org/10.1186/1748-5908-2-40.CrossRefPubMedPubMedCentral

Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion intervention: The RE-AIM framework. Am J Public Health. 1999;89:1322–7. https://doi.org/10.2105/ajph.89.9.1322.CrossRefPubMedPubMedCentral

Matthews L, Mitchell F, Stalker K, McConnachie A, Murray H, Melling C, et al. Process evaluation of the Walk Well study: a cluster-randomised controlled trial of a community based walking programme for adults with intellectual disabilities. BMC Public Health. 2016;16:527. https://doi.org/10.1186/s12889-016-3179-6.CrossRefPubMedPubMedCentral

Steckler ALL. Process evaluation for public health interventions and research. San Francisco, CA: Jossey-Bass; 2002.

World Health Organization. Process evaluation workbook. Geneva: WHO; 2001.

van Bruinessen IR, van Weel-Baumgarten EM, Gouw H, Zijlstra JM, van Dulmen S. An integrated process and outcome evaluation of a web-based communication tool for patients with malignant lymphoma: randomized controlled trial. J Med Internet Res. 2016;18(7):14. https://doi.org/10.2196/jmir.5877.

Foley L, Mhurchu CN, Marsh S, Epstein LH, Olds T, Dewes O, et al. Screen Time Weight-loss Intervention Targeting Children at Home (SWITCH): process evaluation of a randomised controlled trial intervention. BMC Public Health. 2016;16:9. https://doi.org/10.1186/s12889-016-3124-8.CrossRef

10.

Harris T, Kerry SM, Victor CR, Shah SM, Iliffe S, Ussher M, et al. PACE-UP (Pedometer and consultation evaluation - UP) - a pedometer-based walking intervention with and without practice nurse support in primary care patients aged 45–75 years: study protocol for a randomised controlled trial. Trials. 2013;14:418. https://doi.org/10.1186/1745-6215-14-418.CrossRefPubMedPubMedCentral

11.

Harris T, Kerry SM, Limb ES, Victor CR, Iliffe S, Ussher M, et al. Effect of a primary care walking intervention with and without nurse support on physical activity levels in 45- to 75-year-olds: The Pedometer And Consultation Evaluation (PACE-UP) cluster randomised clinical trial. PLoS Med. 2017;14(1):e1002210. https://doi.org/10.1371/journal.pmed.1002210.CrossRefPubMedPubMedCentral

12.

British Psychological Society. Improving health: changing behaviour: NHS Health Trainer Handbook. London: Department of Health; 2008.

13.

Normansell R, Smith J, Victor C, Cook DG, Kerry S, Iliffe S, et al. Numbers are not the whole story: a qualitative exploration of barriers and facilitators to increased physical activity in a primary care based walking intervention. BMC Public Health. 2014;14:1272. https://doi.org/10.1186/1471-2458-14-1272.CrossRefPubMedPubMedCentral

14.

Beighton C, Victor C, Normansell R, Cook D, Kerry S, Iliffe S, et al. “It’s not just about walking.....it’s the practice nurse that makes it work”: a qualitative exploration of the views of practice nurses delivering complex physical activity interventions in primary care. BMC Public Health. 2015;15(1):1236. https://doi.org/10.1186/s12889-015-2568-6.CrossRefPubMedPubMedCentral

15.

Ramsay CR, Thomas RE, Croal BL, Grimshaw JM, Eccles MP. Using the theory of planned behaviour as a process evaluation tool in randomised trials of knowledge translation strategies: A case study from UK primary care. Implement Sci. 2010;5:71. https://doi.org/10.1186/1748-5908-5-71.CrossRefPubMedPubMedCentral

16.

Tomasone JR, Martin Ginis KA, Estabrooks PA, Domenicucci L. Changing minds, changing lives from the top down: an investigation of the dissemination and adoption of a Canada-wide educational intervention to enhance health care professionals’ intentions to prescribe physical activity. Int J Behav Med. 2015;22(3):336–44. https://doi.org/10.1007/s12529-014-9414-6.CrossRefPubMed

17.

Tomasone JR, Arbour-Nicitopoulos KP, Pila E, Lamontagne ME, Cummings I, Latimer-Cheung AE, et al. Exploring end user adoption and maintenance of a telephone-based physical activity counseling service for individuals with physical disabilities using the Theoretical Domains Framework. Disabil Rehabil. 2017;39:1332–40. https://doi.org/10.1080/09638288.2016.1193231.CrossRefPubMed

18.

Hasson H, Blomberg S, Dunér A. Fidelity and moderating factors in complex interventions: a case study of a continuum of care program for frail elderly people in health and social care. Implement Sci. 2012;7:23. https://doi.org/10.1186/1748-5908-7-23.CrossRefPubMedPubMedCentral

19.

Grimshaw JM, Zwarenstein M, Tetroe JM, Graham ID, Lemyre L, Ecccles MP, et al. Looking inside the black box: a theory-based process evaluation alongside a randomised controlled trial of printed educational materials (the Ontario printed educational message, OPEM) to improve referral and prescribing practices in primary care in Ontario, Canada. Implement Sci. 2007;2:38. https://doi.org/10.1186/1748-5908-2-38.CrossRefPubMedPubMedCentral

20.

Berendsen BA, Kremers SP, Savelberg HH, Schaper NC, Hendriks MR. The implementation and sustainability of a combined lifestyle intervention in primary care: mixed method process evaluation. BMC Fam Pract. 2015;16:37. https://doi.org/10.1186/s12875-015-0254-5.CrossRefPubMedPubMedCentral

21.

Wiltsey Stirman S, Kimberly J, Cook N, Calloway A, Castro F, Charns M. The sustainability of new programs and innovations: a review of the empirical literature and recommendations for future research. Implement Sci. 2012;7:17. https://doi.org/10.1186/1748-5908-7-17.CrossRefPubMedPubMedCentral

22.

Bravata DM, Smith-Spangler C, Sundaram V, Gienger AL, Lin N, Lewis R, et al. Using pedometers to increase physical activity and improve health: a systematic review. JAMA. 2007;298(19):2296–304.CrossRefPubMed

Title: Relating process evaluation measures to complex intervention outcomes: findings from the PACE-UP primary care pedometer-based walking trial
Authors: Cheryl Furness
Emma Howard
Elizabeth Limb
Derek G. Cook
Sally Kerry
Charlotte Wahlich
Christina Victor
Ulf Ekelund
Steve Iliffe
Michael Ussher
Peter Whincup
Julia Fox-Rushby
Judith Ibison
Stephen DeWilde
Tess Harris
Publication date: 01-12-2018
Publisher: BioMed Central
Published in: Trials / Issue 1/2018
Electronic ISSN: 1745-6215
DOI: https://doi.org/10.1186/s13063-017-2428-z

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

Relating process evaluation measures to complex intervention outcomes: findings from the PACE-UP primary care pedometer-based walking trial

Abstract

Background

Methods

Results

Conclusion

Trial registration

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

Abstract

Background

Methods

Results

Conclusion

Trial registration

Please log in to get access to this content

Other articles of this Issue 1/2018

A cluster randomised trial of a classroom communication resource program to change peer attitudes towards children who stutter among grade 7 students

Effects of a 6-week, whole-body vibration strength-training on depression symptoms, endocrinological and neurobiological parameters in adolescent inpatients experiencing a major depressive episode (the “Balancing Vibrations Study”): study protocol for a randomized placebo-controlled trial

A dynamic application of PRECIS-2 to evaluate implementation in a pragmatic, cluster randomized clinical trial in two nursing home systems

Pilot study on increased adherence to physical activity on prescription (PAP) through mindfulness: study protocol

The ideal time of systemic metronidazole and amoxicillin administration in the treatment of severe periodontitis: study protocol for a randomized controlled trial

Acupuncture and clomiphene for Chinese women with polycystic ovary syndrome (PCOSAct): statistical analysis approach with the revision and explanation