Skip to main content
Top
Published in: BMC Health Services Research 1/2024

Open Access 01-12-2024 | Physical Therapy | Research

Feasibility of a quality-improvement program based on routinely collected health outcomes in Dutch primary care physical therapist practice: a mixed-methods study

Authors: LSF Smeekens, AC Verburg, MJM Maas, R van Heerde, A van Kerkhof, PJ van der Wees

Published in: BMC Health Services Research | Issue 1/2024

Login to get access

Abstract

Background

This study evaluates the feasibility of a nine-month advanced quality-improvement program aimed at enhancing the quality of care provided by primary care physical therapists in the Netherlands. The evaluation is based on routinely collected health outcomes of patients with nonspecific low back pain, assessing three feasibility domains: (1) appropriateness, feasibility, and acceptability for quality-improvement purposes; (2) impact on clinical performance; and (3) impact on learning and behavioral change.

Methods

A mixed-methods quality-improvement study using a concurrent triangulation design was conducted in primary care physical therapist practice. Feedback reports on the processes and outcomes of care, peer assessment, and self-assessment were used in a Plan-Do-Study-Act cycle based on self-selected goals. The program’s appropriateness, feasibility, and acceptability, as well as the impact on clinical performance, were evaluated using the Intervention Appropriate Measure, Feasibility Intervention Measure, Acceptability Intervention Measure (for these three measure, possible scores range from 4 to 20), and with a self-assessment of clinical performance (scored 0–10), respectively. The impact on learning and behavioral change was evaluated qualitatively with a directed content analysis.

Results

Ten physical therapists from two practices participated in this study. They rated the program with a mean of 16.5 (SD 1.9) for appropriateness, 17.1 (SD 2.2) for feasibility, and 16.4 (SD 1.5) for acceptability. Participants gave their development in clinical performance a mean score of 6.7 (SD 1.8). Participants became aware of the potential value of using outcome data and gained insight into their own routines and motivations. They changed their data collection routines, implemented data in their routine practice, and explored the impact on their clinical behavior.

Conclusions

This explorative study demonstrated that a quality-improvement program, using health outcomes from a national registry, is judged to be feasible.

Impact statement

This study provides preliminary evidence on how physical therapists may use health outcomes to improve their quality, which can be further used in initiatives to improve outcome-based care in primary physical therapy.
Appendix
Available only for authorised users
Literature
1.
go back to reference Spath P, Kelly DL. Applying quality management in healthcare: a systems approach. Health Administration Press Chicago; 2017. Spath P, Kelly DL. Applying quality management in healthcare: a systems approach. Health Administration Press Chicago; 2017.
2.
go back to reference Porter ME. Value-based Health care Delivery. 2008;248:503–9. Porter ME. Value-based Health care Delivery. 2008;248:503–9.
3.
go back to reference Meerhoff GA, Verburg AC, Schapendonk RM, Cruijsberg J, Nijhuis-van der Sanden MW, van Dulmen SA et al. Reliability, validity and discriminability of patient reported outcomes for non-specific low back pain in a nationwide physical therapy registry: a retrospective observational cohort study 2021;16:e0251892. Meerhoff GA, Verburg AC, Schapendonk RM, Cruijsberg J, Nijhuis-van der Sanden MW, van Dulmen SA et al. Reliability, validity and discriminability of patient reported outcomes for non-specific low back pain in a nationwide physical therapy registry: a retrospective observational cohort study 2021;16:e0251892.
4.
go back to reference Verburg AC, van Dulmen SA, Kiers H, Nijhuis-van der Sanden MW, van der Wees PJ. Patient-reported outcome-based quality indicators in Dutch primary care physical therapy for patients with nonspecific low back Pain. A Cohort Study; 2021. Verburg AC, van Dulmen SA, Kiers H, Nijhuis-van der Sanden MW, van der Wees PJ. Patient-reported outcome-based quality indicators in Dutch primary care physical therapy for patients with nonspecific low back Pain. A Cohort Study; 2021.
5.
go back to reference Swinkels RA, Meerhoff GM, Custers JW, van Peppen RP, Beurskens AJ, Wittink H. Using outcome measures in daily practice: development and evaluation of an implementation strategy for physiotherapists in. Neth. 2015;67:357–64. Swinkels RA, Meerhoff GM, Custers JW, van Peppen RP, Beurskens AJ, Wittink H. Using outcome measures in daily practice: development and evaluation of an implementation strategy for physiotherapists in. Neth. 2015;67:357–64.
6.
go back to reference van Dulmen S, van der Wees P. Eindrapport toepassing van minimale dataset en kwaliteitsindicatoren voor lage rugklachten in de fysiotherapie n.d. van Dulmen S, van der Wees P. Eindrapport toepassing van minimale dataset en kwaliteitsindicatoren voor lage rugklachten in de fysiotherapie n.d.
7.
go back to reference Greenhalgh J, Dalkin S, Gibbons E, Wright J, Valderas JM, Meads D et al. How do aggregated patient-reported outcome measures data stimulate health care improvement? A realist synthesis. 2018;23(1):57–65. Greenhalgh J, Dalkin S, Gibbons E, Wright J, Valderas JM, Meads D et al. How do aggregated patient-reported outcome measures data stimulate health care improvement? A realist synthesis. 2018;23(1):57–65.
8.
go back to reference Koes BW, Van Tulder M, Lin C-WC, Macedo LG, McAuley J, Maher C. An updated overview of clinical guidelines for the management of non-specific low back pain in primary care. 2010;19(12):2075–94. Koes BW, Van Tulder M, Lin C-WC, Macedo LG, McAuley J, Maher C. An updated overview of clinical guidelines for the management of non-specific low back pain in primary care. 2010;19(12):2075–94.
9.
go back to reference Koninklijk Nederlands Genootschap voor Fysiotherapie (KNGF). / vereniging van Oefentherapeuten Cesar en Mensendieck (VvOCM). KNGF-richtlijn Lage rugpijn en lumbosacraal radiculair syndroom. Amersfoort/Utrecht: KNGF/VvoCM; 2021. n.d. Koninklijk Nederlands Genootschap voor Fysiotherapie (KNGF). / vereniging van Oefentherapeuten Cesar en Mensendieck (VvOCM). KNGF-richtlijn Lage rugpijn en lumbosacraal radiculair syndroom. Amersfoort/Utrecht: KNGF/VvoCM; 2021. n.d.
10.
go back to reference Copeland JM, Taylor WJ, Dean SG. Factors influencing the use of outcome measures for patients with low back pain: a survey of New. Z Phys Therapists. 2008;88(12):1492–505. Copeland JM, Taylor WJ, Dean SG. Factors influencing the use of outcome measures for patients with low back pain: a survey of New. Z Phys Therapists. 2008;88(12):1492–505.
11.
go back to reference Jette DU, Halbert J, Iverson C, Miceli E, Shah P. Use of standardized outcome measures. Phys Therapist Practice: Perceptions Appl. 2009;89(2):125–35. Jette DU, Halbert J, Iverson C, Miceli E, Shah P. Use of standardized outcome measures. Phys Therapist Practice: Perceptions Appl. 2009;89(2):125–35.
12.
go back to reference van Dulmen SA, van der Wees PJ, Staal JB, Braspenning J, Nijhuis-van der Sanden MW. Patient reported outcome measures (PROMs) for goalsetting and outcome measurement in primary care physiotherapy. Explorative Field Study. 2017;103:66–72. van Dulmen SA, van der Wees PJ, Staal JB, Braspenning J, Nijhuis-van der Sanden MW. Patient reported outcome measures (PROMs) for goalsetting and outcome measurement in primary care physiotherapy. Explorative Field Study. 2017;103:66–72.
13.
go back to reference Meerhoff GA, van Dulmen SA, Cruijsberg JK, Nijhuis-van der Sanden MW, Van der Wees PJ. Which factors influence the use of patient-reported outcome measures in Dutch physiotherapy practice? A cross-sectional study. 2020;72(1):63–70. Meerhoff GA, van Dulmen SA, Cruijsberg JK, Nijhuis-van der Sanden MW, Van der Wees PJ. Which factors influence the use of patient-reported outcome measures in Dutch physiotherapy practice? A cross-sectional study. 2020;72(1):63–70.
14.
go back to reference Irizarry T, DeVito Dabbs A, Curran CR. Patient portals and patient engagement: a state of the science review. 2015;17(6):e148. Irizarry T, DeVito Dabbs A, Curran CR. Patient portals and patient engagement: a state of the science review. 2015;17(6):e148.
15.
go back to reference Sorondo B, Allen A, Bayleran J, Doore S, Fathima S, Sabbagh I et al. Using a patient portal to transmit patient reported health information into the electronic record: workflow implications and user experience. 2016;4(3). Sorondo B, Allen A, Bayleran J, Doore S, Fathima S, Sabbagh I et al. Using a patient portal to transmit patient reported health information into the electronic record: workflow implications and user experience. 2016;4(3).
16.
go back to reference Ivers N, Jamtvedt G, Flottorp S, Young JM, Odgaard-Jensen J, French SD et al. Audit and feedback: effects on professional practice and healthcare outcomes. 2012. Ivers N, Jamtvedt G, Flottorp S, Young JM, Odgaard-Jensen J, French SD et al. Audit and feedback: effects on professional practice and healthcare outcomes. 2012.
17.
go back to reference van der Wees P, van der Vleuten C. Marjo Maas Ria Nijhuis–van der Sanden Geert Rutten Yvonne Heerkens n.d.:187. van der Wees P, van der Vleuten C. Marjo Maas Ria Nijhuis–van der Sanden Geert Rutten Yvonne Heerkens n.d.:187.
18.
go back to reference Gibbons C, Porter I, Gonçalves-Bradley DC, Stoilov S, Ricci-Cabello I, Tsangaris E et al. Routine provision of feedback from patient-reported outcome measurements to healthcare providers and patients in clinical practice 2021. Gibbons C, Porter I, Gonçalves-Bradley DC, Stoilov S, Ricci-Cabello I, Tsangaris E et al. Routine provision of feedback from patient-reported outcome measurements to healthcare providers and patients in clinical practice 2021.
19.
go back to reference Greenhalgh J, Dalkin S, Gooding K, Gibbons E, Wright J, Meads D et al. Functionality and feedback: a realist synthesis of the collation, interpretation and utilisation of patient-reported outcome measures data to improve patient care. 2017;5:1–280. Greenhalgh J, Dalkin S, Gooding K, Gibbons E, Wright J, Meads D et al. Functionality and feedback: a realist synthesis of the collation, interpretation and utilisation of patient-reported outcome measures data to improve patient care. 2017;5:1–280.
20.
go back to reference Maas MJ, Nijhuis-van der Sanden MW, Driehuis F, Heerkens YF, van der Vleuten CP, van der Wees PJ. Feasibility of peer assessment and clinical audit to self-regulate the quality of physiotherapy services: a mixed methods study 2017;7:e013726. Maas MJ, Nijhuis-van der Sanden MW, Driehuis F, Heerkens YF, van der Vleuten CP, van der Wees PJ. Feasibility of peer assessment and clinical audit to self-regulate the quality of physiotherapy services: a mixed methods study 2017;7:e013726.
21.
go back to reference Maas MJ, van der Wees PJ, Braam C, Koetsenruijter J, Heerkens YF, van der Vleuten CP et al. An innovative peer assessment approach to enhance guideline adherence in physical therapy: single-masked, cluster-randomized controlled trial. 2015;95(4):600–12. Maas MJ, van der Wees PJ, Braam C, Koetsenruijter J, Heerkens YF, van der Vleuten CP et al. An innovative peer assessment approach to enhance guideline adherence in physical therapy: single-masked, cluster-randomized controlled trial. 2015;95(4):600–12.
23.
go back to reference Maas MJ, Driehuis F, Meerhoff GA, Heerkens YF, van der Vleuten CP, Nijhuis-van der Sanden MW et al. Impact of self-and peer assessment on the clinical performance of physiotherapists in primary care: a cohort study 2018;70:393–401. Maas MJ, Driehuis F, Meerhoff GA, Heerkens YF, van der Vleuten CP, Nijhuis-van der Sanden MW et al. Impact of self-and peer assessment on the clinical performance of physiotherapists in primary care: a cohort study 2018;70:393–401.
24.
go back to reference Kampstra NA, Zipfel N, van der Nat PB, Westert GP, van der Wees PJ, Groenewoud AS. Health outcomes measurement and organizational readiness support quality improvement: a. Syst Rev. 2018;18:1–14. Kampstra NA, Zipfel N, van der Nat PB, Westert GP, van der Wees PJ, Groenewoud AS. Health outcomes measurement and organizational readiness support quality improvement: a. Syst Rev. 2018;18:1–14.
25.
go back to reference McDonald PL, Foley TJ, Verheij R, Braithwaite J, Rubin J, Harwood K et al. Data to knowledge to improvement: creating the learning health system. 2024;384. McDonald PL, Foley TJ, Verheij R, Braithwaite J, Rubin J, Harwood K et al. Data to knowledge to improvement: creating the learning health system. 2024;384.
26.
go back to reference Creswell JW, Plano Clark VL, Gutmann ML, Hanson WE. An expanded typology for classifying mixed methods research into designs 2003:209–40. Creswell JW, Plano Clark VL, Gutmann ML, Hanson WE. An expanded typology for classifying mixed methods research into designs 2003:209–40.
27.
go back to reference Bowen DJ, Kreuter M, Spring B, Cofta-Woerpel L, Linnan L, Weiner D, et al. How we Des Feasibility Stud. 2009;36:452–7. Bowen DJ, Kreuter M, Spring B, Cofta-Woerpel L, Linnan L, Weiner D, et al. How we Des Feasibility Stud. 2009;36:452–7.
28.
go back to reference Ogrinc G, Armstrong GE, Dolansky MA, Singh MK, Davies L. SQUIRE-EDU (standards for QUality Improvement Reporting Excellence in Education): publication guidelines for educational improvement. 2019;94(10):1461. Ogrinc G, Armstrong GE, Dolansky MA, Singh MK, Davies L. SQUIRE-EDU (standards for QUality Improvement Reporting Excellence in Education): publication guidelines for educational improvement. 2019;94(10):1461.
30.
go back to reference Krägeloh CU, Czuba KJ, Billington DR, Kersten P, Siegert RJ. Using feedback from patient-reported outcome measures in mental health services: a scoping study and typology. 2015;66:224–41. Krägeloh CU, Czuba KJ, Billington DR, Kersten P, Siegert RJ. Using feedback from patient-reported outcome measures in mental health services: a scoping study and typology. 2015;66:224–41.
31.
go back to reference Hildon Z, Neuburger J, Allwood D, van der Meulen J, Black N. Clinicians’ and patients’ views of metrics of change derived from patient reported outcome measures (PROMs) for comparing providers’. Perform Surg. 2012;12:1–13. Hildon Z, Neuburger J, Allwood D, van der Meulen J, Black N. Clinicians’ and patients’ views of metrics of change derived from patient reported outcome measures (PROMs) for comparing providers’. Perform Surg. 2012;12:1–13.
32.
go back to reference Hildon Z, Allwood D, Black N. Making data more meaningful: patients’ views of the format and content of quality indicators comparing health. care Providers. 2012;88:298–304. Hildon Z, Allwood D, Black N. Making data more meaningful: patients’ views of the format and content of quality indicators comparing health. care Providers. 2012;88:298–304.
33.
go back to reference Pronovost PJ, Hudson DW. Improving healthcare quality through organisational peer-to-peer assessment: lessons from the nuclear power industry. 2012;21:872–5. Pronovost PJ, Hudson DW. Improving healthcare quality through organisational peer-to-peer assessment: lessons from the nuclear power industry. 2012;21:872–5.
34.
go back to reference Wakefield J, Herbert CP, Maclure M, Dormuth C, Wright JM, Legare J, et al. Commit Change Statements can Predict Actual Change Pract. 2003;23:81–92. Wakefield J, Herbert CP, Maclure M, Dormuth C, Wright JM, Legare J, et al. Commit Change Statements can Predict Actual Change Pract. 2003;23:81–92.
35.
go back to reference Rehring SMA, Steiner JF, Reifler LM, Glenn KA, Daley MF. Commitment to change statements and actual practice change after a Continuing Medical. Educ Intervention. 2021;41:145–52. Rehring SMA, Steiner JF, Reifler LM, Glenn KA, Daley MF. Commitment to change statements and actual practice change after a Continuing Medical. Educ Intervention. 2021;41:145–52.
36.
go back to reference Steenbruggen RA, van Heusden-Scholtalbers LA, Hoogeboom TJ, Maas M, Brand P, van der Wees P. Impact and feasibility of a tailor-made patient communication quality improvement programme for hospital-based physiotherapists: a mixed-methods study. 2021;10:e001286. Steenbruggen RA, van Heusden-Scholtalbers LA, Hoogeboom TJ, Maas M, Brand P, van der Wees P. Impact and feasibility of a tailor-made patient communication quality improvement programme for hospital-based physiotherapists: a mixed-methods study. 2021;10:e001286.
37.
go back to reference Weiner BJ, Lewis CC, Stanick C, Powell BJ, Dorsey CN, Clary AS, et al. Psychometric Assess Three New Developed Implement Outcome Measures. 2017;12:1–12. Weiner BJ, Lewis CC, Stanick C, Powell BJ, Dorsey CN, Clary AS, et al. Psychometric Assess Three New Developed Implement Outcome Measures. 2017;12:1–12.
38.
go back to reference Cousins JB, Whitmore E. Framing participatory evaluation 1998;1998:5–23. Cousins JB, Whitmore E. Framing participatory evaluation 1998;1998:5–23.
39.
go back to reference van Staa A, de Vries K. Directed content analysis: een meer deductieve dan inductieve aanpak bij kwalitatieve analyse 2014;19. van Staa A, de Vries K. Directed content analysis: een meer deductieve dan inductieve aanpak bij kwalitatieve analyse 2014;19.
40.
go back to reference Kiger ME, Varpio L. Thematic analysis of qualitative data. AMEE Guide 131. 2020;42:846–54. Kiger ME, Varpio L. Thematic analysis of qualitative data. AMEE Guide 131. 2020;42:846–54.
41.
go back to reference Friese S. Qualitative data analysis with ATLAS. Ti. Sage; 2019. Friese S. Qualitative data analysis with ATLAS. Ti. Sage; 2019.
42.
go back to reference O’Connor C, Joffe H. Intercoder reliability in qualitative research: debates and practical guidelines 2020;19:1609406919899220. O’Connor C, Joffe H. Intercoder reliability in qualitative research: debates and practical guidelines 2020;19:1609406919899220.
43.
go back to reference Kirkpatrick D. Great Ideas Revisit. 1996;50:54–60. Kirkpatrick D. Great Ideas Revisit. 1996;50:54–60.
44.
go back to reference van Dulmen SA, Maas M, Staal JB, Rutten G, Kiers H, Nijhuis-van der Sanden M, et al. Effectiveness of peer assessment for implementing a Dutch physical therapy low back pain guideline. Cluster Randomized Controlled Trial. 2014;94:1396–409. van Dulmen SA, Maas M, Staal JB, Rutten G, Kiers H, Nijhuis-van der Sanden M, et al. Effectiveness of peer assessment for implementing a Dutch physical therapy low back pain guideline. Cluster Randomized Controlled Trial. 2014;94:1396–409.
45.
go back to reference Epstein RM, Siegel DJ, Silberman J. Self-monitoring in clinical practice: a challenge for medical educators 2008;28:5–13. Epstein RM, Siegel DJ, Silberman J. Self-monitoring in clinical practice: a challenge for medical educators 2008;28:5–13.
46.
go back to reference Daves DA, Mazmanian PE, Fordis M, Van Harrision R, Thorpe KE, Perrier L. Accuracy of physician self-assessment compared with observed measures of competence 2006;296:1094–102. Daves DA, Mazmanian PE, Fordis M, Van Harrision R, Thorpe KE, Perrier L. Accuracy of physician self-assessment compared with observed measures of competence 2006;296:1094–102.
47.
go back to reference Prochaska JO, Velicer WF. Transtheoretical Model Health Behav Change. 1997;12:38–48. Prochaska JO, Velicer WF. Transtheoretical Model Health Behav Change. 1997;12:38–48.
48.
go back to reference Ajzen I. The theory of planned behavior 1991;50:179–211. Ajzen I. The theory of planned behavior 1991;50:179–211.
49.
go back to reference Scholte M, Neeleman-van der Steen CW, van der Wees PJ, Nijhuis-van der Sanden MW, Braspenning J. The reasons behind the (non) use of feedback reports for quality improvement in physical therapy: a mixed-method study. 2016;11(8):e0161056. Scholte M, Neeleman-van der Steen CW, van der Wees PJ, Nijhuis-van der Sanden MW, Braspenning J. The reasons behind the (non) use of feedback reports for quality improvement in physical therapy: a mixed-method study. 2016;11(8):e0161056.
50.
go back to reference Alvarado N, McVey L, Elshehaly M, Greenhalgh J, Dowding D, Ruddle R, et al. Analysis of a web-based dashboard to support the Use of National Audit Data in Quality Improvement. Realist Evaluation. 2021;23(11):e28854. Alvarado N, McVey L, Elshehaly M, Greenhalgh J, Dowding D, Ruddle R, et al. Analysis of a web-based dashboard to support the Use of National Audit Data in Quality Improvement. Realist Evaluation. 2021;23(11):e28854.
51.
go back to reference Ryan RM, Deci EL. Self-determination theory 2017. Ryan RM, Deci EL. Self-determination theory 2017.
52.
go back to reference Dewey J, Authentic IEL. Experiential learning 1938. Dewey J, Authentic IEL. Experiential learning 1938.
53.
go back to reference Kluger AN, DeNisi A. The effects of feedback interventions on performance: a historical review, a meta-analysis, and a preliminary feedback intervention theory. 1996;119:254. Kluger AN, DeNisi A. The effects of feedback interventions on performance: a historical review, a meta-analysis, and a preliminary feedback intervention theory. 1996;119:254.
54.
go back to reference Anderson R. New MRC guidance on evaluating complex interventions. 2008;337. Anderson R. New MRC guidance on evaluating complex interventions. 2008;337.
55.
go back to reference Maas MJ, van Poelgeest E, Weymans C, PJvd W. Module 3 feedback op proces en uitkomsten. KNGF; 201. Maas MJ, van Poelgeest E, Weymans C, PJvd W. Module 3 feedback op proces en uitkomsten. KNGF; 201.
Metadata
Title
Feasibility of a quality-improvement program based on routinely collected health outcomes in Dutch primary care physical therapist practice: a mixed-methods study
Authors
LSF Smeekens
AC Verburg
MJM Maas
R van Heerde
A van Kerkhof
PJ van der Wees
Publication date
01-12-2024
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2024
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-024-10958-5

Other articles of this Issue 1/2024

BMC Health Services Research 1/2024 Go to the issue