Skip to main content
Top
Published in: BMC Health Services Research 1/2024

Open Access 01-12-2024 | Research

Implementation of an audit and feedback module targeting low-value clinical practices in a provincial trauma quality assurance program: a cost-effectiveness study

Authors: Blanchard Conombo, Jason R. Guertin, Jeffrey S. Hoch, Jeremy Grimshaw, Mélanie Bérubé, Christian Malo, Simon Berthelot, François Lauzier, Henry T. Stelfox, Alexis F. Turgeon, Patrick Archambault, Amina Belcaid, Lynne Moore

Published in: BMC Health Services Research | Issue 1/2024

Login to get access

Abstract

Background

Audit and Feedback (A&F) interventions based on quality indicators have been shown to lead to significant improvements in compliance with evidence-based care including de-adoption of low-value practices (LVPs). Our primary aim was to evaluate the cost-effectiveness of adding a hypothetical A&F module targeting LVPs for trauma admissions to an existing quality assurance intervention targeting high-value care and risk-adjusted outcomes. A secondary aim was to assess how certain A&F characteristics might influence its cost-effectiveness.

Methods

We conducted a cost-effectiveness analysis using a probabilistic static decision analytic model in the Québec trauma care continuum. We considered the Québec Ministry of Health perspective. Our economic evaluation compared a hypothetical scenario in which the A&F module targeting LVPs is implemented in a Canadian provincial trauma quality assurance program to a status quo scenario in which the A&F module is not implemented. In scenarios analyses we assessed the impact of A&F characteristics on its cost-effectiveness. Results are presented in terms of incremental costs per LVP avoided.

Results

Results suggest that the implementation of A&F module (Cost = $1,480,850; Number of LVPs = 6,005) is associated with higher costs and higher effectiveness compared to status quo (Cost = $1,124,661; Number of LVPs = 8,228). The A&F module would cost $160 per LVP avoided compared to status quo. The A&F module becomes more cost-effective with the addition of facilitation visits; more frequent evaluation; and when only high-volume trauma centers are considered.

Conclusion

A&F module targeting LVPs is associated with higher costs and higher effectiveness than status quo and has the potential to be cost-effective if the decision-makers’ willingness-to-pay is at least $160 per LVP avoided. This likely represents an underestimate of true ICER due to underestimated costs or missed opportunity costs. Results suggest that virtual facilitation visits, frequent evaluation, and implementing the module in high-volume centers can improve cost-effectiveness.
Appendix
Available only for authorised users
Literature
3.
go back to reference Canadian Institute for Health Information. CIHI. unnecessary care in Canada: technical report. Ottawa, ON: CIHI, 2017. Canadian Institute for Health Information. CIHI. unnecessary care in Canada: technical report. Ottawa, ON: CIHI, 2017.
5.
6.
8.
go back to reference Hauser CJ, Adams CA Jr, Eachempati SR. Surgical Infection Society guideline: prophylactic antibiotic use in open fractures: an evidence-based guideline. Surg infect. 2006;7(4):379–405.CrossRef Hauser CJ, Adams CA Jr, Eachempati SR. Surgical Infection Society guideline: prophylactic antibiotic use in open fractures: an evidence-based guideline. Surg infect. 2006;7(4):379–405.CrossRef
9.
go back to reference Niven DJ, Mrklas KJ, Holodinsky JK, et al. Towards understanding the de-adoption of low-value clinical practices: a scoping review. BMC Med. 2015;13:255.CrossRefPubMedPubMedCentral Niven DJ, Mrklas KJ, Holodinsky JK, et al. Towards understanding the de-adoption of low-value clinical practices: a scoping review. BMC Med. 2015;13:255.CrossRefPubMedPubMedCentral
11.
go back to reference Noah I. Optimizing Audit and Feedback Interventions to Improve Quality in Primary Care. 2014. Noah I. Optimizing Audit and Feedback Interventions to Improve Quality in Primary Care. 2014.
13.
go back to reference Soleymani F, Rashidian A, Dinarvand R, Kebriaeezade A, Hosseini M, Abdollahi M. Assessing the effectiveness and cost-effectiveness of audit and feedback on physician’s prescribing indicators: study protocol of a randomized controlled trial with economic evaluation. Daru. 2012;20(1):88–88.CrossRefPubMedPubMedCentral Soleymani F, Rashidian A, Dinarvand R, Kebriaeezade A, Hosseini M, Abdollahi M. Assessing the effectiveness and cost-effectiveness of audit and feedback on physician’s prescribing indicators: study protocol of a randomized controlled trial with economic evaluation. Daru. 2012;20(1):88–88.CrossRefPubMedPubMedCentral
14.
go back to reference Avery AJ, Rodgers S, Cantrill JA, et al. A pharmacist-led information technology intervention for medication errors (PINCER): a multicentre, cluster randomised, controlled trial and cost-effectiveness analysis. Lancet. 2012;379(9823):1310–9.CrossRefPubMed Avery AJ, Rodgers S, Cantrill JA, et al. A pharmacist-led information technology intervention for medication errors (PINCER): a multicentre, cluster randomised, controlled trial and cost-effectiveness analysis. Lancet. 2012;379(9823):1310–9.CrossRefPubMed
15.
go back to reference Moore L, Guertin JR, Tardif P-A, et al. Economic evaluations of audit and feedback interventions: a systematic review. BMJ Qual Saf. 2022;31(10):754.CrossRefPubMed Moore L, Guertin JR, Tardif P-A, et al. Economic evaluations of audit and feedback interventions: a systematic review. BMJ Qual Saf. 2022;31(10):754.CrossRefPubMed
16.
go back to reference Squires JE, Sullivan K, Eccles MP, Worswick J, Grimshaw JM. Are multifaceted interventions more effective than single-component interventions in changing health-care professionals’ behaviours? An overview of systematic reviews. Implement Sci. 2014;9(1):152.CrossRefPubMedPubMedCentral Squires JE, Sullivan K, Eccles MP, Worswick J, Grimshaw JM. Are multifaceted interventions more effective than single-component interventions in changing health-care professionals’ behaviours? An overview of systematic reviews. Implement Sci. 2014;9(1):152.CrossRefPubMedPubMedCentral
18.
go back to reference Heyworth J. Trauma services in a district general hospital. BMJ (Clinical research ed). 1990;300(6728):876–7.CrossRef Heyworth J. Trauma services in a district general hospital. BMJ (Clinical research ed). 1990;300(6728):876–7.CrossRef
19.
go back to reference CADTH. Guidelines for the economic evaluation of health technologies: Canada. 4th edition. Ottawa: CADTH; 2017. CADTH. Guidelines for the economic evaluation of health technologies: Canada. 4th edition. Ottawa: CADTH; 2017.
20.
go back to reference Husereau D, Drummond M, Augustovski F, et al. Consolidated Health Economic Evaluation Reporting Standards 2022 (CHEERS 2022) statement: updated reporting guidance for health economic evaluations. BMJ (Clinical research ed). 2022;376:e067975.PubMed Husereau D, Drummond M, Augustovski F, et al. Consolidated Health Economic Evaluation Reporting Standards 2022 (CHEERS 2022) statement: updated reporting guidance for health economic evaluations. BMJ (Clinical research ed). 2022;376:e067975.PubMed
22.
go back to reference Developing a framework and research agenda for overuse and appropriateness measures. Agency for Healthcare Research and Quality Appropriateness Small Conference. Published 2009. Accessed 17 Sept 2018. Developing a framework and research agenda for overuse and appropriateness measures. Agency for Healthcare Research and Quality Appropriateness Small Conference. Published 2009. Accessed 17 Sept 2018.
23.
24.
25.
go back to reference Stelfox HT, Straus SE. Measuring quality of care: considering measurement frameworks and needs assessment to guide quality indicator development. J Clin Epidemiol. 2013;66(12):1320–7.CrossRefPubMed Stelfox HT, Straus SE. Measuring quality of care: considering measurement frameworks and needs assessment to guide quality indicator development. J Clin Epidemiol. 2013;66(12):1320–7.CrossRefPubMed
26.
go back to reference Ivers N, Jamtvedt G, Flottorp S, et al. Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Datab Syst Rev. 2012;6:Cd000259. Ivers N, Jamtvedt G, Flottorp S, et al. Audit and feedback: effects on professional practice and healthcare outcomes. Cochrane Datab Syst Rev. 2012;6:Cd000259.
27.
28.
go back to reference Wan X, Wang W, Liu J, Tong T. Estimating the sample mean and standard deviation from the sample size, median, range and/or interquartile range. BMC Med Res Methodol. 2014;14(1):135.CrossRefPubMedPubMedCentral Wan X, Wang W, Liu J, Tong T. Estimating the sample mean and standard deviation from the sample size, median, range and/or interquartile range. BMC Med Res Methodol. 2014;14(1):135.CrossRefPubMedPubMedCentral
29.
go back to reference Conombo B, Guertin JR, Hoch JS, et al. Potential avoidable costs of low-value clinical practices in acute injury care in an integrated canadian provincial trauma system. JAMA Surg. 2023;158(9):977–9.CrossRefPubMed Conombo B, Guertin JR, Hoch JS, et al. Potential avoidable costs of low-value clinical practices in acute injury care in an integrated canadian provincial trauma system. JAMA Surg. 2023;158(9):977–9.CrossRefPubMed
30.
go back to reference Canby JBT. Applying activity-based costing to healthcare settings. Healthc Financ Manag. 1995;49(2):50–2 54-56. Canby JBT. Applying activity-based costing to healthcare settings. Healthc Financ Manag. 1995;49(2):50–2 54-56.
31.
go back to reference Chan YC. Improving hospital cost accounting with activity-based costing. Health Care Manage Rev. 1993;18(1):71–7.CrossRefPubMed Chan YC. Improving hospital cost accounting with activity-based costing. Health Care Manage Rev. 1993;18(1):71–7.CrossRefPubMed
32.
33.
go back to reference Fenwick E, Claxton K, Sculpher M. Representing uncertainty: the role of cost-effectiveness acceptability curves. Health Econ. 2001;10(8):779–87.CrossRefPubMed Fenwick E, Claxton K, Sculpher M. Representing uncertainty: the role of cost-effectiveness acceptability curves. Health Econ. 2001;10(8):779–87.CrossRefPubMed
34.
go back to reference Ling R, Giles M, Searles A. Administration of indwelling urinary catheters in four Australian Hospitals: cost-effectiveness analysis of a multifaceted nurse-led intervention. BMC Health Serv Res. 2021;21(1):897.CrossRefPubMedPubMedCentral Ling R, Giles M, Searles A. Administration of indwelling urinary catheters in four Australian Hospitals: cost-effectiveness analysis of a multifaceted nurse-led intervention. BMC Health Serv Res. 2021;21(1):897.CrossRefPubMedPubMedCentral
35.
go back to reference Gandjour A, Lauterbach KW. When is it worth reducing overuse of health care services? The example of prescribing expensive antihypertensives. Med Klin (Munich). 2005;100(9):535–41.CrossRefPubMed Gandjour A, Lauterbach KW. When is it worth reducing overuse of health care services? The example of prescribing expensive antihypertensives. Med Klin (Munich). 2005;100(9):535–41.CrossRefPubMed
36.
go back to reference Barasa EW, Ayieko P, Cleary S, English M. A multifaceted intervention to improve the quality of care of children in district hospitals in Kenya: a cost-effectiveness analysis. PLoS Med. 2012;9(6):e1001238.CrossRefPubMedPubMedCentral Barasa EW, Ayieko P, Cleary S, English M. A multifaceted intervention to improve the quality of care of children in district hospitals in Kenya: a cost-effectiveness analysis. PLoS Med. 2012;9(6):e1001238.CrossRefPubMedPubMedCentral
37.
go back to reference Huis A, Schoonhoven L, Grol R, Donders R, Hulscher M, van Achterberg T. Impact of a team and leaders-directed strategy to improve nurses’ adherence to hand hygiene guidelines: a cluster randomised trial. Int J Nurs Stud. 2013;50(4):464–74.CrossRefPubMed Huis A, Schoonhoven L, Grol R, Donders R, Hulscher M, van Achterberg T. Impact of a team and leaders-directed strategy to improve nurses’ adherence to hand hygiene guidelines: a cluster randomised trial. Int J Nurs Stud. 2013;50(4):464–74.CrossRefPubMed
38.
go back to reference Crawshaw J, Meyer C, Antonopoulou V, et al. Identifying behaviour change techniques in 287 randomized controlled trials of audit and feedback interventions targeting practice change among healthcare professionals. Implement Sci. 2023;18(1):63.CrossRefPubMedPubMedCentral Crawshaw J, Meyer C, Antonopoulou V, et al. Identifying behaviour change techniques in 287 randomized controlled trials of audit and feedback interventions targeting practice change among healthcare professionals. Implement Sci. 2023;18(1):63.CrossRefPubMedPubMedCentral
39.
go back to reference Dunsmore J, Duncan E, MacLennan S, N’Dow J, MacLennan S. Effectiveness of de-implementation strategies for low-value prescribing in secondary care: a systematic review. Implement Sci Commun. 2023;4(1):115.CrossRefPubMedPubMedCentral Dunsmore J, Duncan E, MacLennan S, N’Dow J, MacLennan S. Effectiveness of de-implementation strategies for low-value prescribing in secondary care: a systematic review. Implement Sci Commun. 2023;4(1):115.CrossRefPubMedPubMedCentral
40.
go back to reference Ridic G, Gleason S, Ridic O. Comparisons of health care systems in the United States. Germany Canada Mater Sociomed. 2012;24(2):112–20.CrossRefPubMed Ridic G, Gleason S, Ridic O. Comparisons of health care systems in the United States. Germany Canada Mater Sociomed. 2012;24(2):112–20.CrossRefPubMed
41.
go back to reference Elliott RA, Putman Kd Fau - Franklin M, Franklin M Fau - Annemans L, et al. Cost effectiveness of a pharmacist-led information technology intervention for reducing rates of clinically important errors in medicines management in general practices (PINCER). (1179–2027 (Electronic)). Elliott RA, Putman Kd Fau - Franklin M, Franklin M Fau - Annemans L, et al. Cost effectiveness of a pharmacist-led information technology intervention for reducing rates of clinically important errors in medicines management in general practices (PINCER). (1179–2027 (Electronic)).
42.
go back to reference Elliott RA, Putman KD, Franklin M, et al. Cost effectiveness of a pharmacist-led information technology intervention for reducing rates of clinically important errors in medicines management in general practices (PINCER). Pharmacoeconomics. 2014;32(6):573–90.CrossRefPubMed Elliott RA, Putman KD, Franklin M, et al. Cost effectiveness of a pharmacist-led information technology intervention for reducing rates of clinically important errors in medicines management in general practices (PINCER). Pharmacoeconomics. 2014;32(6):573–90.CrossRefPubMed
43.
go back to reference Johri M, Ng ESW, Bermudez-Tamayo C, Hoch JS, Ducruet T, Chaillet N. A cluster-randomized trial to reduce caesarean delivery rates in Quebec: cost-effectiveness analysis. BMC Med. 2017;15(1):96.CrossRefPubMedPubMedCentral Johri M, Ng ESW, Bermudez-Tamayo C, Hoch JS, Ducruet T, Chaillet N. A cluster-randomized trial to reduce caesarean delivery rates in Quebec: cost-effectiveness analysis. BMC Med. 2017;15(1):96.CrossRefPubMedPubMedCentral
44.
go back to reference Rodriguez-Martinez CE, Sossa-Briceño MP, Castro-Rodriguez JA. Cost-effectiveness of the utilization of “good practice” or the lack thereof according to a bronchiolitis evidence-based clinical practice guideline. J Eval Clin Pract. 2019;25(4):682–8.CrossRefPubMed Rodriguez-Martinez CE, Sossa-Briceño MP, Castro-Rodriguez JA. Cost-effectiveness of the utilization of “good practice” or the lack thereof according to a bronchiolitis evidence-based clinical practice guideline. J Eval Clin Pract. 2019;25(4):682–8.CrossRefPubMed
Metadata
Title
Implementation of an audit and feedback module targeting low-value clinical practices in a provincial trauma quality assurance program: a cost-effectiveness study
Authors
Blanchard Conombo
Jason R. Guertin
Jeffrey S. Hoch
Jeremy Grimshaw
Mélanie Bérubé
Christian Malo
Simon Berthelot
François Lauzier
Henry T. Stelfox
Alexis F. Turgeon
Patrick Archambault
Amina Belcaid
Lynne Moore
Publication date
01-12-2024
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2024
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-024-10969-2

Other articles of this Issue 1/2024

BMC Health Services Research 1/2024 Go to the issue