Skip to main content
Top
Published in: World Journal of Surgery 6/2017

01-06-2017 | Scientific Review

Cost-Effectiveness in Global Surgery: Pearls, Pitfalls, and a Checklist

Authors: Mark G. Shrime, Blake C. Alkire, Caris Grimes, Tiffany E. Chao, Dan Poenaru, Stéphane Verguet

Published in: World Journal of Surgery | Issue 6/2017

Login to get access

Abstract

Introduction

Cost-effectiveness analysis can be a powerful policy-making tool. In the two decades since the first cost-effectiveness analyses in global surgery, the methodology has established the cost-effectiveness of many types of surgery in low- and middle-income countries (LMICs). However, with the crescendo of cost-effectiveness analyses in global surgery has come vast disparities in methodology, with only 15% of studies adhering to published guidelines. This has led to results that have varied up to 150-fold.

Methods

The theoretical basis, common pitfalls, and guidelines-based recommendations for cost-effectiveness analyses are reviewed, and a checklist to be used for cost-effectiveness analyses in global surgery is created.

Results

Common pitfalls in global surgery cost-effectiveness analyses fall into five categories: the analytic perspective, cost measurement, effectiveness measurement, probability estimation, valuation of the counterfactual, and heterogeneity and uncertainty. These are reviewed in turn, and a checklist to avoid these pitfalls is developed.

Conclusion

Cost-effectiveness analyses, when done rigorously, can be very useful for the development of efficient surgical systems in LMICs. This review highlights the common pitfalls in these analyses and methods to avoid these pitfalls.
Appendix
Available only for authorised users
Footnotes
1
Revised United States Preventative Services Task Force recommendations are due in late 2017; whether this recommendation persists in the United States remains to be seen.
 
2
One important exception exists to this rule. If a cost is completely identical in both the intervention and its comparator, it can be ignored. This is because the numerator is a subtraction. As an example, if patients undergoing the intervention incur a $100 cost for a consultation, which is identical to a $100 cost for consultation in patients undergoing the comparator, then the numerator becomes:
\(\$ 100 + c_{\text{intervention}} {-}\left( {\$ 100 + c_{\text{comparator}} } \right) = c_{\text{intervention}} - c_{\text{comparator}}\)
and the $100 drops out.
 
3
Note that YLD is included as a possibility after death with treatment. Although this is likely zero, including it in the calculation allows for accounting of any disability occurring between unsuccessful treatment and death.
 
Literature
1.
go back to reference Kiatpongsan S, Kim JJ (2014) Costs and cost-effectiveness of 9-valent human papillomavirus (HPV) vaccination in two East African countries. PLoS ONE 9(9):e106836CrossRefPubMedPubMedCentral Kiatpongsan S, Kim JJ (2014) Costs and cost-effectiveness of 9-valent human papillomavirus (HPV) vaccination in two East African countries. PLoS ONE 9(9):e106836CrossRefPubMedPubMedCentral
2.
go back to reference Stout NK, Rosenberg MA, Trentham-Dietz A, Smith MA, Robinson SM, Fryback DG (2006) Retrospective cost-effectiveness analysis of screening mammography. J Natl Cancer Inst 98(11):774–782CrossRefPubMed Stout NK, Rosenberg MA, Trentham-Dietz A, Smith MA, Robinson SM, Fryback DG (2006) Retrospective cost-effectiveness analysis of screening mammography. J Natl Cancer Inst 98(11):774–782CrossRefPubMed
3.
go back to reference Lowson K, Jenks M, Filby A, Carr L, Campbell B, Powell J (2015) Examining the implementation of NICE guidance: cross-sectional survey of the use of NICE interventional procedures guidance by NHS trusts. Implement Sci 10:93CrossRefPubMedPubMedCentral Lowson K, Jenks M, Filby A, Carr L, Campbell B, Powell J (2015) Examining the implementation of NICE guidance: cross-sectional survey of the use of NICE interventional procedures guidance by NHS trusts. Implement Sci 10:93CrossRefPubMedPubMedCentral
4.
go back to reference Marseille E (1996) Cost-effectiveness of cataract surgery in a public health eye care programme in Nepal. Bull World Health Organ 74:319–324PubMedPubMedCentral Marseille E (1996) Cost-effectiveness of cataract surgery in a public health eye care programme in Nepal. Bull World Health Organ 74:319–324PubMedPubMedCentral
5.
go back to reference Evans TG, Ransom MK, Kyaw TA, Ko CK (1996) Cost effectiveness and cost utility of preventing trachomatous visual impairment: lessons from 30 years of trachoma control in Burma. Br J Ophthalmol 80:880–889CrossRefPubMedPubMedCentral Evans TG, Ransom MK, Kyaw TA, Ko CK (1996) Cost effectiveness and cost utility of preventing trachomatous visual impairment: lessons from 30 years of trachoma control in Burma. Br J Ophthalmol 80:880–889CrossRefPubMedPubMedCentral
6.
go back to reference McCord C, Chowdhury Q (2003) A cost effective small hospital in Bangladesh: what it can mean for emergency obstetric care. Int J Gynaecol Obstet 81:83–92CrossRefPubMed McCord C, Chowdhury Q (2003) A cost effective small hospital in Bangladesh: what it can mean for emergency obstetric care. Int J Gynaecol Obstet 81:83–92CrossRefPubMed
7.
go back to reference Gosselin RA, Thind A, Bellardinelli A (2006) Cost/DALY averted in a small hospital in Sierra Leone: what is the relative contribution of different services? World J Surg 30:505–511CrossRefPubMed Gosselin RA, Thind A, Bellardinelli A (2006) Cost/DALY averted in a small hospital in Sierra Leone: what is the relative contribution of different services? World J Surg 30:505–511CrossRefPubMed
9.
go back to reference Chao TE, Sharma K, Mandigo M et al (2014) Cost-eff ectiveness of surgery and its policy implications for global health: a systematic review and analysis. Lancet Glob Health 2:e334–e345CrossRefPubMed Chao TE, Sharma K, Mandigo M et al (2014) Cost-eff ectiveness of surgery and its policy implications for global health: a systematic review and analysis. Lancet Glob Health 2:e334–e345CrossRefPubMed
10.
go back to reference Grimes CE, Henry JA, Maraka J, Mkandawire NC, Cotton M (2014) Cost-effectiveness of surgery in low- and middle-income countries: a systematic review. World J Surg 38:252–263CrossRefPubMed Grimes CE, Henry JA, Maraka J, Mkandawire NC, Cotton M (2014) Cost-effectiveness of surgery in low- and middle-income countries: a systematic review. World J Surg 38:252–263CrossRefPubMed
11.
go back to reference Meara JG, Leather AJM, Hagander L et al (2015) Global surgery 2030: evidence and solutions for achieving health, welfare, and economic development. Lancet 386(9993):569–624CrossRefPubMed Meara JG, Leather AJM, Hagander L et al (2015) Global surgery 2030: evidence and solutions for achieving health, welfare, and economic development. Lancet 386(9993):569–624CrossRefPubMed
12.
go back to reference Mock C, Donkor P, Gawande AA et al (2015) Essential surgery: key messages from disease control priorities, 3rd edn. Lancet 385(9983):2209–2219CrossRefPubMed Mock C, Donkor P, Gawande AA et al (2015) Essential surgery: key messages from disease control priorities, 3rd edn. Lancet 385(9983):2209–2219CrossRefPubMed
13.
go back to reference Husereau D, Drummond M, Petrou S et al (2013) Consolidated Health Economic Evaluation Reporting Standards (CHEERS)–explanation and elaboration: a report of the ISPOR Health Economic Evaluation Publication Guidelines Good Reporting Practices Task Force. Value Health 16(2):231–250CrossRefPubMed Husereau D, Drummond M, Petrou S et al (2013) Consolidated Health Economic Evaluation Reporting Standards (CHEERS)–explanation and elaboration: a report of the ISPOR Health Economic Evaluation Publication Guidelines Good Reporting Practices Task Force. Value Health 16(2):231–250CrossRefPubMed
14.
go back to reference Drummond MF (2005) Methods for the economic evaluation of health care programmes. Oxford University Press, Oxford Drummond MF (2005) Methods for the economic evaluation of health care programmes. Oxford University Press, Oxford
15.
go back to reference Tan-Torres Edejer T, Baltussen R, Adam T et al (2003) Making choices in health: WHO guide to cost-effectiveness analysis. World Health Organization, Geneva Tan-Torres Edejer T, Baltussen R, Adam T et al (2003) Making choices in health: WHO guide to cost-effectiveness analysis. World Health Organization, Geneva
16.
go back to reference Gold MR, Siegel JE, Russell LR, Weinstein MC (1996) Cost effectiveness in health and medicine. Oxford University Press, New York Gold MR, Siegel JE, Russell LR, Weinstein MC (1996) Cost effectiveness in health and medicine. Oxford University Press, New York
17.
go back to reference Weinstein MC, Toy EL, Sandberg EA et al (2001) Modeling for healthcare and other policy decisions: uses, roles, and validity. Value Health 4(5):348–361CrossRefPubMed Weinstein MC, Toy EL, Sandberg EA et al (2001) Modeling for healthcare and other policy decisions: uses, roles, and validity. Value Health 4(5):348–361CrossRefPubMed
18.
go back to reference Hammit JK, Robinson LA (2011) The income elasticity of the value per statistical life: transferring estimates between high and low income populations. J Benefit Cost Anal 2(1):1–29 Hammit JK, Robinson LA (2011) The income elasticity of the value per statistical life: transferring estimates between high and low income populations. J Benefit Cost Anal 2(1):1–29
19.
go back to reference Tadisina KK, Chopra K, Tangredi J, Thomson JG, Singh DP (2014) Helping hands: a cost-effectiveness study of a humanitarian hand surgery mission. Plast Surg Int 2014:921625PubMedPubMedCentral Tadisina KK, Chopra K, Tangredi J, Thomson JG, Singh DP (2014) Helping hands: a cost-effectiveness study of a humanitarian hand surgery mission. Plast Surg Int 2014:921625PubMedPubMedCentral
20.
go back to reference Egle JP, McKendrick A, Mittal VK, Sosa F (2014) Short-term surgical mission to the Dominican Republic: a cost-benefit analysis. Int J Surg 12(10):1045–1049CrossRefPubMed Egle JP, McKendrick A, Mittal VK, Sosa F (2014) Short-term surgical mission to the Dominican Republic: a cost-benefit analysis. Int J Surg 12(10):1045–1049CrossRefPubMed
21.
go back to reference Xu K, Evans DB, Kadama P et al (2006) Understanding the impact of eliminating user fees: utilization and catastrophic health expenditures in Uganda. Soc Sci Med 62(4):866–876CrossRefPubMed Xu K, Evans DB, Kadama P et al (2006) Understanding the impact of eliminating user fees: utilization and catastrophic health expenditures in Uganda. Soc Sci Med 62(4):866–876CrossRefPubMed
22.
go back to reference Dasta JF, McLaughlin TP, Mody SH, Tak PiechC (2005) Daily cost of an intensive care unit day: the contribution of mechanical ventilation. Crit Care Med 33:1266–1271CrossRefPubMed Dasta JF, McLaughlin TP, Mody SH, Tak PiechC (2005) Daily cost of an intensive care unit day: the contribution of mechanical ventilation. Crit Care Med 33:1266–1271CrossRefPubMed
24.
go back to reference Shrime MG, Dare AJ, Alkire BC, O’Neill K, Meara JG (2015) Catastrophic expenditure to pay for surgery worldwide: a modeling study. Lancet Global Health 3(Suppl 2):S38–S44CrossRefPubMed Shrime MG, Dare AJ, Alkire BC, O’Neill K, Meara JG (2015) Catastrophic expenditure to pay for surgery worldwide: a modeling study. Lancet Global Health 3(Suppl 2):S38–S44CrossRefPubMed
25.
go back to reference Ensor T (2004) Informal payments for health care in transition economies. Soc Sci Med 58(2):237–246CrossRefPubMed Ensor T (2004) Informal payments for health care in transition economies. Soc Sci Med 58(2):237–246CrossRefPubMed
26.
go back to reference Morris SS, Carletto C, Hoddinott J, Christiaensen LJM (2000) Validity of rapid estimates of household wealth and income for health surveys in rural Africa. J Epidemiol Commun Health 54:381–387CrossRef Morris SS, Carletto C, Hoddinott J, Christiaensen LJM (2000) Validity of rapid estimates of household wealth and income for health surveys in rural Africa. J Epidemiol Commun Health 54:381–387CrossRef
31.
go back to reference Gosselin RA, Ozgediz D, Poenaru D (2013) A square peg in a round hole? Challenges with DALY-based “burden of disease” calculations in surgery and a call for alternative metrics. World J Surg 37(11):2507–2511CrossRefPubMed Gosselin RA, Ozgediz D, Poenaru D (2013) A square peg in a round hole? Challenges with DALY-based “burden of disease” calculations in surgery and a call for alternative metrics. World J Surg 37(11):2507–2511CrossRefPubMed
32.
go back to reference Pliskin JS, Shepard DS, Weinstein MC (1980) Utility functions for life years and health status. Oper Res 28(1):206–224CrossRef Pliskin JS, Shepard DS, Weinstein MC (1980) Utility functions for life years and health status. Oper Res 28(1):206–224CrossRef
33.
go back to reference Murray CJL (1994) Quantifying the burden of disease: the technical basis for disability-adjusted life years. Bull World Health Organ 72(3):429–445PubMedPubMedCentral Murray CJL (1994) Quantifying the burden of disease: the technical basis for disability-adjusted life years. Bull World Health Organ 72(3):429–445PubMedPubMedCentral
35.
go back to reference Babigumira JB, Stergachis A, Veenstra DL et al (2012) Potential cost-effectiveness of universal access to modern contraceptives in Uganda. PLoS ONE 7(2):e30735CrossRefPubMedPubMedCentral Babigumira JB, Stergachis A, Veenstra DL et al (2012) Potential cost-effectiveness of universal access to modern contraceptives in Uganda. PLoS ONE 7(2):e30735CrossRefPubMedPubMedCentral
37.
go back to reference Salomon JA, Vos T, Hogan DR et al (2012) Common values in assessing health outcomes from disease and injury: disability weights measurement study for the Global Burden of Disease Study 2010. Lancet 380(9859):2129–2143CrossRefPubMed Salomon JA, Vos T, Hogan DR et al (2012) Common values in assessing health outcomes from disease and injury: disability weights measurement study for the Global Burden of Disease Study 2010. Lancet 380(9859):2129–2143CrossRefPubMed
38.
go back to reference Wu VK, Poenaru D (2013) Burden of surgically correctable disabilities among children in the Dadaab refugee camp. World J Surg 37(7):1536–1543CrossRefPubMed Wu VK, Poenaru D (2013) Burden of surgically correctable disabilities among children in the Dadaab refugee camp. World J Surg 37(7):1536–1543CrossRefPubMed
39.
go back to reference Gosselin RA, Maldonado A, Elder G (2010) Comparative cost-effectiveness analysis of two MSF surgical trauma centers. World J Surg 34(3):415–419CrossRefPubMed Gosselin RA, Maldonado A, Elder G (2010) Comparative cost-effectiveness analysis of two MSF surgical trauma centers. World J Surg 34(3):415–419CrossRefPubMed
40.
go back to reference Bickler SW, Ozgediz D, Gosselin RA et al (2010) Key concepts for estimating the burden of surgical conditions and the unmet need for surgical care. World J Surg 34(3):374–380CrossRefPubMed Bickler SW, Ozgediz D, Gosselin RA et al (2010) Key concepts for estimating the burden of surgical conditions and the unmet need for surgical care. World J Surg 34(3):374–380CrossRefPubMed
41.
go back to reference Flanagan W, McIntosh C, Le Petit C, Berthelot JM (2006) Deriving utility scores for co-morbid conditions: a test of the multiplicative model for combining individual condition scores. Popul Health Metr 4:13CrossRefPubMedPubMedCentral Flanagan W, McIntosh C, Le Petit C, Berthelot JM (2006) Deriving utility scores for co-morbid conditions: a test of the multiplicative model for combining individual condition scores. Popul Health Metr 4:13CrossRefPubMedPubMedCentral
42.
go back to reference Poenaru D, Pemberton J, Frankfurter C, Cameron BH (2015) Quantifying the disability from congenital anomalies averted through pediatric surgery: a cross-sectional comparison of a pediatric surgical unit in Kenya and Canada. World J Surg 39(9):2198–2206CrossRefPubMed Poenaru D, Pemberton J, Frankfurter C, Cameron BH (2015) Quantifying the disability from congenital anomalies averted through pediatric surgery: a cross-sectional comparison of a pediatric surgical unit in Kenya and Canada. World J Surg 39(9):2198–2206CrossRefPubMed
44.
go back to reference Shrime MG, Verguet S, Johansson KA, Jamison DT, Kruk ME (2015) Task-shifting, universal public finance, or both for the expansion of surgical access in rural Ethiopia: an extended cost-effectiveness analysis. Health Policy Plann. doi:10.1093/heapol/czv121 Shrime MG, Verguet S, Johansson KA, Jamison DT, Kruk ME (2015) Task-shifting, universal public finance, or both for the expansion of surgical access in rural Ethiopia: an extended cost-effectiveness analysis. Health Policy Plann. doi:10.​1093/​heapol/​czv121
45.
go back to reference Hunink MGM, Weinstein MC, Wittenberg E et al (2014) Decision making in health and medicine: integrating evidence and values. Cambridge University Press, CambridgeCrossRef Hunink MGM, Weinstein MC, Wittenberg E et al (2014) Decision making in health and medicine: integrating evidence and values. Cambridge University Press, CambridgeCrossRef
46.
go back to reference Gosselin RA, Gialamas G, Atkin DM (2011) Comparing the cost-effectiveness of short orthopedic missions in elective and relief situations in developing countries. World J Surg 35(5):951–955CrossRefPubMedPubMedCentral Gosselin RA, Gialamas G, Atkin DM (2011) Comparing the cost-effectiveness of short orthopedic missions in elective and relief situations in developing countries. World J Surg 35(5):951–955CrossRefPubMedPubMedCentral
47.
go back to reference Murray CJL, Evans DB, Acharya A, Baltussen R (2000) Development of WHO guidelines on generalized cost-effectiveness analysis. Health Econ 9:235–251CrossRefPubMed Murray CJL, Evans DB, Acharya A, Baltussen R (2000) Development of WHO guidelines on generalized cost-effectiveness analysis. Health Econ 9:235–251CrossRefPubMed
Metadata
Title
Cost-Effectiveness in Global Surgery: Pearls, Pitfalls, and a Checklist
Authors
Mark G. Shrime
Blake C. Alkire
Caris Grimes
Tiffany E. Chao
Dan Poenaru
Stéphane Verguet
Publication date
01-06-2017
Publisher
Springer International Publishing
Published in
World Journal of Surgery / Issue 6/2017
Print ISSN: 0364-2313
Electronic ISSN: 1432-2323
DOI
https://doi.org/10.1007/s00268-017-3875-0

Other articles of this Issue 6/2017

World Journal of Surgery 6/2017 Go to the issue