Skip to main content
Top
Published in: International Journal for Equity in Health 1/2018

Open Access 01-12-2018 | Research

Measuring financial protection against catastrophic health expenditures: methodological challenges for global monitoring

Authors: Justine Hsu, Gabriela Flores, David Evans, Anne Mills, Kara Hanson

Published in: International Journal for Equity in Health | Issue 1/2018

Login to get access

Abstract

Background

Monitoring financial protection against catastrophic health expenditures is important to understand how health financing arrangements in a country protect its population against high costs associated with accessing health services. While catastrophic health expenditures are generally defined to be when household expenditures for health exceed a given threshold of household resources, there is no gold standard with several methods applied to define the threshold and household resources. These different approaches to constructing the indicator might give different pictures of a country’s progress towards financial protection. In order for monitoring to effectively provide policy insight, it is critical to understand the sensitivity of measurement to these choices.

Methods

This paper examines the impact of varying two methodological choices by analysing household expenditure data from a sample of 47 countries. We assess sensitivity of cross-country comparisons to a range of thresholds by testing for restricted dominance. We further assess sensitivity of comparisons to different methods for defining household resources (i.e. total expenditure, non-food expenditure and non-subsistence expenditure) by conducting correlation tests of country rankings.

Results

We found country rankings are robust to the choice of threshold in a tenth to a quarter of comparisons within the 5–85% threshold range and this increases to half of comparisons if the threshold is restricted to 5–40%, following those commonly used in the literature. Furthermore, correlations of country rankings using different methods to define household resources were moderate to high; thus, this choice makes less difference from a measurement perspective than from an ethical perspective as different definitions of available household resources reflect varying concerns for equity.

Conclusions

Interpreting comparisons from global monitoring based on a single threshold should be done with caution as these may not provide reliable insight into relative country progress. We therefore recommend financial protection against catastrophic health expenditures be measured across a range of thresholds using a catastrophic incidence curve as shown in this paper. We further recommend evaluating financial protection in relation to a country’s health financing system arrangements in order to better understand the extent of protection and better inform future policy changes.
Appendix
Available only for authorised users
Footnotes
1
This will occur for those households with similar levels of total expenditure where actual food spending by the poorer household is just below the fixed subsistence expenditure amount and that by the richer household is just above. This is because CTP is defined as total expenditure net of actual food spending when actual food spending is less than subsistence expenditure.
 
Literature
1.
go back to reference United Nations. Resolution adopted by the general assembly on 6 July 2017: 71/313 work of the statistical commission pertaining to the 2030 agenda for sustainable development (a/71/L.75). New York: United Nations; 2017. United Nations. Resolution adopted by the general assembly on 6 July 2017: 71/313 work of the statistical commission pertaining to the 2030 agenda for sustainable development (a/71/L.75). New York: United Nations; 2017.
2.
go back to reference OECD, Eurostat. WHO. A system of health accounts 2011. Paris: OECD; 2011. OECD, Eurostat. WHO. A system of health accounts 2011. Paris: OECD; 2011.
3.
go back to reference Wagstaff A, van Doorslaer E. Paying for health care: quantifying fairness, catastrophe, and impoverishment, with applications to Vietnam, 1993–98: Washington, DC: World Bank Policy Research Working Paper; 2001. Wagstaff A, van Doorslaer E. Paying for health care: quantifying fairness, catastrophe, and impoverishment, with applications to Vietnam, 1993–98: Washington, DC: World Bank Policy Research Working Paper; 2001.
4.
go back to reference Xu K, Klavus J, Kawabata K, Evans DB, Hanvoravongchai P, Ortiz JP. Chapter 39: household health system contributions and capacity to pay: definitional, empirical and technical challenges. In: Murray CJ, Evans DB, editors. Geneva: World Health Organization; 2003. Xu K, Klavus J, Kawabata K, Evans DB, Hanvoravongchai P, Ortiz JP. Chapter 39: household health system contributions and capacity to pay: definitional, empirical and technical challenges. In: Murray CJ, Evans DB, editors. Geneva: World Health Organization; 2003.
5.
go back to reference Wagstaff A. Measuring financial protection in health. Washington, DC: World Bank; 2008. Wagstaff A. Measuring financial protection in health. Washington, DC: World Bank; 2008.
6.
go back to reference Ataguba J. Reassessing catastrophic health-care payments with a Nigerian case study. Health Econ Policy Law. 2012;7(3):309–26.CrossRef Ataguba J. Reassessing catastrophic health-care payments with a Nigerian case study. Health Econ Policy Law. 2012;7(3):309–26.CrossRef
7.
go back to reference Onoka CA, Onwujekwe OE, Hanson K, Uzochukwu BS. Examining catastrophic health expenditures at variable thresholds using household consumption expenditure diaries: catastrophic health expenditure in Nigeria. Tropical Med Int Health. 2011;16(10):1334–41.CrossRef Onoka CA, Onwujekwe OE, Hanson K, Uzochukwu BS. Examining catastrophic health expenditures at variable thresholds using household consumption expenditure diaries: catastrophic health expenditure in Nigeria. Tropical Med Int Health. 2011;16(10):1334–41.CrossRef
8.
go back to reference Flores G, O’Donnell O. Robust measurement of financial protection in health. Lausanne: University of Lausanne, HEC-DEEP; mimeo 2018. Flores G, O’Donnell O. Robust measurement of financial protection in health. Lausanne: University of Lausanne, HEC-DEEP; mimeo 2018.
9.
go back to reference Su TT, Kouyaté B, Flessa S. Catastrophic household expenditure for health care in a low-income society: a study from Nouna District. Burkina Faso Bull World Health Organ. 2006;84(1):21–7.CrossRef Su TT, Kouyaté B, Flessa S. Catastrophic household expenditure for health care in a low-income society: a study from Nouna District. Burkina Faso Bull World Health Organ. 2006;84(1):21–7.CrossRef
10.
go back to reference Knaul FM, Wong R, Arreola-Ornelas H, Harvard University, Global Equity Initiative, Fundación Mexicana para la Salud, et al. Household spending and impoverishment. Boston: Harvard Global Equity Initiative; Mexican Health Foundation; Distributed by Harvard University Press; 2012. Knaul FM, Wong R, Arreola-Ornelas H, Harvard University, Global Equity Initiative, Fundación Mexicana para la Salud, et al. Household spending and impoverishment. Boston: Harvard Global Equity Initiative; Mexican Health Foundation; Distributed by Harvard University Press; 2012.
11.
go back to reference Karan A, Yip W, Mahal A. Extending health insurance to the poor in India: an impact evaluation of Rashtriya Swasthya Bima Yojana on out of pocket spending for healthcare. Soc Sci Med. 2017;181:83–92.CrossRef Karan A, Yip W, Mahal A. Extending health insurance to the poor in India: an impact evaluation of Rashtriya Swasthya Bima Yojana on out of pocket spending for healthcare. Soc Sci Med. 2017;181:83–92.CrossRef
12.
go back to reference Chen W-H. Comparing low income of Canada’s regions a stochastic dominance approach. Ottawa: Statistics Canada; 2008.CrossRef Chen W-H. Comparing low income of Canada’s regions a stochastic dominance approach. Ottawa: Statistics Canada; 2008.CrossRef
13.
go back to reference Koch SF. Out-of-pocket payments on health: trends and dominance considerations. Pretoria: University of Pretoria; 2015. Koch SF. Out-of-pocket payments on health: trends and dominance considerations. Pretoria: University of Pretoria; 2015.
14.
go back to reference Arrow K. Uncertainty and the welfare economics of medical care. Am Econ Rev. 1963;53:941–73. Arrow K. Uncertainty and the welfare economics of medical care. Am Econ Rev. 1963;53:941–73.
15.
go back to reference Berki SE. A look at catastrophic medical expenses and the poor. Health Aff (Millwood). 1986;5(4):138–45.CrossRef Berki SE. A look at catastrophic medical expenses and the poor. Health Aff (Millwood). 1986;5(4):138–45.CrossRef
16.
go back to reference O’Donnell O, Wagstaff A, van Doorslaer E, Lindelow M. Analyzing health equity using household survey data. Washington, DC: The World Bank; 2008. O’Donnell O, Wagstaff A, van Doorslaer E, Lindelow M. Analyzing health equity using household survey data. Washington, DC: The World Bank; 2008.
17.
go back to reference World Health Organization. Distribution of health payments and catastrophic expenditures: methodology. Geneva: World Health Organization; 2005. World Health Organization. Distribution of health payments and catastrophic expenditures: methodology. Geneva: World Health Organization; 2005.
18.
go back to reference Pal R. Measuring incidence of catastrophic out-of-pocket health expenditure: with application to India. Int J Health Care Finance Econ. 2012;12(1):63–85.CrossRef Pal R. Measuring incidence of catastrophic out-of-pocket health expenditure: with application to India. Int J Health Care Finance Econ. 2012;12(1):63–85.CrossRef
19.
go back to reference Wagstaff A, Eozenou PH-V. CATA meets IMPOV: a unified approach to measuring financial protection in health. Washington, DC: The World Bank; 2015. p. 1–41. Report No.: WPS6861 Wagstaff A, Eozenou PH-V. CATA meets IMPOV: a unified approach to measuring financial protection in health. Washington, DC: The World Bank; 2015. p. 1–41. Report No.: WPS6861
20.
go back to reference World Health Organization, World Bank. Tracking universal health coverage: 2017 global monitoring report. Geneva: World Health Organization; 2017. World Health Organization, World Bank. Tracking universal health coverage: 2017 global monitoring report. Geneva: World Health Organization; 2017.
21.
go back to reference Ravallion M. Poverty comparisons: a guide to concepts and methods: World Bank; 1992. Ravallion M. Poverty comparisons: a guide to concepts and methods: World Bank; 1992.
22.
go back to reference Deaton A, Zaidi S. Guidelines for constructing consumption aggregates for welfare analysis. Washington, DC: World Bank; 2002. Deaton A, Zaidi S. Guidelines for constructing consumption aggregates for welfare analysis. Washington, DC: World Bank; 2002.
23.
go back to reference Thomson S, Evetovits T, Cylus J, Jakab M. Monitoring financial protection to assess progress towards universal health coverage in Europe. Public Health Panor. 2016;2(3):357–66. Thomson S, Evetovits T, Cylus J, Jakab M. Monitoring financial protection to assess progress towards universal health coverage in Europe. Public Health Panor. 2016;2(3):357–66.
24.
go back to reference Deaton A, Grosh M. Chapter 17: consumption. In: designing household survey questionnaires for developing countries: lessons from ten years of LSMS experience. Washington, DC: World Bank; 2000. Deaton A, Grosh M. Chapter 17: consumption. In: designing household survey questionnaires for developing countries: lessons from ten years of LSMS experience. Washington, DC: World Bank; 2000.
25.
go back to reference Chen S, Ravallion M. The developing world is poorer than we thought, but no less successful in the fight against poverty. Q J Econ. 2010;125(4):1577–625.CrossRef Chen S, Ravallion M. The developing world is poorer than we thought, but no less successful in the fight against poverty. Q J Econ. 2010;125(4):1577–625.CrossRef
26.
go back to reference Wyszewianski L. Financially catastrophic and high-cost cases: definitions, distinctions, and their implications for policy formulation. Inq J Med Care Organ Provis Financ. 1986;23(4):382–94. Wyszewianski L. Financially catastrophic and high-cost cases: definitions, distinctions, and their implications for policy formulation. Inq J Med Care Organ Provis Financ. 1986;23(4):382–94.
27.
go back to reference Wagstaff A, van Doorslaer E. Catastrophe and impoverishment in paying for health care: with applications to Vietnam 1993–1998. Health Econ. 2003;12(11):921–33.CrossRef Wagstaff A, van Doorslaer E. Catastrophe and impoverishment in paying for health care: with applications to Vietnam 1993–1998. Health Econ. 2003;12(11):921–33.CrossRef
28.
go back to reference Ranson MK. Reduction of catastrophic health care expenditures by a community-based health insurance scheme in Gujarat, India: current experiences and challenges. Bull World Health Organ. 2002;80(8):613–21.PubMedPubMedCentral Ranson MK. Reduction of catastrophic health care expenditures by a community-based health insurance scheme in Gujarat, India: current experiences and challenges. Bull World Health Organ. 2002;80(8):613–21.PubMedPubMedCentral
29.
go back to reference Ekman B. Catastrophic health payments and health insurance: some counterintuitive evidence from one low-income country. Health Policy Amst Neth. 2007;83(2–3):304–13.CrossRef Ekman B. Catastrophic health payments and health insurance: some counterintuitive evidence from one low-income country. Health Policy Amst Neth. 2007;83(2–3):304–13.CrossRef
30.
go back to reference Xu K, Evans D, Kawabata K, Zeramdini R, Klavus J, Murray C. Household catastrophic health expenditure: a multicountry analysis. Lancet. 2003;362(9378):111–7.CrossRef Xu K, Evans D, Kawabata K, Zeramdini R, Klavus J, Murray C. Household catastrophic health expenditure: a multicountry analysis. Lancet. 2003;362(9378):111–7.CrossRef
31.
go back to reference Xu K, Evans DB, Carrin G, Aguilar-Rivera AM, Musgrove P, Evans T. Protecting households from catastrophic health spending. Health Aff (Millwood). 2007;26(4):972–83.CrossRef Xu K, Evans DB, Carrin G, Aguilar-Rivera AM, Musgrove P, Evans T. Protecting households from catastrophic health spending. Health Aff (Millwood). 2007;26(4):972–83.CrossRef
32.
go back to reference Chen W-H, Duclos J-Y. Testing for poverty dominance: an application to Canada. Stat Can. 2008;42:109–19. Chen W-H, Duclos J-Y. Testing for poverty dominance: an application to Canada. Stat Can. 2008;42:109–19.
33.
go back to reference Bennett CJ. Inference for dominance relations. Int Econ Rev. 2013;54(4):1309–28.CrossRef Bennett CJ. Inference for dominance relations. Int Econ Rev. 2013;54(4):1309–28.CrossRef
34.
go back to reference Davidson R, Duclos J-Y. Statistical inference for stochastic dominance and for the measurement of poverty and inequality. Econometrica. 2000;68(6):1435–64.CrossRef Davidson R, Duclos J-Y. Statistical inference for stochastic dominance and for the measurement of poverty and inequality. Econometrica. 2000;68(6):1435–64.CrossRef
35.
go back to reference Wagstaff A. Measuring financial protection in health. In: Smith PC, Mossialos E, Papanicolas I, Leatherman S, editors. Performance measurement for health system improvement: experiences, challenges and prospects. Cambridge: Cambridge University Press; 2009. Wagstaff A. Measuring financial protection in health. In: Smith PC, Mossialos E, Papanicolas I, Leatherman S, editors. Performance measurement for health system improvement: experiences, challenges and prospects. Cambridge: Cambridge University Press; 2009.
37.
go back to reference Kaur A, Prakasa Rao BLS, Singh H. Testing for second-order stochastic dominance of two distributions. Econom Theory. 1994;10(05):849.CrossRef Kaur A, Prakasa Rao BLS, Singh H. Testing for second-order stochastic dominance of two distributions. Econom Theory. 1994;10(05):849.CrossRef
38.
go back to reference Wingfield T, Boccia D, Tovar M, Gavino A, Zevallos K, Montoya R, et al. Defining catastrophic costs and comparing their importance for adverse tuberculosis outcome with multi-drug resistance: a prospective cohort study, Peru. Ruger JP, editor. PLoS Med. 2014;11(7):e1001675.CrossRef Wingfield T, Boccia D, Tovar M, Gavino A, Zevallos K, Montoya R, et al. Defining catastrophic costs and comparing their importance for adverse tuberculosis outcome with multi-drug resistance: a prospective cohort study, Peru. Ruger JP, editor. PLoS Med. 2014;11(7):e1001675.CrossRef
39.
go back to reference Rudgard WE, Evans CA, Sweeney S, Wingfield T, Lönnroth K, Barreira D, et al. Comparison of two cash transfer strategies to prevent catastrophic costs for poor tuberculosis-affected households in low- and middle-income countries: an economic modelling study. Metcalfe JZ, editor. PLoS Med. 2017;14(11):e1002418.CrossRef Rudgard WE, Evans CA, Sweeney S, Wingfield T, Lönnroth K, Barreira D, et al. Comparison of two cash transfer strategies to prevent catastrophic costs for poor tuberculosis-affected households in low- and middle-income countries: an economic modelling study. Metcalfe JZ, editor. PLoS Med. 2017;14(11):e1002418.CrossRef
40.
go back to reference Murray CJL, Evans DB, editors. Health systems performance assessment: debates, methods and empiricism. Geneva: World Health Organization; 2003. Murray CJL, Evans DB, editors. Health systems performance assessment: debates, methods and empiricism. Geneva: World Health Organization; 2003.
41.
go back to reference Moreno-Serra R, Millett C, Smith PC. Towards improved measurement of financial protection in health. PLoS Med. 2011;8(9):e1001087.CrossRef Moreno-Serra R, Millett C, Smith PC. Towards improved measurement of financial protection in health. PLoS Med. 2011;8(9):e1001087.CrossRef
42.
go back to reference World Health Organization, World Bank. Tracking universal health coverage: first global monitoring report. Geneva: World Health Organization; 2015. World Health Organization, World Bank. Tracking universal health coverage: first global monitoring report. Geneva: World Health Organization; 2015.
43.
go back to reference Wagstaff A, Flores G, Hsu J, Smitz M-F, Chepynoga K, Buisman LR, et al. Progress on catastrophic health spending in 133 countries: a retrospective observational study. Lancet Glob Health. 2018;6(2):e169–79.CrossRef Wagstaff A, Flores G, Hsu J, Smitz M-F, Chepynoga K, Buisman LR, et al. Progress on catastrophic health spending in 133 countries: a retrospective observational study. Lancet Glob Health. 2018;6(2):e169–79.CrossRef
44.
go back to reference Wagstaff A, Flores G, Smitz M-F, Hsu J, Chepynoga K, Eozenou P. Progress on impoverishing health spending in 122 countries: a retrospective observational study. Lancet Glob Health. 2018;6(2):e180–92.CrossRef Wagstaff A, Flores G, Smitz M-F, Hsu J, Chepynoga K, Eozenou P. Progress on impoverishing health spending in 122 countries: a retrospective observational study. Lancet Glob Health. 2018;6(2):e180–92.CrossRef
45.
go back to reference Heijink R, Xu K, Saksena P, Evans D. Validity and comparability of out-of-pocket health expenditure from household surveys: a review of the literature and current survey instruments. Geneva: World Health Organization; 2011. Heijink R, Xu K, Saksena P, Evans D. Validity and comparability of out-of-pocket health expenditure from household surveys: a review of the literature and current survey instruments. Geneva: World Health Organization; 2011.
46.
go back to reference Ruger JP. An alternative framework for analyzing financial protection in health. PLoS Med. 2012;9(8):e1001294.CrossRef Ruger JP. An alternative framework for analyzing financial protection in health. PLoS Med. 2012;9(8):e1001294.CrossRef
Metadata
Title
Measuring financial protection against catastrophic health expenditures: methodological challenges for global monitoring
Authors
Justine Hsu
Gabriela Flores
David Evans
Anne Mills
Kara Hanson
Publication date
01-12-2018
Publisher
BioMed Central
Published in
International Journal for Equity in Health / Issue 1/2018
Electronic ISSN: 1475-9276
DOI
https://doi.org/10.1186/s12939-018-0749-5

Other articles of this Issue 1/2018

International Journal for Equity in Health 1/2018 Go to the issue