Skip to main content
Top
Published in: BMC Health Services Research 1/2007

Open Access 01-12-2007 | Research article

Combining evidence and values in priority setting: testing the balance sheet method in a low-income country

Authors: Emmanuel Makundi, Lydia Kapiriri, Ole Frithjof Norheim

Published in: BMC Health Services Research | Issue 1/2007

Login to get access

Abstract

Background

Procedures for priority setting need to incorporate both scientific evidence and public values. The aim of this study was to test out a model for priority setting which incorporates both scientific evidence and public values, and to explore use of evidence by a selection of stakeholders and to study reasons for the relative ranking of health care interventions in a setting of extreme resource scarcity.

Methods

Systematic search for and assessment of relevant evidence for priority setting in a low-income country. Development of a balance sheet according to Eddy's explicit method. Eight group interviews (n-85), using a modified nominal group technique for eliciting individual and group rankings of a given set of health interventions.

Results

The study procedure made it possible to compare the groups' ranking before and after all the evidence was provided to participants. A rank deviation is significant if the rank order of the same intervention differed by two or more points on the ordinal scale. A comparison between the initial rank and the final rank (before deliberation) showed a rank deviation of 67%. The difference between the initial rank and the final rank after discussion and voting gave a rank deviation of 78%.

Conclusion

Evidence-based and deliberative decision-making does change priorities significantly in an experimental setting. Our use of the balance sheet method was meant as a demonstration project, but could if properly developed be feasible for health planners, experts and health workers, although more work is needed before it can be used for laypersons.
Appendix
Available only for authorised users
Literature
1.
go back to reference World Health Report: Health systems: improving performance. 2000, Geneva: World Health Organization World Health Report: Health systems: improving performance. 2000, Geneva: World Health Organization
2.
go back to reference Ministry of Health. Tanzania: National Package of Essential Health Interventions in Tanzania. 1999, Dar es Salaam: Ministry of Health Ministry of Health. Tanzania: National Package of Essential Health Interventions in Tanzania. 1999, Dar es Salaam: Ministry of Health
3.
go back to reference Makundi E, et al: Health sector reform. Situation analysis of 31 councils under phase III of the joint health sector/local government reform. 2002, Dar es Salaam: National Institute for Medical Research Makundi E, et al: Health sector reform. Situation analysis of 31 councils under phase III of the joint health sector/local government reform. 2002, Dar es Salaam: National Institute for Medical Research
4.
go back to reference Ministry of Health. Tanzania: National burden of disease profile for 2001, Tanzania. Dar es Salaam: Adult mortality and morbidity project. 2002 Ministry of Health. Tanzania: National burden of disease profile for 2001, Tanzania. Dar es Salaam: Adult mortality and morbidity project. 2002
5.
go back to reference Hutubessy R, Chisholm D, Tan-Torres Edejer T, WHO-CHOICE obo: Generalized cost-effectiveness analysis for national-level priority-setting in the health sector. Cost Effectiveness and Resource Allocation. 2003, 1 (8): 1-29.PubMedPubMedCentral Hutubessy R, Chisholm D, Tan-Torres Edejer T, WHO-CHOICE obo: Generalized cost-effectiveness analysis for national-level priority-setting in the health sector. Cost Effectiveness and Resource Allocation. 2003, 1 (8): 1-29.PubMedPubMedCentral
6.
go back to reference Murray C, Evans DB, Acharya A, RMPM. B: Development of WHO Guidelines on Generalized Cost-Effectiveness Analysis. Health Economics. 2000, 9: 235-251. 10.1002/(SICI)1099-1050(200004)9:3<235::AID-HEC502>3.0.CO;2-O.PubMedCrossRef Murray C, Evans DB, Acharya A, RMPM. B: Development of WHO Guidelines on Generalized Cost-Effectiveness Analysis. Health Economics. 2000, 9: 235-251. 10.1002/(SICI)1099-1050(200004)9:3<235::AID-HEC502>3.0.CO;2-O.PubMedCrossRef
7.
go back to reference Daniels N, Bryant J, Castano RA, Dantes OG, Khan KS, Pannarunothai S: Benchmarks of fairness for health care reform: a policy tool for developing countries. Bull World Health Organ. 2000, 78 (6): 740-750.PubMedPubMedCentral Daniels N, Bryant J, Castano RA, Dantes OG, Khan KS, Pannarunothai S: Benchmarks of fairness for health care reform: a policy tool for developing countries. Bull World Health Organ. 2000, 78 (6): 740-750.PubMedPubMedCentral
9.
go back to reference Singer PA: Resource allocation: beyond evidence-based medicine and cost- effectiveness analysis. ACP J Club. 1997, 127 (3): A16-18.PubMed Singer PA: Resource allocation: beyond evidence-based medicine and cost- effectiveness analysis. ACP J Club. 1997, 127 (3): A16-18.PubMed
10.
go back to reference Murray CJ, Lopez AD: Evidence-based health policy – lessons from the Global Burden of Disease Study. Science. 1996, 274 (5288): 740-743. 10.1126/science.274.5288.740.PubMedCrossRef Murray CJ, Lopez AD: Evidence-based health policy – lessons from the Global Burden of Disease Study. Science. 1996, 274 (5288): 740-743. 10.1126/science.274.5288.740.PubMedCrossRef
11.
go back to reference Daniels N, Sabin J: Setting limits fairly. Can we learn to share scarce medical resources?. 2002, Cambridge: Oxford University PressCrossRef Daniels N, Sabin J: Setting limits fairly. Can we learn to share scarce medical resources?. 2002, Cambridge: Oxford University PressCrossRef
12.
go back to reference Baltussen R, Niessen L: Priority setting of health interventions: the need for multi-criteria decision analysis. Cost Effectiveness and Resource Allocation. 2006, 4 (14). Baltussen R, Niessen L: Priority setting of health interventions: the need for multi-criteria decision analysis. Cost Effectiveness and Resource Allocation. 2006, 4 (14).
13.
go back to reference Charles C, DeMaio S: Lay participation in health care decision making: a conceptual framework. Journal of Health Politics, Policy & Law. 1993, 18: 881-904.CrossRef Charles C, DeMaio S: Lay participation in health care decision making: a conceptual framework. Journal of Health Politics, Policy & Law. 1993, 18: 881-904.CrossRef
14.
go back to reference Conway T, Hu TC, Harrington T: Setting health priorities: community boards accurately reflect the preferences of the community's residents. J-Community-Health. 1997, 22 (1): 57-68. 10.1023/A:1025198924501.PubMedCrossRef Conway T, Hu TC, Harrington T: Setting health priorities: community boards accurately reflect the preferences of the community's residents. J-Community-Health. 1997, 22 (1): 57-68. 10.1023/A:1025198924501.PubMedCrossRef
15.
go back to reference Emanuel EJ: Where civic republicanism and deliberative democracy meet. Hastings Cent Rep. 1996, 26 (6): 12-14. 10.2307/3528746.PubMedCrossRef Emanuel EJ: Where civic republicanism and deliberative democracy meet. Hastings Cent Rep. 1996, 26 (6): 12-14. 10.2307/3528746.PubMedCrossRef
16.
go back to reference Ham C: Synthesis: what can we learn from international experience?. Br Med Bull. 1995, 51 (4): 819-830.PubMedCrossRef Ham C: Synthesis: what can we learn from international experience?. Br Med Bull. 1995, 51 (4): 819-830.PubMedCrossRef
18.
go back to reference Gutman A, Thompson D: Democracy and Disagreement. 1996, Cambridge, Mass: The Belknap Press of Harvard University Press Gutman A, Thompson D: Democracy and Disagreement. 1996, Cambridge, Mass: The Belknap Press of Harvard University Press
19.
go back to reference Elster J, (Ed): Deliberative Democracy. 1998, Cambridge: Cambridge University Press Elster J, (Ed): Deliberative Democracy. 1998, Cambridge: Cambridge University Press
20.
go back to reference Murray C, Lopez A, (Eds): The Global Burden of Disease. 1996, Cambridge Mass.: Harvard School of Public Health, WHO, World Bank, 1. Murray C, Lopez A, (Eds): The Global Burden of Disease. 1996, Cambridge Mass.: Harvard School of Public Health, WHO, World Bank, 1.
21.
go back to reference WHO: Global Tuberculosis Control: Country profile: United Republic of Tanzania. 2002, Geneva: WHO WHO: Global Tuberculosis Control: Country profile: United Republic of Tanzania. 2002, Geneva: WHO
22.
go back to reference National Bureau of Statistics: Health survey. Dar es Salaam. 1999 National Bureau of Statistics: Health survey. Dar es Salaam. 1999
23.
go back to reference Aids Controll Programme: Aids Controll Programme Surveilance Report. Dar es Salaam: Aids Controll Programme. 2000 Aids Controll Programme: Aids Controll Programme Surveilance Report. Dar es Salaam: Aids Controll Programme. 2000
24.
go back to reference Mnyika SK, Kabalimu TK, Mbaruku G, Masisila R, W M-S: Randomised trial of alternative malaria chemophrophylaxis strategies among pregnant women in Kigoma, Tanzania: Results from baseline studies. East African Medical Journal. 2000, 77 (2): 105-110.PubMed Mnyika SK, Kabalimu TK, Mbaruku G, Masisila R, W M-S: Randomised trial of alternative malaria chemophrophylaxis strategies among pregnant women in Kigoma, Tanzania: Results from baseline studies. East African Medical Journal. 2000, 77 (2): 105-110.PubMed
25.
go back to reference Drakeley CJ, Akim NI, Sauerwein RW, Greenwood BM, Targett GA: Estimates of the infectious reservoir of Plasmodium falciparum malaria in The Gambia and in Tanzania. Transactions of the Royal Society of Tropical Medicine and Hygiene. 2000, 94 (5): 472-476. 10.1016/S0035-9203(00)90056-7.PubMedCrossRef Drakeley CJ, Akim NI, Sauerwein RW, Greenwood BM, Targett GA: Estimates of the infectious reservoir of Plasmodium falciparum malaria in The Gambia and in Tanzania. Transactions of the Royal Society of Tropical Medicine and Hygiene. 2000, 94 (5): 472-476. 10.1016/S0035-9203(00)90056-7.PubMedCrossRef
26.
go back to reference Kilewo C, Massawe A, Lyamuya E, Semali I, Kalokola F, Urassa E, Giattas M, Temu F, Karlsson K, Mhalu F, et al: HIV counseling and testing of pregnant women in sub-Saharan Africa: experience form a study on prevention of mother-to-child HIV-1 transmission in Dar es Salaam, Tanzania. Journal of acquired-immune-deficiency-syndromes. 2001, 28 (5): 458-462.PubMedCrossRef Kilewo C, Massawe A, Lyamuya E, Semali I, Kalokola F, Urassa E, Giattas M, Temu F, Karlsson K, Mhalu F, et al: HIV counseling and testing of pregnant women in sub-Saharan Africa: experience form a study on prevention of mother-to-child HIV-1 transmission in Dar es Salaam, Tanzania. Journal of acquired-immune-deficiency-syndromes. 2001, 28 (5): 458-462.PubMedCrossRef
27.
go back to reference Range N, Ipuge YA, O'Brien RJ, Egwaga SM, Mfinanga SG, Chonde TM, Mukadi YD, MW B: Trend in HIV prevalence among tuberculosis patients in Tanzania. International Journal of Tuberculosis and Lung Disease. 2001, 5 (5): 405-412. Range N, Ipuge YA, O'Brien RJ, Egwaga SM, Mfinanga SG, Chonde TM, Mukadi YD, MW B: Trend in HIV prevalence among tuberculosis patients in Tanzania. International Journal of Tuberculosis and Lung Disease. 2001, 5 (5): 405-412.
28.
go back to reference Kwesigabo G, Killewo JZ, Urassa W, Mbena E, Mhalu F, Lugalla JL, Godoy C, Biberfeld G, Emmelin M, Wall S, et al: Monitoring of HIV-1 infection prevalence and trends in the general population using pregnant women as sentinel population: 9 years experience from the Kagera region of Tanzania. Journal of acquired-immune-deficiency-syndromes. 2000, 23 (5): 410-407.PubMedCrossRef Kwesigabo G, Killewo JZ, Urassa W, Mbena E, Mhalu F, Lugalla JL, Godoy C, Biberfeld G, Emmelin M, Wall S, et al: Monitoring of HIV-1 infection prevalence and trends in the general population using pregnant women as sentinel population: 9 years experience from the Kagera region of Tanzania. Journal of acquired-immune-deficiency-syndromes. 2000, 23 (5): 410-407.PubMedCrossRef
29.
go back to reference Todd J, Balira R, Grosskurth H, Mayaud P, Mosha F, ka-Gina G, Klokke A, Gabone R, Gavyole A, Mabey D, et al: HIV-associated adult mortality in a rural Tanzanian population. AIDS. 1997, 11 (6): 801-807. 10.1097/00002030-199706000-00013.PubMedCrossRef Todd J, Balira R, Grosskurth H, Mayaud P, Mosha F, ka-Gina G, Klokke A, Gabone R, Gavyole A, Mabey D, et al: HIV-associated adult mortality in a rural Tanzanian population. AIDS. 1997, 11 (6): 801-807. 10.1097/00002030-199706000-00013.PubMedCrossRef
30.
go back to reference Ministry of Health. Tanzania: Burden of disease profile for 2001. Dar es Salaam. Dar es Salaam: Adult mortality and morbidity project. 2002 Ministry of Health. Tanzania: Burden of disease profile for 2001. Dar es Salaam. Dar es Salaam: Adult mortality and morbidity project. 2002
31.
go back to reference Ministry of Health. Tanzania: Burden of disease profile for 2001. Hai District. Dar es Salaam: Adult mortality and morbidity project. 2002 Ministry of Health. Tanzania: Burden of disease profile for 2001. Hai District. Dar es Salaam: Adult mortality and morbidity project. 2002
32.
go back to reference Floyd C, Wilkinson D, Gilks C: Comparisons of cost effectiveness of directly observed tretament (DOT) and conventionally delivered treatment for tuberculosis: experience from rural South Africa. BMJ. 1997, 315: 1407-1411.PubMedPubMedCentralCrossRef Floyd C, Wilkinson D, Gilks C: Comparisons of cost effectiveness of directly observed tretament (DOT) and conventionally delivered treatment for tuberculosis: experience from rural South Africa. BMJ. 1997, 315: 1407-1411.PubMedPubMedCentralCrossRef
33.
go back to reference World Health Organization DoCH: Integrated Management of Childhood Illness. 1997, Geneva: World Health Organization World Health Organization DoCH: Integrated Management of Childhood Illness. 1997, Geneva: World Health Organization
34.
go back to reference Varley RC, Tarvid J, Chao DN: A reassessment of the cost-effectiveness of water and sanitation interventions in programmes for controlling childhood diarrhoea. Bull World Health Organ. 1998, 76 (6): 617-631.PubMedPubMedCentral Varley RC, Tarvid J, Chao DN: A reassessment of the cost-effectiveness of water and sanitation interventions in programmes for controlling childhood diarrhoea. Bull World Health Organ. 1998, 76 (6): 617-631.PubMedPubMedCentral
35.
go back to reference Sweat M, Gregorich S, Sangiwa G, Furlonge C, Balmer D, Kamenga C, Grinstead O, Coates T: Cost-effectiveness of voluntary HIV-1 counselling and testing in reducing sexual transmission of HIV-1 in Kenya and Tanzania. Lancet. 2000, 356 (9224): 113-121. 10.1016/S0140-6736(00)02447-8.PubMedCrossRef Sweat M, Gregorich S, Sangiwa G, Furlonge C, Balmer D, Kamenga C, Grinstead O, Coates T: Cost-effectiveness of voluntary HIV-1 counselling and testing in reducing sexual transmission of HIV-1 in Kenya and Tanzania. Lancet. 2000, 356 (9224): 113-121. 10.1016/S0140-6736(00)02447-8.PubMedCrossRef
36.
go back to reference Stringer JS, Rouse DJ, Vermund SH, Goldenberg RL, Sinkala M, Stinnett AA: Cost-effective use of nevirapine to prevent vertical HIV transmission in sub-Saharan Africa. J Acquir Immune Defic Syndr. 2000, 24 (4): 369-377.PubMedCrossRef Stringer JS, Rouse DJ, Vermund SH, Goldenberg RL, Sinkala M, Stinnett AA: Cost-effective use of nevirapine to prevent vertical HIV transmission in sub-Saharan Africa. J Acquir Immune Defic Syndr. 2000, 24 (4): 369-377.PubMedCrossRef
37.
go back to reference Marseille E, Kahn JG, Mmiro F, Guay L, Musoke P, Fowler MG, Jackson JB: Cost effectiveness of single-dose nevirapine regimen for mothers and babies to decrease vertical HIV-1 transmission in sub-Saharan Africa. Lancet. 1999, 354 (9181): 803-809. 10.1016/S0140-6736(99)80009-9.PubMedCrossRef Marseille E, Kahn JG, Mmiro F, Guay L, Musoke P, Fowler MG, Jackson JB: Cost effectiveness of single-dose nevirapine regimen for mothers and babies to decrease vertical HIV-1 transmission in sub-Saharan Africa. Lancet. 1999, 354 (9181): 803-809. 10.1016/S0140-6736(99)80009-9.PubMedCrossRef
38.
go back to reference Goodman C, Coleman P, Mills A: Economic Analysis of Malaria Control in Sub-Saharan Africa. 2000, Geneva, Switzerland: Global Forum for Health Research, 185. Goodman C, Coleman P, Mills A: Economic Analysis of Malaria Control in Sub-Saharan Africa. 2000, Geneva, Switzerland: Global Forum for Health Research, 185.
39.
go back to reference Goodman CA, Mills AJ: The evidence base on the cost-effectiveness of malaria control measures in Africa. Health Policy Plan. 1999, 14 (4): 301-312. 10.1093/heapol/14.4.301.PubMedCrossRef Goodman CA, Mills AJ: The evidence base on the cost-effectiveness of malaria control measures in Africa. Health Policy Plan. 1999, 14 (4): 301-312. 10.1093/heapol/14.4.301.PubMedCrossRef
40.
go back to reference Goodman CA, Coleman PG, Mills AJ: Cost-effectiveness of malaria control in sub-Saharan Africa [see comments]. Lancet. 1999, 354 (9176): 378-385. 10.1016/S0140-6736(99)02141-8.PubMedCrossRef Goodman CA, Coleman PG, Mills AJ: Cost-effectiveness of malaria control in sub-Saharan Africa [see comments]. Lancet. 1999, 354 (9176): 378-385. 10.1016/S0140-6736(99)02141-8.PubMedCrossRef
41.
go back to reference Goodman CA, Coleman PG, Mills AJ: The cost-effectiveness of antenatal malaria prevention in sub-Saharan Africa. Am J Trop Med Hyg. 2001, 64 (1–2 Suppl): 45-56.PubMedCrossRef Goodman CA, Coleman PG, Mills AJ: The cost-effectiveness of antenatal malaria prevention in sub-Saharan Africa. Am J Trop Med Hyg. 2001, 64 (1–2 Suppl): 45-56.PubMedCrossRef
42.
go back to reference Creese A, Floyd K, Alban A, Guinness L: Cost-effectiveness of HIV/AIDS interventions in Africa: a systematic review of the evidence. Lancet. 2002, 359 (9318): 1635-1643. 10.1016/S0140-6736(02)08595-1.PubMedCrossRef Creese A, Floyd K, Alban A, Guinness L: Cost-effectiveness of HIV/AIDS interventions in Africa: a systematic review of the evidence. Lancet. 2002, 359 (9318): 1635-1643. 10.1016/S0140-6736(02)08595-1.PubMedCrossRef
43.
go back to reference Jha P, Ousmame B, Ranson K: The cost-efectiveness of forty health interventions in Guinea. Health Policy and Planning. 1998, 249-262. 10.1093/heapol/13.3.249. 13 Jha P, Ousmame B, Ranson K: The cost-efectiveness of forty health interventions in Guinea. Health Policy and Planning. 1998, 249-262. 10.1093/heapol/13.3.249. 13
44.
go back to reference Whitehead M: The concepts and principles of equity and health. Int J Health Serv. 1992, 22 (3): 429-445. 10.2190/986L-LHQ6-2VTE-YRRN.PubMedCrossRef Whitehead M: The concepts and principles of equity and health. Int J Health Serv. 1992, 22 (3): 429-445. 10.2190/986L-LHQ6-2VTE-YRRN.PubMedCrossRef
45.
go back to reference Caplan RL, Light DW, Daniels N: Benchmarks of fairness: a moral framework for assessing equity. Int J Health Serv. 1999, 29 (4): 853-869. 10.2190/DBBU-WUC4-Y23L-4LEA.PubMedCrossRef Caplan RL, Light DW, Daniels N: Benchmarks of fairness: a moral framework for assessing equity. Int J Health Serv. 1999, 29 (4): 853-869. 10.2190/DBBU-WUC4-Y23L-4LEA.PubMedCrossRef
46.
go back to reference Eddy DM: Clinical decision making: from theory to practice. Guidelines for policy statements: the explicit approach. JAMA. 1990, 263: 2239-2240. 10.1001/jama.263.16.2239. 2243PubMedCrossRef Eddy DM: Clinical decision making: from theory to practice. Guidelines for policy statements: the explicit approach. JAMA. 1990, 263: 2239-2240. 10.1001/jama.263.16.2239. 2243PubMedCrossRef
47.
go back to reference Redman S, Carrick S, Cockburn J, Hirst S: Consulting about priorities for the NHMRC National Breast Cancer Centre: how good is the nominal group technique. Aust-N-Z-J-Public-Health. 1997, 21 (3): 250-256.PubMedCrossRef Redman S, Carrick S, Cockburn J, Hirst S: Consulting about priorities for the NHMRC National Breast Cancer Centre: how good is the nominal group technique. Aust-N-Z-J-Public-Health. 1997, 21 (3): 250-256.PubMedCrossRef
48.
go back to reference Kapiriri L, Norheim OF: Whose priorities count? Comparison of community-identified health problems and Burden-of-Disease assessed health priorities in a district in Uganda. Health Expectations. 2002, 5: 55-62. 10.1046/j.1369-6513.2002.00161.x.PubMedPubMedCentralCrossRef Kapiriri L, Norheim OF: Whose priorities count? Comparison of community-identified health problems and Burden-of-Disease assessed health priorities in a district in Uganda. Health Expectations. 2002, 5: 55-62. 10.1046/j.1369-6513.2002.00161.x.PubMedPubMedCentralCrossRef
49.
go back to reference Dolan P, Cookson R, Ferguson B: Effect of discussion and deliberation on the public's views of priority setting in health care: focus group study. Bmj. 1999, 318 (7188): 916-919.PubMedPubMedCentralCrossRef Dolan P, Cookson R, Ferguson B: Effect of discussion and deliberation on the public's views of priority setting in health care: focus group study. Bmj. 1999, 318 (7188): 916-919.PubMedPubMedCentralCrossRef
50.
go back to reference Baltussen R, Stolk E, Chisholm D, Aikins M: Towards a multi-criteria approach for priority setting: an application to Ghana. Health Econ. 2006, 15 (7): 689-696. 10.1002/hec.1092.PubMedCrossRef Baltussen R, Stolk E, Chisholm D, Aikins M: Towards a multi-criteria approach for priority setting: an application to Ghana. Health Econ. 2006, 15 (7): 689-696. 10.1002/hec.1092.PubMedCrossRef
51.
go back to reference Sackett DL, Richardson WS, Rosenberg W, Haynes RB: Evidence-based Medicine. How to Practice and Teach EBM. 1997, New York: Churchill Livingstone Sackett DL, Richardson WS, Rosenberg W, Haynes RB: Evidence-based Medicine. How to Practice and Teach EBM. 1997, New York: Churchill Livingstone
Metadata
Title
Combining evidence and values in priority setting: testing the balance sheet method in a low-income country
Authors
Emmanuel Makundi
Lydia Kapiriri
Ole Frithjof Norheim
Publication date
01-12-2007
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2007
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/1472-6963-7-152

Other articles of this Issue 1/2007

BMC Health Services Research 1/2007 Go to the issue