Skip to main content
Top
Published in: BMC Public Health 1/2008

Open Access 01-12-2008 | Correspondence

Vouchers for scaling up insecticide-treated nets in Tanzania: Methods for monitoring and evaluation of a national health system intervention

Authors: Kara Hanson, Rose Nathan, Tanya Marchant, Hadji Mponda, Caroline Jones, Jane Bruce, Godlove Stephen, Jo Mulligan, Hassan Mshinda, Joanna Armstrong Schellenberg

Published in: BMC Public Health | Issue 1/2008

Login to get access

Abstract

Background

The Tanzania National Voucher Scheme (TNVS) uses the public health system and the commercial sector to deliver subsidised insecticide-treated nets (ITNs) to pregnant women. The system began operation in October 2004 and by May 2006 was operating in all districts in the country. Evaluating complex public health interventions which operate at national level requires a multidisciplinary approach, novel methods, and collaboration with implementers to support the timely translation of findings into programme changes. This paper describes this novel approach to delivering ITNs and the design of the monitoring and evaluation (M&E).

Methods

A comprehensive and multidisciplinary M&E design was developed collaboratively between researchers and the National Malaria Control Programme. Five main domains of investigation were identified: (1) ITN coverage among target groups, (2) provision and use of reproductive and child health services, (3) "leakage" of vouchers, (4) the commercial ITN market, and (5) cost and cost-effectiveness of the scheme.

Results

The evaluation plan combined quantitative (household and facility surveys, voucher tracking, retail census and cost analysis) and qualitative (focus groups and in-depth interviews) methods. This plan was defined in collaboration with implementing partners but undertaken independently. Findings were reported regularly to the national malaria control programme and partners, and used to modify the implementation strategy over time.

Conclusion

The M&E of the TNVS is a potential model for generating information to guide national and international programmers about options for delivering priority interventions. It is independent, comprehensive, provides timely results, includes information on intermediate processes to allow implementation to be modified, measures leakage as well as coverage, and measures progress over time.
Appendix
Available only for authorised users
Literature
1.
go back to reference ter Kuile F, Terlouw D, Kariuki S, Phillips-Howard P, Mirel L, Hawley W, Friedman J, Shi Y, Kolczak M, Lal A, et al: Impact of permethrin-treated bed nets on malaria, anemia, and growth in infants in an area of intense perennial malaria transmission in western Kenya. Am J Trop Med Hyg. 2003, 68 (4): 68-77.PubMed ter Kuile F, Terlouw D, Kariuki S, Phillips-Howard P, Mirel L, Hawley W, Friedman J, Shi Y, Kolczak M, Lal A, et al: Impact of permethrin-treated bed nets on malaria, anemia, and growth in infants in an area of intense perennial malaria transmission in western Kenya. Am J Trop Med Hyg. 2003, 68 (4): 68-77.PubMed
2.
go back to reference Abdulla S, Armstrong Schellenberg JR, Nathan R, Mukasa O, Marchant T, Smith T, Tanner M, Lengeler C: Impact on malaria morbidity of a programme supplying insecticide-treated nets in children aged under 2 years in Tanzania: community cross-sectional study. Br Med J. 2001, 322: 270-273. 10.1136/bmj.322.7281.270.CrossRef Abdulla S, Armstrong Schellenberg JR, Nathan R, Mukasa O, Marchant T, Smith T, Tanner M, Lengeler C: Impact on malaria morbidity of a programme supplying insecticide-treated nets in children aged under 2 years in Tanzania: community cross-sectional study. Br Med J. 2001, 322: 270-273. 10.1136/bmj.322.7281.270.CrossRef
3.
go back to reference Eisele T, Lindblade K, Wannemuehler K, Gimnig J, Odhiambo F, Hawley W, Ter Kuile F, Phillips-Howard P, Rosen D, Nahlen B, et al: Effect of sustained insecticide-treated bed net use on all-cause child mortality in an area of intense perennial malaria transmission in western Kenya. Am J Trop Med Hyg. 2005, 73 (1): 149-156.PubMed Eisele T, Lindblade K, Wannemuehler K, Gimnig J, Odhiambo F, Hawley W, Ter Kuile F, Phillips-Howard P, Rosen D, Nahlen B, et al: Effect of sustained insecticide-treated bed net use on all-cause child mortality in an area of intense perennial malaria transmission in western Kenya. Am J Trop Med Hyg. 2005, 73 (1): 149-156.PubMed
4.
go back to reference Armstrong Schellenberg JR, Abdulla S, Nathan R, Mukasa O, Marchant TJ, Kikumbih N, Mushi AK, Mponda H, Minja H, Mshinda H, et al: Effect of large-scale social marketing of insecticide-treated nets on child survival in rural Tanzania. Lancet. 2001, 357 (9264): 1241-1247. 10.1016/S0140-6736(00)04404-4.CrossRef Armstrong Schellenberg JR, Abdulla S, Nathan R, Mukasa O, Marchant TJ, Kikumbih N, Mushi AK, Mponda H, Minja H, Mshinda H, et al: Effect of large-scale social marketing of insecticide-treated nets on child survival in rural Tanzania. Lancet. 2001, 357 (9264): 1241-1247. 10.1016/S0140-6736(00)04404-4.CrossRef
5.
go back to reference ter Kuile F, Terlouw D, Phillips-Howard P, Hawley W, Friedman J, Kariuki S, Shi Y, Kolczak M, Lal A, Vulule J, et al: Reduction of malaria during pregnancy by permethrin-treated bed nets in an area of intense perennial malaria transmission in western Kenya. Am J Trop Med Hyg. 2003, 68 (4 Suppl): 50-60.PubMed ter Kuile F, Terlouw D, Phillips-Howard P, Hawley W, Friedman J, Kariuki S, Shi Y, Kolczak M, Lal A, Vulule J, et al: Reduction of malaria during pregnancy by permethrin-treated bed nets in an area of intense perennial malaria transmission in western Kenya. Am J Trop Med Hyg. 2003, 68 (4 Suppl): 50-60.PubMed
6.
go back to reference Marchant T, Armstrong Schellenberg J, Edgar T, Nathan R, Abdulla S, Mukasa O, Mponda H, Lengeler C: Socially-marketed insecticide-treated nets improve malaria and anaemia in pregnancy in southern Tanzania. Trop Med Int Health. 2002, 7 (2): 149-158. 10.1046/j.1365-3156.2002.00840.x.CrossRefPubMed Marchant T, Armstrong Schellenberg J, Edgar T, Nathan R, Abdulla S, Mukasa O, Mponda H, Lengeler C: Socially-marketed insecticide-treated nets improve malaria and anaemia in pregnancy in southern Tanzania. Trop Med Int Health. 2002, 7 (2): 149-158. 10.1046/j.1365-3156.2002.00840.x.CrossRefPubMed
8.
go back to reference Webster J, Lines J, Bruce J, Armstrong Schellenberg JRM, Hanson K: Which distribution systems reach the poor? Equity of coverage of never treated nets, ever treated nets, and immunisation, to reduce child mortality in Africa. Lancet Infect Dis. 2005, 5 (11): 709-717. 10.1016/S1473-3099(05)70269-3.CrossRefPubMed Webster J, Lines J, Bruce J, Armstrong Schellenberg JRM, Hanson K: Which distribution systems reach the poor? Equity of coverage of never treated nets, ever treated nets, and immunisation, to reduce child mortality in Africa. Lancet Infect Dis. 2005, 5 (11): 709-717. 10.1016/S1473-3099(05)70269-3.CrossRefPubMed
9.
go back to reference Molyneux DH, Nantulya VM: Linking disease control programmes in rural Africa: a pro-poor strategy to reach Abuja targets and millennium development goals. BMJ. 2004, 328: 1129-1132. 10.1136/bmj.328.7448.1129.CrossRefPubMedPubMedCentral Molyneux DH, Nantulya VM: Linking disease control programmes in rural Africa: a pro-poor strategy to reach Abuja targets and millennium development goals. BMJ. 2004, 328: 1129-1132. 10.1136/bmj.328.7448.1129.CrossRefPubMedPubMedCentral
10.
go back to reference Curtis CF, Maxwell CA, Lemnge M, Kilama WL, Steketee RW, Hawley WA, Bergevin Y, Campbell CC, Sachs J, Teklehaimanot A, et al: Scaling-up coverage with insecticide-treated nets against malaria in Africa: who should pay?. Lancet Infect Dis. 2003, 3 (5): 304-307. 10.1016/S1473-3099(03)00612-1.CrossRefPubMed Curtis CF, Maxwell CA, Lemnge M, Kilama WL, Steketee RW, Hawley WA, Bergevin Y, Campbell CC, Sachs J, Teklehaimanot A, et al: Scaling-up coverage with insecticide-treated nets against malaria in Africa: who should pay?. Lancet Infect Dis. 2003, 3 (5): 304-307. 10.1016/S1473-3099(03)00612-1.CrossRefPubMed
11.
go back to reference Lines J, Lengeler C, Cham K, de Savigny D, Chimumbwa J, Langi P, Carroll D, Mills AJ, Hanson K, Webster J, et al: Scaling-up and sustaining insecticide-treated net coverage. Lancet Infect Dis. 2003, 3 (8): 465-466. 10.1016/S1473-3099(03)00717-5.CrossRefPubMed Lines J, Lengeler C, Cham K, de Savigny D, Chimumbwa J, Langi P, Carroll D, Mills AJ, Hanson K, Webster J, et al: Scaling-up and sustaining insecticide-treated net coverage. Lancet Infect Dis. 2003, 3 (8): 465-466. 10.1016/S1473-3099(03)00717-5.CrossRefPubMed
12.
go back to reference Stevens W: Untangling the debate surrounding strategies for achieving sustainable high coverage of insecticide-treated nets. Applied Health Economics and Health Policy. 2005, 4 (1): 5-8. 10.2165/00148365-200504010-00002.CrossRefPubMed Stevens W: Untangling the debate surrounding strategies for achieving sustainable high coverage of insecticide-treated nets. Applied Health Economics and Health Policy. 2005, 4 (1): 5-8. 10.2165/00148365-200504010-00002.CrossRefPubMed
14.
go back to reference Roberts L: Combatting malaria: Battling over bednets. Science. 2007, 318: 556-559. 10.1126/science.318.5850.556.CrossRefPubMed Roberts L: Combatting malaria: Battling over bednets. Science. 2007, 318: 556-559. 10.1126/science.318.5850.556.CrossRefPubMed
15.
go back to reference Victora CG, Hanson K, Bryce J, Vaughan JP: Achieving universal coverage with health interventions. Lancet. 2004, 364: 1541-1548. 10.1016/S0140-6736(04)17279-6.CrossRefPubMed Victora CG, Hanson K, Bryce J, Vaughan JP: Achieving universal coverage with health interventions. Lancet. 2004, 364: 1541-1548. 10.1016/S0140-6736(04)17279-6.CrossRefPubMed
16.
go back to reference Hanson K, Ranson MK, Oliveira-Cruz V, Mills A: Expanding access to priority health interventions: A framework for understanding the constraints to scaling-up. Journal of International Development. 2003, 15: 1-14. 10.1002/jid.963.CrossRef Hanson K, Ranson MK, Oliveira-Cruz V, Mills A: Expanding access to priority health interventions: A framework for understanding the constraints to scaling-up. Journal of International Development. 2003, 15: 1-14. 10.1002/jid.963.CrossRef
17.
go back to reference Grabowsky M, Farrell N, Hawley W, Chimumbwa J, Hoyer S, Wolkon A, Selanikio J, Sorensen R: Integrating insecticide-treated bednets into a measles vaccination campaign achieves high, rapid and equitable coverage with direct and voucher-based methods. Trop Med Int Health. 2005, 10 (11): 1151-1160. 10.1111/j.1365-3156.2005.01502.x.CrossRefPubMed Grabowsky M, Farrell N, Hawley W, Chimumbwa J, Hoyer S, Wolkon A, Selanikio J, Sorensen R: Integrating insecticide-treated bednets into a measles vaccination campaign achieves high, rapid and equitable coverage with direct and voucher-based methods. Trop Med Int Health. 2005, 10 (11): 1151-1160. 10.1111/j.1365-3156.2005.01502.x.CrossRefPubMed
18.
go back to reference Grabowsky M, Nobiya T, Ahun M, Donna R, Lengor M, Zimmerman D, Ladd H, Hoekstra E, Bello A, Baffoe-Wilmot A, et al: Distributing insecticide-treated bednets during measles vaccination: a low-cost means of achieving high and equitable coverage. Bull World Health Organ. 2005, 83 (3): 195-201.PubMedPubMedCentral Grabowsky M, Nobiya T, Ahun M, Donna R, Lengor M, Zimmerman D, Ladd H, Hoekstra E, Bello A, Baffoe-Wilmot A, et al: Distributing insecticide-treated bednets during measles vaccination: a low-cost means of achieving high and equitable coverage. Bull World Health Organ. 2005, 83 (3): 195-201.PubMedPubMedCentral
19.
go back to reference CDC: Distribution of insecticide-treated bednets during an integrated nationwide immunization campaign – Togo, West Africa, December 2004. MMWR Morb Mortal Wkly Rep. 2005, 54: 994-996. CDC: Distribution of insecticide-treated bednets during an integrated nationwide immunization campaign – Togo, West Africa, December 2004. MMWR Morb Mortal Wkly Rep. 2005, 54: 994-996.
20.
go back to reference Stevens W, Wiseman V, Ortiz J, Chavasse D: The costs and effects of a nationwide insecticide treated net programme: the cost of Malawi. Malaria Journal. 2005, 4 (1): 22-10.1186/1475-2875-4-22.CrossRefPubMedPubMedCentral Stevens W, Wiseman V, Ortiz J, Chavasse D: The costs and effects of a nationwide insecticide treated net programme: the cost of Malawi. Malaria Journal. 2005, 4 (1): 22-10.1186/1475-2875-4-22.CrossRefPubMedPubMedCentral
23.
go back to reference National Bureau of Statistics (Tanzania): Household budget survey 2000/1. 2002, Dar es Salaam: National Bureau of Statistics National Bureau of Statistics (Tanzania): Household budget survey 2000/1. 2002, Dar es Salaam: National Bureau of Statistics
24.
go back to reference Tami A, Mbati J, Nathan R, Mponda H, Lengeler C, Armstrong Schellenberg JRM: Use and misuse of a voucher scheme as a subsidy for treated nets for malaria control in southern Tanzania. Health Policy Plan. 2006, 21 (1): 1-9. 10.1093/heapol/czj005.CrossRefPubMed Tami A, Mbati J, Nathan R, Mponda H, Lengeler C, Armstrong Schellenberg JRM: Use and misuse of a voucher scheme as a subsidy for treated nets for malaria control in southern Tanzania. Health Policy Plan. 2006, 21 (1): 1-9. 10.1093/heapol/czj005.CrossRefPubMed
25.
go back to reference Kolaczinski J, Hanson K: Costing the distribution of insecticide-treated nets: a review of cost and cost-effectiveness studies to provide guidance on standardization of costing methodology. Malaria Journal. 2006, 5: 37-10.1186/1475-2875-5-37.CrossRefPubMedPubMedCentral Kolaczinski J, Hanson K: Costing the distribution of insecticide-treated nets: a review of cost and cost-effectiveness studies to provide guidance on standardization of costing methodology. Malaria Journal. 2006, 5: 37-10.1186/1475-2875-5-37.CrossRefPubMedPubMedCentral
26.
go back to reference Shirima K, Mukasa O, Armstrong Schellenberg JRM, Manzi F, John D, Mushi A, Mrisho M, Tanner M, Mshinda H, D S: The use of Personal Digital Assistants for data entry at the point of collection in a large household survey in Southern Tanzania. Emerging Themes in Epidemiology. 2007, 1 (4): 5-10.1186/1742-7622-4-5.CrossRef Shirima K, Mukasa O, Armstrong Schellenberg JRM, Manzi F, John D, Mushi A, Mrisho M, Tanner M, Mshinda H, D S: The use of Personal Digital Assistants for data entry at the point of collection in a large household survey in Southern Tanzania. Emerging Themes in Epidemiology. 2007, 1 (4): 5-10.1186/1742-7622-4-5.CrossRef
27.
go back to reference StataCorp: Stata Statistical Software: Release 9. 2005, College Station, Texas: StataCorp LP StataCorp: Stata Statistical Software: Release 9. 2005, College Station, Texas: StataCorp LP
28.
go back to reference Filmer D, Pritchett L: Estimating wealth effects without expenditure data – or tears: an application to educational enrollements in states of India. Demography. 2001, 38 (1): 115-132.PubMed Filmer D, Pritchett L: Estimating wealth effects without expenditure data – or tears: an application to educational enrollements in states of India. Demography. 2001, 38 (1): 115-132.PubMed
29.
go back to reference Evaluation Gap Working Group: When will we ever learn? Improving lives through impact evaluation. 2006, Washington DC: Center for Global Development Evaluation Gap Working Group: When will we ever learn? Improving lives through impact evaluation. 2006, Washington DC: Center for Global Development
30.
go back to reference Bryce JCV: Ten methodological lessons from the multi-country evaluation of Integrated Management of Childhood Illness. Health Policy Plan. 2005, 20 (Supplement 1): i94-i105. 10.1093/heapol/czi056.CrossRefPubMed Bryce JCV: Ten methodological lessons from the multi-country evaluation of Integrated Management of Childhood Illness. Health Policy Plan. 2005, 20 (Supplement 1): i94-i105. 10.1093/heapol/czi056.CrossRefPubMed
31.
go back to reference Lewis M: Governance and corruption in public health care systems. 2006, Washington DC: Centre for Global Development WP78 Lewis M: Governance and corruption in public health care systems. 2006, Washington DC: Centre for Global Development WP78
32.
go back to reference Skarbinsky J, Massaga J, Rowe AK, Kachur SP: Distribution of free untreated bednets bundled with insecticide via an integrated child health campaign in Lindi region, Tanzania: Lessons for future campaigns. Am J Trop Med Hyg. 2007, 76 (6): 1100-1106. Skarbinsky J, Massaga J, Rowe AK, Kachur SP: Distribution of free untreated bednets bundled with insecticide via an integrated child health campaign in Lindi region, Tanzania: Lessons for future campaigns. Am J Trop Med Hyg. 2007, 76 (6): 1100-1106.
33.
go back to reference Bennett S, Boerma JT, Brugha R: Scaling up HIV/AIDS evaluation. The Lancet. 2006, 367: 79-82. 10.1016/S0140-6736(06)67928-2.CrossRef Bennett S, Boerma JT, Brugha R: Scaling up HIV/AIDS evaluation. The Lancet. 2006, 367: 79-82. 10.1016/S0140-6736(06)67928-2.CrossRef
Metadata
Title
Vouchers for scaling up insecticide-treated nets in Tanzania: Methods for monitoring and evaluation of a national health system intervention
Authors
Kara Hanson
Rose Nathan
Tanya Marchant
Hadji Mponda
Caroline Jones
Jane Bruce
Godlove Stephen
Jo Mulligan
Hassan Mshinda
Joanna Armstrong Schellenberg
Publication date
01-12-2008
Publisher
BioMed Central
Published in
BMC Public Health / Issue 1/2008
Electronic ISSN: 1471-2458
DOI
https://doi.org/10.1186/1471-2458-8-205

Other articles of this Issue 1/2008

BMC Public Health 1/2008 Go to the issue