Skip to main content
Top
Published in: Population Health Metrics 1/2014

Open Access 01-12-2014 | Research

A methodological framework for the improved use of routine health system data to evaluate national malaria control programs: evidence from Zambia

Authors: Adam Bennett, Joshua Yukich, John M Miller, Penelope Vounatsou, Busiku Hamainza, Mercy M Ingwe, Hawela B Moonga, Mulakwo Kamuliwo, Joseph Keating, Thomas A Smith, Richard W Steketee, Thomas P Eisele

Published in: Population Health Metrics | Issue 1/2014

Login to get access

Abstract

Background

Due to challenges in laboratory confirmation, reporting completeness, timeliness, and health access, routine incidence data from health management information systems (HMIS) have rarely been used for the rigorous evaluation of malaria control program scale-up in Africa.

Methods

We used data from the Zambia HMIS for 2009–2011, a period of rapid diagnostic and reporting scale-up, to evaluate the association between insecticide-treated net (ITN) program intensity and district-level monthly confirmed outpatient malaria incidence using a dose–response national platform approach with district-time units as the unit of analysis. A Bayesian geostatistical model was employed to estimate longitudinal district-level ITN coverage from household survey and programmatic data, and a conditional autoregressive model (CAR) was used to impute missing HMIS data. The association between confirmed malaria case incidence and ITN program intensity was modeled while controlling for known confounding factors, including climate variability, reporting, testing, treatment-seeking, and access to health care, and additionally accounting for spatial and temporal autocorrelation.

Results

An increase in district level ITN coverage of one ITN per household was associated with an estimated 27% reduction in confirmed case incidence overall (incidence rate ratio (IRR): 0 · 73, 95% Bayesian Credible Interval (BCI): 0 · 65–0 · 81), and a 41% reduction in areas of lower malaria burden.

Conclusions

When improved through comprehensive parasitologically confirmed case reporting, HMIS data can become a valuable tool for evaluating malaria program scale-up. Using this approach we provide further evidence that increased ITN coverage is associated with decreased malaria morbidity and use of health services for malaria illness in Zambia. These methods and results are broadly relevant for malaria program evaluations currently ongoing in sub-Saharan Africa, especially as routine confirmed case data improve.
Appendix
Available only for authorised users
Literature
1.
go back to reference A research agenda for malaria eradication: monitoring, evaluation, and surveillance. PLoS Med. 2011, 8 (1): e1000400-10.1371/journal.pmed.1000400. A research agenda for malaria eradication: monitoring, evaluation, and surveillance. PLoS Med. 2011, 8 (1): e1000400-10.1371/journal.pmed.1000400.
2.
go back to reference Rowe AK, Kachur SP, Yoon SY, Lynch M, Slutsker L, Steketee RW: Caution is required when using health facility-based data to evaluate the health impact of malaria control efforts in Africa. Malar J. 2009, 8: 209-10.1186/1475-2875-8-209.CrossRefPubMedPubMedCentral Rowe AK, Kachur SP, Yoon SY, Lynch M, Slutsker L, Steketee RW: Caution is required when using health facility-based data to evaluate the health impact of malaria control efforts in Africa. Malar J. 2009, 8: 209-10.1186/1475-2875-8-209.CrossRefPubMedPubMedCentral
3.
go back to reference Gething PW, Noor AM, Goodman CA, Gikandi PW, Hay SI, Sharif SK, Atkinson PM, Snow RW: Information for decision making from imperfect national data: tracking major changes in health care use in Kenya using geostatistics. BMC Med. 2007, 5: 37-10.1186/1741-7015-5-37.CrossRefPubMedPubMedCentral Gething PW, Noor AM, Goodman CA, Gikandi PW, Hay SI, Sharif SK, Atkinson PM, Snow RW: Information for decision making from imperfect national data: tracking major changes in health care use in Kenya using geostatistics. BMC Med. 2007, 5: 37-10.1186/1741-7015-5-37.CrossRefPubMedPubMedCentral
4.
go back to reference Thomson MC, Doblas-Reyes FJ, Mason SJ, Hagedorn R, Connor SJ, Phinedela T, Morse AP, Palmer TN: Malaria early warnings based on seasonal climate forecasts from multi-model ensembles. Nature. 2006, 439 (7076): 576-579. 10.1038/nature04503.CrossRefPubMed Thomson MC, Doblas-Reyes FJ, Mason SJ, Hagedorn R, Connor SJ, Phinedela T, Morse AP, Palmer TN: Malaria early warnings based on seasonal climate forecasts from multi-model ensembles. Nature. 2006, 439 (7076): 576-579. 10.1038/nature04503.CrossRefPubMed
5.
go back to reference Chanda E, Coleman M, Kleinschmidt I, Hemingway J, Hamainza B, Masaninga F, Chanda-Kapata P, Baboo KS, Dürrheim DN, Coleman M: Impact assessment of malaria vector control using routine surveillance data in Zambia: implications for monitoring and evaluation. Malar J. 2012, 11: 437-10.1186/1475-2875-11-437.CrossRefPubMedPubMedCentral Chanda E, Coleman M, Kleinschmidt I, Hemingway J, Hamainza B, Masaninga F, Chanda-Kapata P, Baboo KS, Dürrheim DN, Coleman M: Impact assessment of malaria vector control using routine surveillance data in Zambia: implications for monitoring and evaluation. Malar J. 2012, 11: 437-10.1186/1475-2875-11-437.CrossRefPubMedPubMedCentral
6.
go back to reference Victora CG, Schellenberg JA, Huicho L, Amaral J, El Arifeen S, Pariyo G, Manzi F, Scherpbier RW, Bryce J, Habicth JP: Context matters: interpreting impact findings in child survival evaluations. Health Policy Plan. 2005, 20 (Suppl 1): i18-i31. 10.1093/heapol/czi050.CrossRefPubMed Victora CG, Schellenberg JA, Huicho L, Amaral J, El Arifeen S, Pariyo G, Manzi F, Scherpbier RW, Bryce J, Habicth JP: Context matters: interpreting impact findings in child survival evaluations. Health Policy Plan. 2005, 20 (Suppl 1): i18-i31. 10.1093/heapol/czi050.CrossRefPubMed
7.
go back to reference Victora CG, Black RE, Boerma JT, Bryce J: Measuring impact in the Millennium Development Goal era and beyond: a new approach to large-scale effectiveness evaluations. Lancet. 2011, 377 (9759): 85-95. 10.1016/S0140-6736(10)60810-0.CrossRefPubMed Victora CG, Black RE, Boerma JT, Bryce J: Measuring impact in the Millennium Development Goal era and beyond: a new approach to large-scale effectiveness evaluations. Lancet. 2011, 377 (9759): 85-95. 10.1016/S0140-6736(10)60810-0.CrossRefPubMed
8.
go back to reference Graves PM, Osgood DE, Thomson MC, Sereke K, Araia A, Zerom M, Ceccato P, Bell M, Del Corral J, Ghebreselassie S, Brantly EP, Ghebremeskel T: Effectiveness of malaria control during changing climate conditions in Eritrea, 1998–2003. Trop Med Int Health. 2008, 13 (2): 218-228. 10.1111/j.1365-3156.2007.01993.x.CrossRefPubMed Graves PM, Osgood DE, Thomson MC, Sereke K, Araia A, Zerom M, Ceccato P, Bell M, Del Corral J, Ghebreselassie S, Brantly EP, Ghebremeskel T: Effectiveness of malaria control during changing climate conditions in Eritrea, 1998–2003. Trop Med Int Health. 2008, 13 (2): 218-228. 10.1111/j.1365-3156.2007.01993.x.CrossRefPubMed
9.
10.
go back to reference Chizema-Kawesha E, Miller J, Steketee RW, Mukonka C, Mohamed AD, Miti SK, Campbell CC: Scaling up malaria control in Zambia: progress and impact 2005–2008. Am J Trop Med Hyg. 2010, 83 (3): 480-488. 10.4269/ajtmh.2010.10-0035.CrossRefPubMedPubMedCentral Chizema-Kawesha E, Miller J, Steketee RW, Mukonka C, Mohamed AD, Miti SK, Campbell CC: Scaling up malaria control in Zambia: progress and impact 2005–2008. Am J Trop Med Hyg. 2010, 83 (3): 480-488. 10.4269/ajtmh.2010.10-0035.CrossRefPubMedPubMedCentral
11.
go back to reference Yukich JO, Bennett A, Albertini A, Incardona S, Moonga H, Chisha Z, Hamainza B, Miller JM, Keating J, Eisele TP, Bell D: Reductions in artemisinin-based combination therapy consumption after the nationwide scale up of routine malaria rapid diagnostic testing in Zambia. Am J Trop Med Hyg. 2012, 87 (3): 437-446. 10.4269/ajtmh.2012.12-0127.CrossRefPubMedPubMedCentral Yukich JO, Bennett A, Albertini A, Incardona S, Moonga H, Chisha Z, Hamainza B, Miller JM, Keating J, Eisele TP, Bell D: Reductions in artemisinin-based combination therapy consumption after the nationwide scale up of routine malaria rapid diagnostic testing in Zambia. Am J Trop Med Hyg. 2012, 87 (3): 437-446. 10.4269/ajtmh.2012.12-0127.CrossRefPubMedPubMedCentral
13.
go back to reference Eisele TP, Miller JM, Moonga HB, Hamainza B, Hutchinson P, Keating J: Malaria infection and anemia prevalence in Zambia's Luangwa District: an area of near-universal insecticide-treated mosquito net coverage. Am J Trop Med Hyg. 2011, 84 (1): 152-157. 10.4269/ajtmh.2011.10-0287.CrossRefPubMedPubMedCentral Eisele TP, Miller JM, Moonga HB, Hamainza B, Hutchinson P, Keating J: Malaria infection and anemia prevalence in Zambia's Luangwa District: an area of near-universal insecticide-treated mosquito net coverage. Am J Trop Med Hyg. 2011, 84 (1): 152-157. 10.4269/ajtmh.2011.10-0287.CrossRefPubMedPubMedCentral
16.
go back to reference Mabaso ML, Craig M, Vounatsou P, Smith T: Towards empirical description of malaria seasonality in southern Africa: the example of Zimbabwe. Trop Med Int Health. 2005, 10 (9): 909-918. 10.1111/j.1365-3156.2005.01462.x.CrossRefPubMed Mabaso ML, Craig M, Vounatsou P, Smith T: Towards empirical description of malaria seasonality in southern Africa: the example of Zimbabwe. Trop Med Int Health. 2005, 10 (9): 909-918. 10.1111/j.1365-3156.2005.01462.x.CrossRefPubMed
18.
go back to reference Alegana VA, Wright JA, Pentrina U, Noor AM, Snow RW, Atikinson PM: Spatial modelling of healthcare utilisation for treatment of fever in Namibia. Int J Health Geogr. 2012, 11: 6-10.1186/1476-072X-11-6.CrossRefPubMedPubMedCentral Alegana VA, Wright JA, Pentrina U, Noor AM, Snow RW, Atikinson PM: Spatial modelling of healthcare utilisation for treatment of fever in Namibia. Int J Health Geogr. 2012, 11: 6-10.1186/1476-072X-11-6.CrossRefPubMedPubMedCentral
19.
go back to reference Zambia Demographic and Health Survey 2007. 2009, Macro International, Calverton,MD Zambia Demographic and Health Survey 2007. 2009, Macro International, Calverton,MD
20.
go back to reference Zambia 2011 Household Survey Report. 2013, Population Services International, Washington DC Zambia 2011 Household Survey Report. 2013, Population Services International, Washington DC
21.
go back to reference Camargo LM, Noronha E, Salcedo JM, Dutra AP, Krieger H, da Silva LH P, Camargo EP: The epidemiology of malaria in Rondonia (Western Amazon region, Brazil): study of a riverine population. Acta Trop. 1999, 72 (1): 1-11. 10.1016/S0001-706X(98)00082-5.CrossRefPubMed Camargo LM, Noronha E, Salcedo JM, Dutra AP, Krieger H, da Silva LH P, Camargo EP: The epidemiology of malaria in Rondonia (Western Amazon region, Brazil): study of a riverine population. Acta Trop. 1999, 72 (1): 1-11. 10.1016/S0001-706X(98)00082-5.CrossRefPubMed
22.
go back to reference Rue H, Martino S, Chopin N: Approximate Bayesian inference for latent Gaussian models using integrated nested Laplace approximations. J R Stat Soc, Series B. 2009, 71 (2): 319-392. 10.1111/j.1467-9868.2008.00700.x.CrossRef Rue H, Martino S, Chopin N: Approximate Bayesian inference for latent Gaussian models using integrated nested Laplace approximations. J R Stat Soc, Series B. 2009, 71 (2): 319-392. 10.1111/j.1467-9868.2008.00700.x.CrossRef
23.
go back to reference Martino S, Rue H: Implementing approximate Bayesian inference using integrated nested laplace approximation: a manual for the inla program (R package). In .[Accessed 2012 January]; Accessed online at ., [http://www.r-inla.org] Martino S, Rue H: Implementing approximate Bayesian inference using integrated nested laplace approximation: a manual for the inla program (R package). In .[Accessed 2012 January]; Accessed online at ., [http://​www.​r-inla.​org]
24.
go back to reference Spiegelhalter DJ, Best NG, Carlin BP, Van Der Linde A: Bayesian measures of model complexity and fit. J R Stat Soc, Series B. 2002, 64 (4): 583-639. 10.1111/1467-9868.00353.CrossRef Spiegelhalter DJ, Best NG, Carlin BP, Van Der Linde A: Bayesian measures of model complexity and fit. J R Stat Soc, Series B. 2002, 64 (4): 583-639. 10.1111/1467-9868.00353.CrossRef
25.
go back to reference Lengeler C: Insecticide-treated bed nets and curtains for preventing malaria. Cochrane Database Syst Rev. 2004, 2: CD000363-PubMed Lengeler C: Insecticide-treated bed nets and curtains for preventing malaria. Cochrane Database Syst Rev. 2004, 2: CD000363-PubMed
26.
go back to reference Otten M, Aregawi M, Were W, Karema C, Medin A, Bekele W, Jima D, Gausi K, Komatsu R, Korenromp E, Low-Beer D, Grabowsky M: Initial evidence of reduction of malaria cases and deaths in Rwanda and Ethiopia due to rapid scale-up of malaria prevention and treatment. Malar J. 2009, 8: 14-10.1186/1475-2875-8-14.CrossRefPubMedPubMedCentral Otten M, Aregawi M, Were W, Karema C, Medin A, Bekele W, Jima D, Gausi K, Komatsu R, Korenromp E, Low-Beer D, Grabowsky M: Initial evidence of reduction of malaria cases and deaths in Rwanda and Ethiopia due to rapid scale-up of malaria prevention and treatment. Malar J. 2009, 8: 14-10.1186/1475-2875-8-14.CrossRefPubMedPubMedCentral
27.
go back to reference Bhattarai A, Ali S, Kachur SP, Mårtensson A, Abbas AK, Khatib R, Al-Mafazy AW, Ramsan M, Rotllant G, Gerstenmaier JF, Molteni F, Abdulla S, Montgomery SM, Kaneko A, Björkman A: Impact of artemisinin-based combination therapy and insecticide-treated nets on malaria burden in Zanzibar. PLoS Med. 2007, 4 (11): e309-10.1371/journal.pmed.0040309.CrossRefPubMedPubMedCentral Bhattarai A, Ali S, Kachur SP, Mårtensson A, Abbas AK, Khatib R, Al-Mafazy AW, Ramsan M, Rotllant G, Gerstenmaier JF, Molteni F, Abdulla S, Montgomery SM, Kaneko A, Björkman A: Impact of artemisinin-based combination therapy and insecticide-treated nets on malaria burden in Zanzibar. PLoS Med. 2007, 4 (11): e309-10.1371/journal.pmed.0040309.CrossRefPubMedPubMedCentral
28.
go back to reference Mabaso ML, Vounatsou P, Midzi S, Da Silva J, Smith T: Spatio-temporal analysis of the role of climate in inter-annual variation of malaria incidence in Zimbabwe. Int J Health Geogr. 2006, 5: 20-10.1186/1476-072X-5-20.CrossRefPubMedPubMedCentral Mabaso ML, Vounatsou P, Midzi S, Da Silva J, Smith T: Spatio-temporal analysis of the role of climate in inter-annual variation of malaria incidence in Zimbabwe. Int J Health Geogr. 2006, 5: 20-10.1186/1476-072X-5-20.CrossRefPubMedPubMedCentral
29.
go back to reference Noor AM, Alegana VA, Patil AP, Snow RW: Predicting the unmet need for biologically targeted coverage of insecticide-treated nets in Kenya. Am J Trop Med Hyg. 2010, 83 (4): 854-860. 10.4269/ajtmh.2010.10-0331.CrossRefPubMedPubMedCentral Noor AM, Alegana VA, Patil AP, Snow RW: Predicting the unmet need for biologically targeted coverage of insecticide-treated nets in Kenya. Am J Trop Med Hyg. 2010, 83 (4): 854-860. 10.4269/ajtmh.2010.10-0331.CrossRefPubMedPubMedCentral
30.
go back to reference Hu W, Clements A, Williams G, Tong S, Mengersen K: Bayesian spatiotemporal analysis of socio-ecologic drivers of Ross River virus transmission in Queensland, Australia. Am J Trop Med Hyg. 2010, 83 (3): 722-728. 10.4269/ajtmh.2010.09-0551.CrossRefPubMedPubMedCentral Hu W, Clements A, Williams G, Tong S, Mengersen K: Bayesian spatiotemporal analysis of socio-ecologic drivers of Ross River virus transmission in Queensland, Australia. Am J Trop Med Hyg. 2010, 83 (3): 722-728. 10.4269/ajtmh.2010.09-0551.CrossRefPubMedPubMedCentral
31.
go back to reference Griffin JT, Hollingsworth TD, Okell LC, Churcher TS, White M, Hinsley W, Bousema T, Drakeley CJ, Ferguson NM, Basáñez MG, Ghani AC: Reducing Plasmodium falciparum malaria transmission in Africa: a model-based evaluation of intervention strategies. PLoS Med. 2010, 7 (8): e1000324-10.1371/journal.pmed.1000324.CrossRefPubMedPubMedCentral Griffin JT, Hollingsworth TD, Okell LC, Churcher TS, White M, Hinsley W, Bousema T, Drakeley CJ, Ferguson NM, Basáñez MG, Ghani AC: Reducing Plasmodium falciparum malaria transmission in Africa: a model-based evaluation of intervention strategies. PLoS Med. 2010, 7 (8): e1000324-10.1371/journal.pmed.1000324.CrossRefPubMedPubMedCentral
32.
go back to reference Smith DL, Hay SI, Noor AM, Snow RW: Predicting changing malaria risk after expanded insecticide-treated net coverage in Africa. Trends Parasitol. 2009, 25 (11): 511-516. 10.1016/j.pt.2009.08.002.CrossRefPubMedPubMedCentral Smith DL, Hay SI, Noor AM, Snow RW: Predicting changing malaria risk after expanded insecticide-treated net coverage in Africa. Trends Parasitol. 2009, 25 (11): 511-516. 10.1016/j.pt.2009.08.002.CrossRefPubMedPubMedCentral
33.
go back to reference Chitnis N, Schapira A, Smith T, Steketee R: Comparing the effectiveness of malaria vector-control interventions through a mathematical model. Am J Trop Med Hyg. 2010, 83 (2): 230-240. 10.4269/ajtmh.2010.09-0179.CrossRefPubMedPubMedCentral Chitnis N, Schapira A, Smith T, Steketee R: Comparing the effectiveness of malaria vector-control interventions through a mathematical model. Am J Trop Med Hyg. 2010, 83 (2): 230-240. 10.4269/ajtmh.2010.09-0179.CrossRefPubMedPubMedCentral
34.
go back to reference Wondji CS, Coleman M, Kleinschmidt I, Mzilahowa T, Irving H, Ndula M, Rehman A, Morgan J, Barnes KG, Hemingway J: Impact of pyrethroid resistance on operational malaria control in Malawi. Proc Natl Acad Sci. 2012, 109 (47): 19063-19070. 10.1073/pnas.1217229109.CrossRefPubMedPubMedCentral Wondji CS, Coleman M, Kleinschmidt I, Mzilahowa T, Irving H, Ndula M, Rehman A, Morgan J, Barnes KG, Hemingway J: Impact of pyrethroid resistance on operational malaria control in Malawi. Proc Natl Acad Sci. 2012, 109 (47): 19063-19070. 10.1073/pnas.1217229109.CrossRefPubMedPubMedCentral
35.
go back to reference Roca-Feltrer A, Kwizombe CJ, Sanjoaquin MA, Sesay SS, Faragher B, Harrison J, Geukers K, Kabuluzi S, Mathanga DP, Molyneux E, Chagomera M, Taylor T, Molyneux M, Heyderman RS: Lack of decline in childhood malaria, Malawi, 2001–2010. Emerg Infect Dis. 2012, 18 (2): 272-278. 10.3201/eid1802.111008.CrossRefPubMedPubMedCentral Roca-Feltrer A, Kwizombe CJ, Sanjoaquin MA, Sesay SS, Faragher B, Harrison J, Geukers K, Kabuluzi S, Mathanga DP, Molyneux E, Chagomera M, Taylor T, Molyneux M, Heyderman RS: Lack of decline in childhood malaria, Malawi, 2001–2010. Emerg Infect Dis. 2012, 18 (2): 272-278. 10.3201/eid1802.111008.CrossRefPubMedPubMedCentral
37.
go back to reference Over M, Bakote'e B, Velayudhan R, Wilikai P, Graves PM: Impregnated nets or DDT residual spraying? Field effectiveness of malaria prevention techniques in Solomon Islands, 1993–1999. Am J Trop Med Hyg. 2004, 71 (2 Suppl): 214-223.PubMed Over M, Bakote'e B, Velayudhan R, Wilikai P, Graves PM: Impregnated nets or DDT residual spraying? Field effectiveness of malaria prevention techniques in Solomon Islands, 1993–1999. Am J Trop Med Hyg. 2004, 71 (2 Suppl): 214-223.PubMed
38.
go back to reference Rowe AK, Steketee RW, Arnold F, Wardlaw T, Basu S, Bakyaita N, Lama M, Winston CA, Lynch M, Cibulskis RE, Shibuya K, Ratcliffe AA, Nahlen BL: Viewpoint: evaluating the impact of malaria control efforts on mortality in sub-Saharan Africa. Trop Med Int Health. 2007, 12 (12): 1524-1539. 10.1111/j.1365-3156.2007.01961.x.CrossRefPubMed Rowe AK, Steketee RW, Arnold F, Wardlaw T, Basu S, Bakyaita N, Lama M, Winston CA, Lynch M, Cibulskis RE, Shibuya K, Ratcliffe AA, Nahlen BL: Viewpoint: evaluating the impact of malaria control efforts on mortality in sub-Saharan Africa. Trop Med Int Health. 2007, 12 (12): 1524-1539. 10.1111/j.1365-3156.2007.01961.x.CrossRefPubMed
Metadata
Title
A methodological framework for the improved use of routine health system data to evaluate national malaria control programs: evidence from Zambia
Authors
Adam Bennett
Joshua Yukich
John M Miller
Penelope Vounatsou
Busiku Hamainza
Mercy M Ingwe
Hawela B Moonga
Mulakwo Kamuliwo
Joseph Keating
Thomas A Smith
Richard W Steketee
Thomas P Eisele
Publication date
01-12-2014
Publisher
BioMed Central
Published in
Population Health Metrics / Issue 1/2014
Electronic ISSN: 1478-7954
DOI
https://doi.org/10.1186/s12963-014-0030-0

Other articles of this Issue 1/2014

Population Health Metrics 1/2014 Go to the issue