Skip to main content
Top
Published in: Population Health Metrics 1/2015

Open Access 01-12-2015 | Research

Effects of a health information system data quality intervention on concordance in Mozambique: time-series analyses from 2009–2012

Authors: Bradley H Wagenaar, Sarah Gimbel, Roxanne Hoek, James Pfeiffer, Cathy Michel, João Luis Manuel, Fatima Cuembelo, Titos Quembo, Pires Afonso, Victoria Porthé, Stephen Gloyd, Kenneth Sherr

Published in: Population Health Metrics | Issue 1/2015

Login to get access

Abstract

Background

We assessed the effects of a three-year national-level, ministry-led health information system (HIS) data quality intervention and identified associated health facility factors.

Methods

Monthly summary HIS data concordance between a gold standard data quality audit and routine HIS data was assessed in 26 health facilities in Sofala Province, Mozambique across four indicators (outpatient consults, institutional births, first antenatal care visits, and third dose of diphtheria, pertussis, and tetanus vaccination) and five levels of health system data aggregation (daily facility paper registers, monthly paper facility reports, monthly paper district reports, monthly electronic district reports, and monthly electronic provincial reports) through retrospective yearly audits conducted July-August 2010–2013. We used mixed-effects linear models to quantify changes in data quality over time and associated health system determinants.

Results

Median concordance increased from 56.3% during the baseline period (2009–2010) to 87.5% during 2012–2013. Concordance improved by 1.0% (confidence interval [CI]: 0.60, 1.5) per month during the intervention period of 2010–2011 and 1.6% (CI: 0.89, 2.2) per month from 2011–2012. No significant improvements were observed from 2009–2010 (during baseline period) or 2012–2013. Facilities with more technical staff (aβ: 0.71; CI: 0.14, 1.3), more first antenatal care visits (aβ: 3.3; CI: 0.43, 6.2), and fewer clinic beds (aβ: -0.94; CI: −1.7, −0.20) showed more improvements. Compared to facilities with no stock-outs, facilities with five essential drugs stocked out had 51.7% (CI: −64.8 -38.6) lower data concordance.

Conclusions

A data quality intervention was associated with significant improvements in health information system data concordance across public-sector health facilities in rural and urban Mozambique. Concordance was higher at those facilities with more human resources for health and was associated with fewer clinic-level stock-outs of essential medicines. Increased investments should be made in data audit and feedback activities alongside targeted efforts to improve HIS data in low- and middle-income countries.
Literature
1.
go back to reference AbouZahr C, Boerma T. Health information systems: the foundations of public health. Bull World Health Organ. 2005;83:578–83.PubMedPubMedCentral AbouZahr C, Boerma T. Health information systems: the foundations of public health. Bull World Health Organ. 2005;83:578–83.PubMedPubMedCentral
2.
go back to reference Bosch-Capblanch X, Ronveau O, Doyle V, Remedios V, Bchir A. Accuracy and quality of immunization information systems in fourty-one low income countries. Trop Med Int Health. 2009;14(1):2–10.CrossRefPubMed Bosch-Capblanch X, Ronveau O, Doyle V, Remedios V, Bchir A. Accuracy and quality of immunization information systems in fourty-one low income countries. Trop Med Int Health. 2009;14(1):2–10.CrossRefPubMed
4.
go back to reference Lim SS, David SB, Charrow A, Murray CJL. Tracking progress towards universal childhood immunisation and the impact of global initiatives: a systematic analyses of three-dose diphtheria, tetanus, and pertussis immunisation coverage. Lancet. 2008;372:2031–46.CrossRefPubMed Lim SS, David SB, Charrow A, Murray CJL. Tracking progress towards universal childhood immunisation and the impact of global initiatives: a systematic analyses of three-dose diphtheria, tetanus, and pertussis immunisation coverage. Lancet. 2008;372:2031–46.CrossRefPubMed
5.
go back to reference Murray CJL, Shengelia B, Gupta N, Moussavi S, Tandon A, Thieren M. Validity of reported vaccination coverage in 45 countries. Lancet. 2003;362:1022–7.CrossRefPubMed Murray CJL, Shengelia B, Gupta N, Moussavi S, Tandon A, Thieren M. Validity of reported vaccination coverage in 45 countries. Lancet. 2003;362:1022–7.CrossRefPubMed
6.
go back to reference Gething P, Noor A, Gikandi P, Ogara EA, Hay SI, Nixon MS, et al. Improving imperfect data from health management information systems in Africa using space-time geostatistics. PLoS Med. 2006;3:e271.CrossRefPubMedPubMedCentral Gething P, Noor A, Gikandi P, Ogara EA, Hay SI, Nixon MS, et al. Improving imperfect data from health management information systems in Africa using space-time geostatistics. PLoS Med. 2006;3:e271.CrossRefPubMedPubMedCentral
7.
go back to reference Rowe AK, Kachur PS, Yoon SS, Lynch M, Slutsker L, Steketee R. Caution is required when using health facility-based data to evaluate the health impact of malaria control efforts in Africa. Malar J. 2009;8(209). Rowe AK, Kachur PS, Yoon SS, Lynch M, Slutsker L, Steketee R. Caution is required when using health facility-based data to evaluate the health impact of malaria control efforts in Africa. Malar J. 2009;8(209).
8.
go back to reference Mate KS, Bennett B, Mphatswe W, Barker P, Rollins N. Challenges for routine health system data management in a large public programme to prevent mother-to-child HIV transmission in South Africa. PLoS One. 2009;4(5):e5483.CrossRefPubMedPubMedCentral Mate KS, Bennett B, Mphatswe W, Barker P, Rollins N. Challenges for routine health system data management in a large public programme to prevent mother-to-child HIV transmission in South Africa. PLoS One. 2009;4(5):e5483.CrossRefPubMedPubMedCentral
9.
go back to reference Amouzou A, Kachaka W, Banda B, Chimzimu M, Hill K, Bryce J. Monitoring child survival in ‘real time’ using routine health facility records: results from Malawi. Trop Med Int Health. 2013; doi:10.1111/tmi.12167. Amouzou A, Kachaka W, Banda B, Chimzimu M, Hill K, Bryce J. Monitoring child survival in ‘real time’ using routine health facility records: results from Malawi. Trop Med Int Health. 2013; doi:10.1111/tmi.12167.
10.
go back to reference Rowe AK. Potential of integrated continuous surveys and quality management to support monitoring, evaluation, and the scale-up of health interventions in developing countries. Am J Trop Med Hyg. 2009;80(6):971–9.PubMed Rowe AK. Potential of integrated continuous surveys and quality management to support monitoring, evaluation, and the scale-up of health interventions in developing countries. Am J Trop Med Hyg. 2009;80(6):971–9.PubMed
11.
go back to reference Admon AJ, Bazile J, Makungwa H, Chingoli MA, Hirschhorn LR, Peckarsky M, et al. Assessing and improving data quality from community health workers: a successful intervention in Neno, Malawi. Public Health Action. 2013;3(1):56–9.CrossRefPubMedPubMedCentral Admon AJ, Bazile J, Makungwa H, Chingoli MA, Hirschhorn LR, Peckarsky M, et al. Assessing and improving data quality from community health workers: a successful intervention in Neno, Malawi. Public Health Action. 2013;3(1):56–9.CrossRefPubMedPubMedCentral
12.
go back to reference Mphatswe W, Mate KS, Bennett B, Ngidi H, Reddy J, Barker PM, et al. Improving public health information: a data quality intervention in KwaZulu-Natal, South Africa. Bull World Health Organ. 2012;90:176–82.CrossRefPubMed Mphatswe W, Mate KS, Bennett B, Ngidi H, Reddy J, Barker PM, et al. Improving public health information: a data quality intervention in KwaZulu-Natal, South Africa. Bull World Health Organ. 2012;90:176–82.CrossRefPubMed
13.
go back to reference Braa J, Heywood A, Sahay S. Improving quality and use of data through data-use workshops: Zanzibar, United Republic of Tanzania. Bull World Health Organ. 2012;90:379–84.CrossRefPubMedPubMedCentral Braa J, Heywood A, Sahay S. Improving quality and use of data through data-use workshops: Zanzibar, United Republic of Tanzania. Bull World Health Organ. 2012;90:379–84.CrossRefPubMedPubMedCentral
14.
go back to reference Cibulskis RE, Hiawalyer G. Information systems for health sector monitoring in Papua New Guinea. Bull World Health Organ. 2002;80:752–8.PubMedPubMedCentral Cibulskis RE, Hiawalyer G. Information systems for health sector monitoring in Papua New Guinea. Bull World Health Organ. 2002;80:752–8.PubMedPubMedCentral
15.
go back to reference Sherr K, Cuembelo F, Michel C, Gimbel, S, Micek, M, Kariaganis, M, et al. Strengthening integrated primary health care in Sofala, Mozambique. BMC Health Serv Res. 2013;13(Suppl 2:S4). Sherr K, Cuembelo F, Michel C, Gimbel, S, Micek, M, Kariaganis, M, et al. Strengthening integrated primary health care in Sofala, Mozambique. BMC Health Serv Res. 2013;13(Suppl 2:S4).
16.
go back to reference Wagenaar BH, Gimbel S, Hoek R, Pfeiffer, J, Michel, C, Manuel, JL, et al. Stock-outs of essential health products in Mozambique - Longitudinal analyses from 2011 to 2013. Trop Med Int Health. 2014; doi:10.1111/tmi.12314. Wagenaar BH, Gimbel S, Hoek R, Pfeiffer, J, Michel, C, Manuel, JL, et al. Stock-outs of essential health products in Mozambique - Longitudinal analyses from 2011 to 2013. Trop Med Int Health. 2014; doi:10.1111/tmi.12314.
17.
go back to reference Mutale W, Chintu N, Amoroso C, Awoonor-Williams K, Phillips J, Baynes C, et al. Improving health information systems for decision making across five sub-Saharan African countries: implementation strategies from the African health initiative. BMC Health Serv Res. 2013;13 Suppl 2:59.CrossRef Mutale W, Chintu N, Amoroso C, Awoonor-Williams K, Phillips J, Baynes C, et al. Improving health information systems for decision making across five sub-Saharan African countries: implementation strategies from the African health initiative. BMC Health Serv Res. 2013;13 Suppl 2:59.CrossRef
18.
go back to reference Gimbel S, Micek M, Lambdin B, Lara J, Karagianis M, Cuembelo F, et al. An assessment of routine primary care health information system data quality in Sofala Province, Mozambique. Popul Health Metr. 2011;9(12). Gimbel S, Micek M, Lambdin B, Lara J, Karagianis M, Cuembelo F, et al. An assessment of routine primary care health information system data quality in Sofala Province, Mozambique. Popul Health Metr. 2011;9(12).
19.
go back to reference Ledikwe J, Gringnon J, Lebelonyane R, Ludick, S, Matshediso, E, Sento, BW. Improving the quality of health information: a qualitative assessment of data management and reporting systems in Botswana. Health Res Policy Syst. 2014;30(12). Ledikwe J, Gringnon J, Lebelonyane R, Ludick, S, Matshediso, E, Sento, BW. Improving the quality of health information: a qualitative assessment of data management and reporting systems in Botswana. Health Res Policy Syst. 2014;30(12).
20.
go back to reference Nicol E, Bradshaw D, Phillips T, Dudley L. Human factors affecting the quality of routinely collected data in South Africa. Stud Health Technol Inform. 2013;192:788–92.PubMed Nicol E, Bradshaw D, Phillips T, Dudley L. Human factors affecting the quality of routinely collected data in South Africa. Stud Health Technol Inform. 2013;192:788–92.PubMed
21.
go back to reference Fernandes Q, Wagenaar BH, Anselmi L, Pfeiffer J, Gloyd S, Sherr K. Effects of health-system strengthening on under-5, infant, and neonatal mortality: 11-year provincial-level time-series analyses in Mozambique. Lancet Global Health. 2014;2(e468-77). Fernandes Q, Wagenaar BH, Anselmi L, Pfeiffer J, Gloyd S, Sherr K. Effects of health-system strengthening on under-5, infant, and neonatal mortality: 11-year provincial-level time-series analyses in Mozambique. Lancet Global Health. 2014;2(e468-77).
22.
go back to reference Victora C, Black R, Boerma T, Bryce J. Measuring impact in the Millennium Development Goal era and Beyond: a new approach to large-scale effectiveness evaluations. Lancet. 2011;377(85–95). Victora C, Black R, Boerma T, Bryce J. Measuring impact in the Millennium Development Goal era and Beyond: a new approach to large-scale effectiveness evaluations. Lancet. 2011;377(85–95).
Metadata
Title
Effects of a health information system data quality intervention on concordance in Mozambique: time-series analyses from 2009–2012
Authors
Bradley H Wagenaar
Sarah Gimbel
Roxanne Hoek
James Pfeiffer
Cathy Michel
João Luis Manuel
Fatima Cuembelo
Titos Quembo
Pires Afonso
Victoria Porthé
Stephen Gloyd
Kenneth Sherr
Publication date
01-12-2015
Publisher
BioMed Central
Published in
Population Health Metrics / Issue 1/2015
Electronic ISSN: 1478-7954
DOI
https://doi.org/10.1186/s12963-015-0043-3

Other articles of this Issue 1/2015

Population Health Metrics 1/2015 Go to the issue