Skip to main content
Top
Published in: Health Research Policy and Systems 1/2014

Open Access 01-12-2014 | Research

Improving the quality of health information: a qualitative assessment of data management and reporting systems in Botswana

Authors: Jenny H Ledikwe, Jessica Grignon, Refeletswe Lebelonyane, Steven Ludick, Ellah Matshediso, Baraedi W Sento, Anjali Sharma, Bazghina-werq Semo

Published in: Health Research Policy and Systems | Issue 1/2014

Login to get access

Abstract

Background

Ensuring that data collected through national health information systems are of sufficient quality for meaningful interpretation is a challenge in many resource-limited countries. An assessment was conducted to identify strengths and weaknesses of the health data management and reporting systems that capture and transfer routine monitoring and evaluation (M&E) data in Botswana.

Methods

This was a descriptive, qualitative assessment. In-depth interviews were conducted at the national (n = 27), district (n = 31), and facility/community (n = 71) levels to assess i) M&E structures, functions, and capabilities; ii) indicator definitions and reporting guidelines; iii) data collection forms and tools; iv) data management processes; and v) links with the national reporting system. A framework analysis was conducted using ATLAS.ti v6.1.

Results

Health programs generally had standardized data collection and reporting tools and defined personnel for M&E responsibilities at the national and district levels. Best practices unique to individual health programs were identified and included a variety of relatively low-resource initiatives such as attention to staffing patterns, making health data more accessible for evidence-based decision-making, developing a single source of information related to indicator definitions, data collection tools, and management processes, and utilization of supportive supervision visits to districts and facilities. Weakness included limited ownership of M&E-related duties within facilities, a lack of tertiary training programs to build M&E skills, few standard practices related to confidentiality and document storage, limited dissemination of indicator definitions, and limited functionality of electronic data management systems.

Conclusions

Addressing fundamental M&E system issues, further standardization of M&E practices, and increasing health services management responsiveness to time-sensitive information are critical to sustain progress related to health service delivery in Botswana. In addition to high-resource initiatives, such as investments in electronic medical record systems and tertiary training programs, there are a variety of low-resource initiatives, such as regular data quality checks, that can strengthen national health information systems. Applying best practices that are effective within one health program to data management and reporting systems of other programs is a practical approach for strengthening health informatics and improving data quality.
Literature
1.
go back to reference World Health Organization: Everybody’s Business: Strengthening Health Systems to Improve Health Outcomes. 2007, Geneva: World Health Organization World Health Organization: Everybody’s Business: Strengthening Health Systems to Improve Health Outcomes. 2007, Geneva: World Health Organization
2.
go back to reference World Health Organization: Monitoring the Building Blocks of Health Systems: A Handbook of Indicators and Their Measurement Strategies. 2010, Geneva: World Health Organization World Health Organization: Monitoring the Building Blocks of Health Systems: A Handbook of Indicators and Their Measurement Strategies. 2010, Geneva: World Health Organization
3.
go back to reference Nutley T: Improving Data use in Decision Making: An Intervention to Strengthen Health Systems. 2012, Chapel Hill, NC: MEASURE Evaluation Nutley T: Improving Data use in Decision Making: An Intervention to Strengthen Health Systems. 2012, Chapel Hill, NC: MEASURE Evaluation
4.
go back to reference AbouZahr C, Boerma T: Health information systems: the foundations of public health. Bull World Health Organ. 2005, 83 (8): 578-583.PubMedPubMedCentral AbouZahr C, Boerma T: Health information systems: the foundations of public health. Bull World Health Organ. 2005, 83 (8): 578-583.PubMedPubMedCentral
5.
go back to reference Chan M, Kazatchkine M, Lob-Levyt J, Obaid T, Schweizer J, Sidibe M, Veneman A, Yamada T: Meeting the demand for results and accountability: a call for action on health data from eight global health agencies. PLoS Med. 2010, 7 (1): e1000223-10.1371/journal.pmed.1000223.CrossRefPubMedPubMedCentral Chan M, Kazatchkine M, Lob-Levyt J, Obaid T, Schweizer J, Sidibe M, Veneman A, Yamada T: Meeting the demand for results and accountability: a call for action on health data from eight global health agencies. PLoS Med. 2010, 7 (1): e1000223-10.1371/journal.pmed.1000223.CrossRefPubMedPubMedCentral
7.
go back to reference Burger EH, van der Merwe L, Volmink J: Errors in the completion of the death notification form. S Afr Med J. 2007, 97 (11): 1077-1081.PubMed Burger EH, van der Merwe L, Volmink J: Errors in the completion of the death notification form. S Afr Med J. 2007, 97 (11): 1077-1081.PubMed
8.
go back to reference Bosch-Capblanch X, Ronveaux O, Doyle V, Remedios V, Bchir A: Accuracy and quality of immunization information systems in forty-one low income countries. Trop Med Int Health. 2009, 14 (1): 2-10. 10.1111/j.1365-3156.2008.02181.x.CrossRefPubMed Bosch-Capblanch X, Ronveaux O, Doyle V, Remedios V, Bchir A: Accuracy and quality of immunization information systems in forty-one low income countries. Trop Med Int Health. 2009, 14 (1): 2-10. 10.1111/j.1365-3156.2008.02181.x.CrossRefPubMed
9.
go back to reference Makombe SD, Hochgesang M, Jahn A, Tweya H, Hedt B, Chuka S, Yu JK, Aberle-Grasse J, Pasulani O, Bailey C, Kamoto K, Schouten EJ, Harries AD: Assessing the quality of data aggregated by antiretroviral treatment clinics in Malawi. Bull World Health Organ. 2008, 86 (4): 310-314. 10.2471/BLT.07.044685.CrossRefPubMedPubMedCentral Makombe SD, Hochgesang M, Jahn A, Tweya H, Hedt B, Chuka S, Yu JK, Aberle-Grasse J, Pasulani O, Bailey C, Kamoto K, Schouten EJ, Harries AD: Assessing the quality of data aggregated by antiretroviral treatment clinics in Malawi. Bull World Health Organ. 2008, 86 (4): 310-314. 10.2471/BLT.07.044685.CrossRefPubMedPubMedCentral
10.
go back to reference Mate KS, Bennett B, Mphatswe W, Barker P, Rollins N: Challenges for routine health system data management in a large public programme to prevent mother-to-child HIV transmission in South Africa. PLoS One. 2009, 4 (5): e5483-10.1371/journal.pone.0005483.CrossRefPubMedPubMedCentral Mate KS, Bennett B, Mphatswe W, Barker P, Rollins N: Challenges for routine health system data management in a large public programme to prevent mother-to-child HIV transmission in South Africa. PLoS One. 2009, 4 (5): e5483-10.1371/journal.pone.0005483.CrossRefPubMedPubMedCentral
11.
go back to reference Mphatswe W, Mate KS, Bennett B, Ngidi H, Reddy J, Barkerb PM, Rollins N: Improving public health information: a data quality intervention in KwaZulu-Natal, South Africa. Bull World Health Organ. 2012, 90 (3): 176-182. 10.2471/BLT.11.092759.CrossRefPubMed Mphatswe W, Mate KS, Bennett B, Ngidi H, Reddy J, Barkerb PM, Rollins N: Improving public health information: a data quality intervention in KwaZulu-Natal, South Africa. Bull World Health Organ. 2012, 90 (3): 176-182. 10.2471/BLT.11.092759.CrossRefPubMed
12.
go back to reference Huaman MA, Araujo-Castillo RV, Soto G, Neyra JM, Quispe JA, Fernandez MF, Mundaca CC, Blazes DL: Impact of two interventions on timeliness and data quality of an electronic disease surveillance system in a resource limited setting (Peru): a prospective evaluation. BMC Med Inform Decis Mak. 2009, 9: 16-10.1186/1472-6947-9-16.CrossRefPubMedPubMedCentral Huaman MA, Araujo-Castillo RV, Soto G, Neyra JM, Quispe JA, Fernandez MF, Mundaca CC, Blazes DL: Impact of two interventions on timeliness and data quality of an electronic disease surveillance system in a resource limited setting (Peru): a prospective evaluation. BMC Med Inform Decis Mak. 2009, 9: 16-10.1186/1472-6947-9-16.CrossRefPubMedPubMedCentral
13.
go back to reference Aqil A, Lippeveld T, Hozumi D: PRISM framework: a paradigm shift for designing, strengthening and evaluating routine health information systems. Health Policy Plan. 2009, 24 (3): 217-228. 10.1093/heapol/czp010.CrossRefPubMedPubMedCentral Aqil A, Lippeveld T, Hozumi D: PRISM framework: a paradigm shift for designing, strengthening and evaluating routine health information systems. Health Policy Plan. 2009, 24 (3): 217-228. 10.1093/heapol/czp010.CrossRefPubMedPubMedCentral
14.
go back to reference Hotchkiss DR, Aqil A, Lippeveld T, Mukooyo E: Evaluation of the Performance of Routine Information System Management (PRISM) framework: evidence from Uganda. BMC Health Serv Res. 2010, 10: 188-10.1186/1472-6963-10-188.CrossRefPubMedPubMedCentral Hotchkiss DR, Aqil A, Lippeveld T, Mukooyo E: Evaluation of the Performance of Routine Information System Management (PRISM) framework: evidence from Uganda. BMC Health Serv Res. 2010, 10: 188-10.1186/1472-6963-10-188.CrossRefPubMedPubMedCentral
15.
go back to reference Green J, Thorogood N: Qualitative Methods for Health Research. 2009, London: Sage Green J, Thorogood N: Qualitative Methods for Health Research. 2009, London: Sage
16.
go back to reference Ward DJ, Furber C, Tierney S, Swallow V: Using framework analysis in nursing research: a worked example. J Adv Nurs. 2013, 69 (11): 2423-2431.PubMed Ward DJ, Furber C, Tierney S, Swallow V: Using framework analysis in nursing research: a worked example. J Adv Nurs. 2013, 69 (11): 2423-2431.PubMed
17.
go back to reference Government of Botswana National AIDS Coordinating Agency (NACA): Progress Report of the National Response to the 2001 Declaration of Commitment on HIV and AIDS: Botswana Country Report 2010. 2010, Gaborone, Botswana: NACA Government of Botswana National AIDS Coordinating Agency (NACA): Progress Report of the National Response to the 2001 Declaration of Commitment on HIV and AIDS: Botswana Country Report 2010. 2010, Gaborone, Botswana: NACA
18.
go back to reference Otwombe KN, Wanyungu J, Nduku K, Taegtmeyer M: Improving national data collection systems from voluntary counselling and testing centres in Kenya. Bull World Health Organ. 2007, 85 (4): 315-318. 10.2471/BLT.06.033712.CrossRefPubMedPubMedCentral Otwombe KN, Wanyungu J, Nduku K, Taegtmeyer M: Improving national data collection systems from voluntary counselling and testing centres in Kenya. Bull World Health Organ. 2007, 85 (4): 315-318. 10.2471/BLT.06.033712.CrossRefPubMedPubMedCentral
19.
go back to reference Callaghan M, Ford N, Schneider H: A systematic review of task- shifting for HIV treatment and care in Africa. Hum Resour Health. 2010, 8: 8-10.1186/1478-4491-8-8.CrossRefPubMedPubMedCentral Callaghan M, Ford N, Schneider H: A systematic review of task- shifting for HIV treatment and care in Africa. Hum Resour Health. 2010, 8: 8-10.1186/1478-4491-8-8.CrossRefPubMedPubMedCentral
20.
go back to reference Mdege ND, Chindove S, Ali S: The effectiveness and cost implications of task-shifting in the delivery of antiretroviral therapy to HIV-infected patients: a systematic review. Health Policy Plan. 2013, 28 (3): 223-236. 10.1093/heapol/czs058.CrossRefPubMed Mdege ND, Chindove S, Ali S: The effectiveness and cost implications of task-shifting in the delivery of antiretroviral therapy to HIV-infected patients: a systematic review. Health Policy Plan. 2013, 28 (3): 223-236. 10.1093/heapol/czs058.CrossRefPubMed
21.
go back to reference Ledikwe JH, Kejelepula M, Maupo K, Sebetso S, Thekiso M, Smith M, Mbayi B, Houghton N, Thankane K, O'Malley G, Semo BW: Evaluation of a well-established task-shifting initiative: the lay counselor cadre in Botswana. PLoS One. 2013, 8 (4): e61601-10.1371/journal.pone.0061601.CrossRefPubMedPubMedCentral Ledikwe JH, Kejelepula M, Maupo K, Sebetso S, Thekiso M, Smith M, Mbayi B, Houghton N, Thankane K, O'Malley G, Semo BW: Evaluation of a well-established task-shifting initiative: the lay counselor cadre in Botswana. PLoS One. 2013, 8 (4): e61601-10.1371/journal.pone.0061601.CrossRefPubMedPubMedCentral
22.
go back to reference Ledikwe JH, Reason LL, Burnett SM, Busang L, Bodika S, Lebelonyane R, Ludick S, Matshediso E, Mawandia S, Mmelesi M, Sento B, Semo BW: Establishing a health information workforce: innovation for low- and middle-income countries. Hum Resourc Health. 2013, 11 (1): 35-10.1186/1478-4491-11-35.CrossRef Ledikwe JH, Reason LL, Burnett SM, Busang L, Bodika S, Lebelonyane R, Ludick S, Matshediso E, Mawandia S, Mmelesi M, Sento B, Semo BW: Establishing a health information workforce: innovation for low- and middle-income countries. Hum Resourc Health. 2013, 11 (1): 35-10.1186/1478-4491-11-35.CrossRef
23.
go back to reference Chaulagai CN, Moyo CM, Koot J, Moyo HB, Sambakunsi TC, Khunga FM, Naphini PD: Design and implementation of a health management information system in Malawi: issues, innovations and results. Health Policy Plan. 2005, 20 (6): 375-384. 10.1093/heapol/czi044.CrossRefPubMed Chaulagai CN, Moyo CM, Koot J, Moyo HB, Sambakunsi TC, Khunga FM, Naphini PD: Design and implementation of a health management information system in Malawi: issues, innovations and results. Health Policy Plan. 2005, 20 (6): 375-384. 10.1093/heapol/czi044.CrossRefPubMed
24.
go back to reference Braa J, Heywood A, Sahay S: Improving quality and use of data through data-use workshops: Zanzibar, United Republic of Tanzania. Bull World Health Organ. 2012, 90 (5): 379-384. 10.2471/BLT.11.99580.CrossRefPubMedPubMedCentral Braa J, Heywood A, Sahay S: Improving quality and use of data through data-use workshops: Zanzibar, United Republic of Tanzania. Bull World Health Organ. 2012, 90 (5): 379-384. 10.2471/BLT.11.99580.CrossRefPubMedPubMedCentral
25.
go back to reference Nash D, Elul B, Rabkin M, Tun M, Saito S, Becker M, Nuwagaba-Biribonwoha H: Strategies for more effective monitoring and evaluation systems in HIV programmatic scale-up in resource-limited settings: implications for health systems strengthening. J Acquir Immune Defic Syndr. 2009, 52 (Suppl 1): S58-S62.CrossRefPubMed Nash D, Elul B, Rabkin M, Tun M, Saito S, Becker M, Nuwagaba-Biribonwoha H: Strategies for more effective monitoring and evaluation systems in HIV programmatic scale-up in resource-limited settings: implications for health systems strengthening. J Acquir Immune Defic Syndr. 2009, 52 (Suppl 1): S58-S62.CrossRefPubMed
26.
go back to reference Ekouevi DK, Karcher S, Coffie PA: Strengthening health systems through HIV monitoring and evaluation in Sub-Saharan Africa. Curr Opin HIV AIDS. 2011, 6 (4): 245-250. 10.1097/COH.0b013e3283479316.CrossRefPubMed Ekouevi DK, Karcher S, Coffie PA: Strengthening health systems through HIV monitoring and evaluation in Sub-Saharan Africa. Curr Opin HIV AIDS. 2011, 6 (4): 245-250. 10.1097/COH.0b013e3283479316.CrossRefPubMed
27.
go back to reference Bukachi F, Pakenham-Walsh N: Information technology for health in developing countries. Chest. 2007, 132 (5): 1624-1630. 10.1378/chest.07-1760.CrossRefPubMed Bukachi F, Pakenham-Walsh N: Information technology for health in developing countries. Chest. 2007, 132 (5): 1624-1630. 10.1378/chest.07-1760.CrossRefPubMed
28.
go back to reference Government of Botswana National AIDS Coordinating Agency (NACA): Botswana 2012 Global AIDS Response Report. 2012, Gaborone, Botswana: NACA Government of Botswana National AIDS Coordinating Agency (NACA): Botswana 2012 Global AIDS Response Report. 2012, Gaborone, Botswana: NACA
29.
go back to reference Nsanzimana S, Ruton H, Lowrance DW, Cishahayo S, Nyemazi JP, Muhayimpundu R, Karema C, Raghunathan PL, Binagwaho A, Riedel DJ: Cell phone-based and internet-based monitoring and evaluation of the National Antiretroviral Treatment Program during rapid scale-up in Rwanda: TRACnet, 2004–2010. J Acquir Immune Defic Syndr. 2012, 59 (2): e17-e23. 10.1097/QAI.0b013e31823e2278.CrossRefPubMed Nsanzimana S, Ruton H, Lowrance DW, Cishahayo S, Nyemazi JP, Muhayimpundu R, Karema C, Raghunathan PL, Binagwaho A, Riedel DJ: Cell phone-based and internet-based monitoring and evaluation of the National Antiretroviral Treatment Program during rapid scale-up in Rwanda: TRACnet, 2004–2010. J Acquir Immune Defic Syndr. 2012, 59 (2): e17-e23. 10.1097/QAI.0b013e31823e2278.CrossRefPubMed
30.
go back to reference Shaw V: Health information system reform in South Africa: developing an essential data set. Bull World Health Organ. 2005, 83 (8): 632-636.PubMedPubMedCentral Shaw V: Health information system reform in South Africa: developing an essential data set. Bull World Health Organ. 2005, 83 (8): 632-636.PubMedPubMedCentral
31.
go back to reference Garrib A, Stoops N, McKenzie A, Dlamini L, Govender T, Rohde J, Herbst K: An evaluation of the district health information system in rural South Africa. S Afr Med J. 2008, 98 (7): 549-552.PubMed Garrib A, Stoops N, McKenzie A, Dlamini L, Govender T, Rohde J, Herbst K: An evaluation of the district health information system in rural South Africa. S Afr Med J. 2008, 98 (7): 549-552.PubMed
32.
go back to reference Kawonga M, Blaauw D, Fonn S: Aligning vertical interventions to health systems: a case study of the HIV monitoring and evaluation system in South Africa. Health Res Policy Syst. 2012, 10: 2-10.1186/1478-4505-10-2.CrossRefPubMedPubMedCentral Kawonga M, Blaauw D, Fonn S: Aligning vertical interventions to health systems: a case study of the HIV monitoring and evaluation system in South Africa. Health Res Policy Syst. 2012, 10: 2-10.1186/1478-4505-10-2.CrossRefPubMedPubMedCentral
33.
go back to reference Braa J, Kanter AS, Lesh N, Crichton R, Jolliffe B, Sæbø J, Kossi E, Seebregts CJ: Comprehensive yet scalable health information systems for low resource settings: a collaborative effort in sierra leone. AMIA Annu Symp Proc. 2010, 2010: 372-376.PubMedPubMedCentral Braa J, Kanter AS, Lesh N, Crichton R, Jolliffe B, Sæbø J, Kossi E, Seebregts CJ: Comprehensive yet scalable health information systems for low resource settings: a collaborative effort in sierra leone. AMIA Annu Symp Proc. 2010, 2010: 372-376.PubMedPubMedCentral
Metadata
Title
Improving the quality of health information: a qualitative assessment of data management and reporting systems in Botswana
Authors
Jenny H Ledikwe
Jessica Grignon
Refeletswe Lebelonyane
Steven Ludick
Ellah Matshediso
Baraedi W Sento
Anjali Sharma
Bazghina-werq Semo
Publication date
01-12-2014
Publisher
BioMed Central
Published in
Health Research Policy and Systems / Issue 1/2014
Electronic ISSN: 1478-4505
DOI
https://doi.org/10.1186/1478-4505-12-7

Other articles of this Issue 1/2014

Health Research Policy and Systems 1/2014 Go to the issue