Top

BMC Health Services Research

Published in:

Open Access 01-11-2017 | Research

Perceptions about data-informed decisions: an assessment of information-use in high HIV-prevalence settings in South Africa

Authors: Edward Nicol, Debbie Bradshaw, Jeannine Uwimana-Nicol, Lilian Dudley

Published in: BMC Health Services Research | Special Issue 2/2017

Abstract

Background

Information-use is an integral component of a routine health information system and essential to influence policy-making, program actions and research. Despite an increased amount of routine data collected, planning and resource-allocation decisions made by health managers for managing HIV programs are often not based on data. This study investigated the use of information, and barriers to using routine data for monitoring the prevention of mother-to-child transmission of HIV (PMTCT) programs in two high HIV-prevalence districts in South Africa.

Methods

We undertook an observational study using a multi-method approach, including an inventory of facility records and reports. The performance of routine information systems management (PRISM) diagnostic ‘Use of Information’ tool was used to assess the PMTCT information system for evidence of data use in 57 health facilities in two districts. Twenty-two in-depth interviews were conducted with key informants to investigate barriers to information use in decision-making. Participants were purposively selected based on their positions and experience with either producing PMTCT data and/or using data for management purposes. We computed descriptive statistics and used a general inductive approach to analyze the qualitative data.

Results

Despite the availability of mechanisms and processes to facilitate information-use in about two-thirds of the facilities, evidence of information-use (i.e., indication of some form of information-use in available RHIS reports) was demonstrated in 53% of the facilities. Information was inadequately used at district and facility levels to inform decisions and planning, but was selectively used for reporting and monitoring program outputs at the provincial level. The inadequate use of information stemmed from organizational issues such as the lack of a culture of information-use, lack of trust in the data, and the inability of program and facility managers to analyze, interpret and use information.

Conclusions

Managers’ inability to use information implied that decisions for program implementation and improving service delivery were not always based on data. This lack of data use could influence the delivery of health care services negatively. Facility and program managers should be provided with opportunities for capacity development as well as practice-based, in-service training, and be supported to use information for planning, management and decision-making.

World Health Organization. Health metrics network: framework and standards for country health information systems. Geneva: World Health Organization; 2008.

Aqil A, Lippeveld T. PRISM tools for assessing, monitoring and evaluating RHIS performance. MEASURE evaluation project; 2010. Available from: http://www.cpc.unc.edu/measure/tools/monitoring-evaluation-systems/prism. Accessed 04 Apr 2016.

Aqil A, Lippeveld T, Hozumi D. PRISM framework: a paradigm shift for designing, strengthening and evaluating routine health information systems. Health Policy Plan. 2009;24(3):217–28. https://doi.org/10.1093/heapol/czp010.CrossRefPubMedPubMedCentral

Nutley T, Reynolds HW. Improving the use of health data for health system strengthening. Glob Health Action. 2013;6:20001. https://doi.org/10.3402/gha.v6i0.20001.CrossRef

Aqil A. PRISM case studies. Strengthening and evaluating RHIS. Chapel Hill: Carolina Population Center, University of North Carolina. MEASURE Evaluation; 2008.

Mate KS, Bennett B, Mphatswe W, Barker P, Rollins N. Challenges for routine health system data management in a large public programme to prevent mother-to-child HIV transmission in South Africa. PLoS One. 2009;4(5):e5483. https://doi.org/10.1371/journal.pone.0005483.CrossRefPubMedPubMedCentral

Nicol E, Dudley L, Bradshaw D. Assessing the quality of routine data for the prevention of mother-to-child transmission of HIV: an analytical observational study in two health districts with high HIV prevalence in South Africa. Int J Med Inform. 2016;95:60–70. https://doi.org/10.1016/j.ijmedinf.2016.09.006.CrossRefPubMed

Nicol E, Bradshaw D. Maternal, newborn and child survival: data challenges. In: Fonn S, Padarath A, editors. South African health review. Durban: Health Systems Trust; 2010. p. 73–8.

Ferguson L, Grant AD, Ong'ech JO, Vusha S, Watson-Jones D, Ross DA. Prevention of mother-to-child transmission of HIV: assessing the accuracy of routinely collected data on maternal antiretroviral prophylaxis coverage in Kenya. Sex Transm Infect. 2012;88(2):120–4. https://doi.org/10.1136/sextrans-2011-050220.CrossRefPubMed

10.

Gimbel S, Micek M, Lambdin B, Lara J, Karagianis M, Cuembelo F, Gloyd S, Pfeiffer J, Sherr K. An assessment of routine primary care health information system data quality in Sofala Province, Mozambique. Popul Health Metr. 2011;9(1):12. https://doi.org/10.1186/1478-7954-9-12.CrossRefPubMedPubMedCentral

11.

Glèlè Ahanhanzo Y, Ouendo E-M, Kpozèhouen A, Levêque A, Makoutodé M, Dramaix-Wilmet M. Data quality assessment in the routine health information system: an application of the lot quality assurance sampling in Benin. Health Policy Plan. 2015;30(7):837–43. https://doi.org/10.1093/heapol/czu067.CrossRefPubMed

12.

Kumalo F. Health management information systems. In: Ijumba P, Padarath A, editors. South African health review 2006. Durban: Health Systems Trust; 2006. p. 65–76.

13.

Rohde JE, Shaw V, Hedberg C, Stoops N, Venter S, Venter K, Matshisi L. Information for primary health care. In: Barron P, Roma-Reardon J, editors. South African health review 2008. Durban: Health Systems Trust; 2008. p. 195–210.

14.

Ledikwe JH, Grignon J, Lebelonyane R, Ludick S, Matshediso E, Sento BW, et al. Improving the quality of health information: a qualitative assessment of data management and reporting systems in Botswana. Health Res Policy Syst. 2014;12:7. https://doi.org/10.1186/1478-4505-12-7.CrossRefPubMedPubMedCentral

15.

MEASURE Evaluation. Tools for Data Demand and Use in the Health Sector Performance of Routine Information Systems Management (PRISM) Tools. Chapel Hill: MEASURE Evaluation; 2011.

16.

World Health Organization. Health metrics network: assessing the national health information system: an assessment tool. – version 4.00. Geneva: WHO; 2008. Available from: https://books.google.co.za/books?id=rNNdgDGxj1UC&printsec=frontcover&source=gbs_ViewAPI&redir_esc=y#v=onepage&q&f=false. Accessed 18 Mar 2016

17.

Patton MQ. Utilization-focused evaluation., 4^th edition. Los Angeles: Safe Publications; 2008.

18.

Nutley T, Gnassou L, Traore M, Bosso AE, Mullen S. Moving data off the shelf and into action: an intervention to improve data-informed decision making in cote d'Ivoire. Glob Health Action. 2014;7:25035. https://doi.org/10.3402/gha.v7.25035.CrossRef

19.

Horch K, Wirz J. People's interest in health information. Bundesgesundheitsblatt, Gesundheitsforschung, Gesundheitsschutz. 2005;48(11):1250–5. https://doi.org/10.1007/s00103-005-1153-z.CrossRefPubMed

20.

Warburton A, Bate L, Long A. The demand for and use of outcomes information. Health Libr Rev. 1994;11(4):253–61.CrossRefPubMed

21.

Barron P, Pillay Y, Doherty T, Sherman G, Jackson D, Bhardwaj S, Robinson P, Goga A. Eliminating mother-to-child HIV transmission in South Africa. Bull World Health Organ. 2013;91(1):70–4. https://doi.org/10.2471/BLT.12.106807.CrossRefPubMed

22.

Garrib A, Stoops N, McKenzie A, Dlamini L, Govender T, Rohde J, Herbst K. An evaluation of the district health information system in rural South Africa. S Afr Med J. 2008;98:549–52.PubMed

23.

MEASURE Evaluation. A review of constraints to using data for decision making: recommendations to inform the design of interventions. Chapel Hill: Carolina Population Center, University of North Carolina; MEASURE Evaluation; 2010.

24.

Harries AD, Zachariah R, Maher D. The power of data: using routinely collected data to improve public health programmes and patient outcomes in low- and middle-income countries. Tropical Med Int Health. 2013;18(9):1154–6. https://doi.org/10.1111/tmi.12159.CrossRef

25.

Peersman G, Rugg D, Erkkola T, Kiwango E, Yang J. Are the investments in national HIV monitoring and evaluation systems paying off? J Acquir Immune Defic Syndr. 2009;52 Suppl 2:S87-S96. dol: https://doi.org/10.1097/QAI.0b013e3181baede7.

26.

National Department of Health. DHIS standard operating procedures and guidelines. Pretoria: Department of Health; 2011.

27.

National Department of Health. Joint review of HIV, TB and PMTCTProgrammes in South Africa: main report. Pretoria: NDOH; 2014.

28.

Alistar SS, Brandeau ML. Decision making for HIV prevention and treatment scale up: bridging the gap between theory and practice. Med Decis Mak. 2012;32(1):105–17. https://doi.org/10.1177/0272989X10391808.CrossRef

29.

Bateman C. Inept drug supply management causing stock-outs. S Afr Med J. 2015;105(9):706–7.CrossRefPubMed

30.

Solarsh G, Goga A. Child health. In: Ijumba P, Day C, Ntuli A, editors. South African health review 2003/04. Durban: Health Systems Trust; 2004. p. 101–26.

31.

Kimaro HC, Twaakyondo HM. Analysing the hindrance to the use of information and technology for improving efficiency of health care delivery system in Tanzania. Tanzan Health Res Bull. 2005;7(3):189–97.PubMed

32.

Burn A, Shongwe G. Monitoring hospital care in South Africa: development and use of indictors in hospital service management. In: Ijumba P, Day C, Ntuli A, editors. South African health review 2003/2004. Durban: Health Systems Trust; 2004. p. 29–41.

33.

Nicol E. Evaluating the process and output indicators for maternal, newborn, and child survival in South Africa: A comparative study of PMTCT information systems in KwaZulu-Natal and the Western Cape. PhD Thesis. SUNScholar: Stellenbosch University; 2015. http://hdl.handle.net/10019.1/97073.

34.

Thomas DR. A general inductive approach for analyzing qualitative evaluation data. Am J Eval. 2006;27(2):237–46. https://doi.org/10.1177/1098214005283748.CrossRef

35.

Heywood A, Rohde J. Using information for action. A manual for health workers at facility level. Arcadia, Pretoria: The Equity Project; 2001.

36.

MEASURE Evaluation. Decision maker perceptions in Kenya and Nigeria: an assessment of data use constraints. Chapel Hill: Carolina Population Center, University of North Carolina; MEASURE Evaluation; 2010.

37.

Harrison T. A facility-level assessment of data use constraints in Uganda. MEASURE Evaluation: Chapel Hill; 2010.

38.

Nicol E, Bradshaw D, Phillips T, Dudley L. Human factors affecting the quality of routinely collected data in South Africa. Stud Health Technol Informs. 2013;192:788–92. https://doi.org/10.3233/978-1-61499-289-9-788.

39.

Doherty T, Chopra M, Nsibande D, Mngoma D. Improving the coverage of the PMTCT programme through a participatory quality improvement intervention in South Africa. BMC Public Health. 2009;9:406. https://doi.org/10.1186/1471-2458-9-406.CrossRefPubMedPubMedCentral

40.

English R, Masilela T, Barron P, Schönfeldt A. Health information Systems in South Africa. In: Padarath A, English R, editors. South African health review 2011. Durban: Health Systems Trust; 2011. p. 81–90.

41.

AbouZahr C, Boerma T. Health information systems: the foundations of public health. Bull World Health Organ. 2005;83(8):578–83. doi: /S0042–96862005000800010PubMedPubMedCentral

42.

Chaulagai CN, Moyo CM, Koot J, Moyo HB, Sambakunsi TC, Khunga FM, Naphini PD. Design and implementation of a health management information system in Malawi: issues, innovations and results. Health Policy Plan. 2005;20(6):375–84. https://doi.org/10.1093/heapol/czi044.CrossRefPubMed

43.

Braa J, Heywood A, Sahay S. Improving quality and use of data through data-use workshops: Zanzibar, United Republic of Tanzania. Bull World Health Organ. 2012;90(5):379–84. https://doi.org/10.2471/BLT.11.099580.CrossRefPubMedPubMedCentral

44.

MEASURE Evaluation. Improving Demand for and Use of Data Strengthens HIV/AIDS Programs in Rwanda. Chapel Hill: University of North Carolina; 2012.

45.

Mphatswe W, Mate KS, Bennett B, Ngidi H, Reddy J, Barker PM, Rollins N. Improving public health information: a data quality intervention in KwaZulu-Natal, South Africa. Bull World Health Organ. 2012;90(3):176–82. https://doi.org/10.2471/BLT.11.092759.CrossRefPubMed

46.

Kamadjeu RM, Tapang EM, Moluh RN. Designing and implementing an electronic health record system in primary care practice in sub-Saharan Africa: a case study from Cameroon. Inform Prim Care. 2005;13(3):179–86.PubMed

47.

Lorenzi NM, Riley RT, Blyth AJ, Southon G, Dixon BJ. Antecedents of the people and organizational aspects of medical informatics: review of the literature. J Am Med Inform Assoc. 1997;4(2):79–93.CrossRefPubMedPubMedCentral

48.

Taylor C. Building cultures for sustainability. Oxford Lead J. 2009;1:1–3. Available from: http://www.oxfordleadership.com/journal/vol1_issue1/taylor.pdf. Accessed 04 Apr 2016

49.

Yusof MM, Kuljis J, Papazafeiropoulou A, Stergioulas LK. An evaluation framework for health information systems: human, organization and technology-fit factors (HOT-fit). Int J Med Inform. 2008;77(6):386–98. https://doi.org/10.1016/j.ijmedinf.2007.08.011.CrossRefPubMed

Title: Perceptions about data-informed decisions: an assessment of information-use in high HIV-prevalence settings in South Africa
Authors: Edward Nicol
Debbie Bradshaw
Jeannine Uwimana-Nicol
Lilian Dudley
Publication date: 01-11-2017
Publisher: BioMed Central
Published in: BMC Health Services Research / Issue Special Issue 2/2017
Electronic ISSN: 1472-6963
DOI: https://doi.org/10.1186/s12913-017-2641-1

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Perceptions about data-informed decisions: an assessment of information-use in high HIV-prevalence settings in South Africa

Abstract

Background

Methods

Results

Conclusions

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Abstract

Background

Methods

Results

Conclusions

Please log in to get access to this content

Other articles of this Special Issue 2/2017

Analysis of the impact of healthcare support initiatives for physically disabled people on their access to care in the city of Saint-Louis, Senegal

Feasibility of implementing a cellphone-based reminder/recall strategy to improve childhood routine immunization in a low-resource setting: a descriptive report

Task shifting in the management of hypertension in Kinshasa, Democratic Republic of Congo: a cross-sectional study

Analyzing implementation dynamics using theory-driven evaluation principles: lessons learnt from a South African centralized chronic dispensing model

Health practitioners’ emotional reactions to caring for hospitalized children in Lomé, Togo: a qualitative study

A descriptive study of treatment provision for problem alcohol drinking in adult males in Khayelitsha, Cape Town, South Africa