Skip to main content
Top
Published in: BMC Health Services Research 1/2017

Open Access 01-12-2017 | Research article

Use of Lot quality assurance sampling surveys to evaluate community health worker performance in rural Zambia: a case of Luangwa district

Authors: Moses Mwanza, Japhet Zulu, Stephanie M. Topp, Patrick Musonda, Wilbroad Mutale, Roma Chilengi

Published in: BMC Health Services Research | Issue 1/2017

Login to get access

Abstract

Background

The Better Health Outcomes through Mentoring and Assessment (BHOMA) project is a cluster randomized controlled trial aimed at reducing age-standardized mortality rates in three rural districts through involvement of Community Health Workers (CHWs), Traditional Birth Attendants (TBAs), and Neighborhood Health Committees (NHCs). CHWs conduct quarterly surveys on all households using a questionnaire that captures key health events occurring within their catchment population. In order to validate contact with households, we utilize the Lot Quality Assurance Sampling (LQAS) methodology. In this study, we report experiences of applying the LQAS approach to monitor performance of CHWs in Luangwa District.

Methods

Between April 2011 and December 2013, seven health facilities in Luangwa district were enrolled into the BHOMA project. The health facility catchment areas were divided into 33 geographic zones. Quality assurance was performed each quarter by randomly selecting zones representing about 90% of enrolled catchment areas from which 19 households per zone where also randomly identified. The surveys were conducted by CHW supervisors who had been trained on using the LQAS questionnaire. Information collected included household identity number (ID), whether the CHW visited the household, duration of the most recent visit, and what health information was discussed during the CHW visit. The threshold for success was set at 75% household outreach by CHWs in each zone.

Results

There are 4,616 total households in the 33 zones. This yielded a target of 32,212 household visits by community health workers during the 7 survey rounds. Based on the set cutoff point for passing the surveys (at least 75% households confirmed as visited), only one team of CHWs at Luangwa high school failed to reach the target during round 1 of the surveys; all the teams otherwise registered successful visits in all the surveys.

Conclusions

We have employed the LQAS methodology for assurance that quarterly surveys were successfully done. This methodology proved helpful in identifying poorly performing CHWs and could be useful for evaluating CHW performance in other areas.

Trial registration

Identifier: NCT01942278. Date of Registration: September 2013.
Appendix
Available only for authorised users
Literature
2.
go back to reference Lindsey E, Sheilds L, Stajduhar K. Creating effective nursing partnerships: An approach to community based action. Nurs Outlook. 1999;45(1):23–6. Lindsey E, Sheilds L, Stajduhar K. Creating effective nursing partnerships: An approach to community based action. Nurs Outlook. 1999;45(1):23–6.
3.
go back to reference Kane SS, Gerretsen B, Scherpbier R, Poz MD, Dieleman M. A realist synthesis of randomized control trials involving use of community health workers for delivering child health interventions in low and middle income countries. BMC Health Serv Res. 2010;10:286.CrossRefPubMedPubMedCentral Kane SS, Gerretsen B, Scherpbier R, Poz MD, Dieleman M. A realist synthesis of randomized control trials involving use of community health workers for delivering child health interventions in low and middle income countries. BMC Health Serv Res. 2010;10:286.CrossRefPubMedPubMedCentral
4.
go back to reference Javanparast S, Baum F, Labonte R, Sanders D, Rajabi Z, Heidari G. The experience of community health workers training in Iran: a qualitative study. BMC Health Serv Res. 2012;12:291.CrossRefPubMedPubMedCentral Javanparast S, Baum F, Labonte R, Sanders D, Rajabi Z, Heidari G. The experience of community health workers training in Iran: a qualitative study. BMC Health Serv Res. 2012;12:291.CrossRefPubMedPubMedCentral
6.
go back to reference Zulu JM, Kinsman J, Michelo C, Hurtig A. Developing the national community health assistant strategy in Zambia: a policy analysis. Health Res Policy Syst. 2013;11:24.CrossRefPubMedPubMedCentral Zulu JM, Kinsman J, Michelo C, Hurtig A. Developing the national community health assistant strategy in Zambia: a policy analysis. Health Res Policy Syst. 2013;11:24.CrossRefPubMedPubMedCentral
8.
go back to reference Gilmore B, McAuliffe E. Effectiveness of community health workers delivering preventive interventions for maternal and child health in low- and middle-income countries: a systematic review. BMC Public Health. 2013;13:847.CrossRefPubMedPubMedCentral Gilmore B, McAuliffe E. Effectiveness of community health workers delivering preventive interventions for maternal and child health in low- and middle-income countries: a systematic review. BMC Public Health. 2013;13:847.CrossRefPubMedPubMedCentral
9.
go back to reference Makaula P, Bloch P, Banda HT, Mbera GB, Mangani C, Sousa A, et al. Primary health care in rural Malawi - a qualitative assessment exploring the relevance of the community-directed intervention approach. BMC Health Serv Res. 2012;12:328.CrossRefPubMedPubMedCentral Makaula P, Bloch P, Banda HT, Mbera GB, Mangani C, Sousa A, et al. Primary health care in rural Malawi - a qualitative assessment exploring the relevance of the community-directed intervention approach. BMC Health Serv Res. 2012;12:328.CrossRefPubMedPubMedCentral
10.
go back to reference Stringer JSA, Taylor-Chisembele A, Chibwesha CJ, Chi HF, Ayles H, Manda H, et al. Protocol-driven primary care and community linkages to improve population health in rural Zambia: the Better Health Outcomes through Mentoring and Assessment (BHOMA) project. BMC Health Serv Res. 2013;13 Suppl 2:S7.CrossRefPubMedPubMedCentral Stringer JSA, Taylor-Chisembele A, Chibwesha CJ, Chi HF, Ayles H, Manda H, et al. Protocol-driven primary care and community linkages to improve population health in rural Zambia: the Better Health Outcomes through Mentoring and Assessment (BHOMA) project. BMC Health Serv Res. 2013;13 Suppl 2:S7.CrossRefPubMedPubMedCentral
11.
go back to reference Schutter L, Sindano N, Theis M, Zue C, Joseph J, Chilengi R, et al. A mobile phone-based, community health worker program for referral, follow-up and service outreach in rural Zambia: outcomes and overview. Telemed E Health. 2014;20(8):721–8. doi:10.1089/tmj.2013.0240. Accessed 17 December 2014.CrossRef Schutter L, Sindano N, Theis M, Zue C, Joseph J, Chilengi R, et al. A mobile phone-based, community health worker program for referral, follow-up and service outreach in rural Zambia: outcomes and overview. Telemed E Health. 2014;20(8):721–8. doi:10.​1089/​tmj.​2013.​0240. Accessed 17 December 2014.CrossRef
12.
go back to reference Tumusiime DK, Agaba G, Kyomuhangi T, Finch J, Kabakyenga J, Macleod S. Introduction of mobile phones for use by volunteer community health workers in support of integrated community case management in Bushenyi District, Uganda: development and implementation process. BMC Health Serv Res. 2014;14 Suppl 1:S2.CrossRefPubMedPubMedCentral Tumusiime DK, Agaba G, Kyomuhangi T, Finch J, Kabakyenga J, Macleod S. Introduction of mobile phones for use by volunteer community health workers in support of integrated community case management in Bushenyi District, Uganda: development and implementation process. BMC Health Serv Res. 2014;14 Suppl 1:S2.CrossRefPubMedPubMedCentral
13.
go back to reference Lanata CF, Black RE. Lot quality assurance sampling techniques in health surveys in developing countries: advantages and current constraints. Health Serv Res. 1991;44(3):133–9. World health statistics quarterly. Lanata CF, Black RE. Lot quality assurance sampling techniques in health surveys in developing countries: advantages and current constraints. Health Serv Res. 1991;44(3):133–9. World health statistics quarterly.
14.
go back to reference Mushtaq MU, Majrooh MA, Ullah ZMS, Akram J, Siddiqui AM, Shad MA, et al. Are we doing enough? Evaluation of the Polio Eradication Initiative in a district of Pakistan’s Punjab province: LQAS study. BMC Public Health. 2010;10:60.CrossRefPubMedPubMedCentral Mushtaq MU, Majrooh MA, Ullah ZMS, Akram J, Siddiqui AM, Shad MA, et al. Are we doing enough? Evaluation of the Polio Eradication Initiative in a district of Pakistan’s Punjab province: LQAS study. BMC Public Health. 2010;10:60.CrossRefPubMedPubMedCentral
15.
go back to reference Pezzoli L, Conteh I, Kamara W, Gacic-Dobo M, Ronveaux O, Perea WA, et al. Intervene before leaving: Clustered lot quality assurance sampling to monitor vaccination coverage at health district level before the end of a yellow fever and measles vaccination campaign in Sierra Leone in 2009. BMC Public Health. 2012;12:415.CrossRefPubMedPubMedCentral Pezzoli L, Conteh I, Kamara W, Gacic-Dobo M, Ronveaux O, Perea WA, et al. Intervene before leaving: Clustered lot quality assurance sampling to monitor vaccination coverage at health district level before the end of a yellow fever and measles vaccination campaign in Sierra Leone in 2009. BMC Public Health. 2012;12:415.CrossRefPubMedPubMedCentral
16.
go back to reference Valadaz JJ, Diprete Brown L, Varges WV, Morley D. Using lot quality assurance sampling to assess measurements for growth monitoring in a developing country’s primary health care system. Int J Epidemiol. 1996;25:381–7.CrossRef Valadaz JJ, Diprete Brown L, Varges WV, Morley D. Using lot quality assurance sampling to assess measurements for growth monitoring in a developing country’s primary health care system. Int J Epidemiol. 1996;25:381–7.CrossRef
17.
go back to reference National LQAS conference. Enhancing Evidence Based Planning at District Level: The LQAS Experience in Uganda Sheraton Hotel Kampala. 2006. National LQAS conference. Enhancing Evidence Based Planning at District Level: The LQAS Experience in Uganda Sheraton Hotel Kampala. 2006.
18.
go back to reference Hedt-Gauthier BL, Mitsunaga T, Hund L, Olives C, Pagano M. The effect of clustering on lot quality assurance sampling: a probabilistic model to calculate sample sizes for quality assessments. Emerg Themes Epidemiol. 2013;10:1.CrossRef Hedt-Gauthier BL, Mitsunaga T, Hund L, Olives C, Pagano M. The effect of clustering on lot quality assurance sampling: a probabilistic model to calculate sample sizes for quality assessments. Emerg Themes Epidemiol. 2013;10:1.CrossRef
19.
go back to reference Perez F, Ba H, Dastagire SG, Altmann. The role of community health workers in improving child health programmes in Mali. BMC Int Health Hum Rights. 2009;9:28.CrossRefPubMedPubMedCentral Perez F, Ba H, Dastagire SG, Altmann. The role of community health workers in improving child health programmes in Mali. BMC Int Health Hum Rights. 2009;9:28.CrossRefPubMedPubMedCentral
20.
go back to reference Biedron C, Pagano M, Hedt BL, Killian A, Ratcliffe, Mabunda S, Valadez JJ, et al. An assessment of Lot Quality Assurance Sampling to evaluate malaria outcome indicators: extending malaria indicator surveys. Int J Epidemiol. 2010;39:72–9.CrossRefPubMedPubMedCentral Biedron C, Pagano M, Hedt BL, Killian A, Ratcliffe, Mabunda S, Valadez JJ, et al. An assessment of Lot Quality Assurance Sampling to evaluate malaria outcome indicators: extending malaria indicator surveys. Int J Epidemiol. 2010;39:72–9.CrossRefPubMedPubMedCentral
22.
go back to reference Valadez JJ, Devkota B, Pradhan MM, Meherda P, Sonal GS, Dhariwal A, et al. Improving malaria treatment and prevention in India by aiding district managers to manage their programmes with local information: a trial assessing the impact of Lot Quality Assurance Sampling on programme outcomes. Trop Med Int Health. 2014;19(10):1226–36.CrossRefPubMed Valadez JJ, Devkota B, Pradhan MM, Meherda P, Sonal GS, Dhariwal A, et al. Improving malaria treatment and prevention in India by aiding district managers to manage their programmes with local information: a trial assessing the impact of Lot Quality Assurance Sampling on programme outcomes. Trop Med Int Health. 2014;19(10):1226–36.CrossRefPubMed
24.
go back to reference Gupte MD, Murthy BN, Mahmood K, Meeralakshmi S, Nagaraju B, Prabhakaran R. Application of lot quality assurance sampling for Leprosy elimination monitoring- examination of some critical factors. Int J Epidemiol. 2004;33:344–8. doi:10.1093/ije/dyh024.CrossRefPubMed Gupte MD, Murthy BN, Mahmood K, Meeralakshmi S, Nagaraju B, Prabhakaran R. Application of lot quality assurance sampling for Leprosy elimination monitoring- examination of some critical factors. Int J Epidemiol. 2004;33:344–8. doi:10.​1093/​ije/​dyh024.CrossRefPubMed
Metadata
Title
Use of Lot quality assurance sampling surveys to evaluate community health worker performance in rural Zambia: a case of Luangwa district
Authors
Moses Mwanza
Japhet Zulu
Stephanie M. Topp
Patrick Musonda
Wilbroad Mutale
Roma Chilengi
Publication date
01-12-2017
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2017
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-017-2229-9

Other articles of this Issue 1/2017

BMC Health Services Research 1/2017 Go to the issue