Skip to main content
Top
Published in: BMC Health Services Research 1/2018

Open Access 01-12-2018 | Research article

The predictive validity of the Living Goods selection tools for community health workers in Kenya: cohort study

Authors: Celia A. Taylor, Richard J. Lilford, Emily Wroe, Frances Griffiths, Ruth Ngechu

Published in: BMC Health Services Research | Issue 1/2018

Login to get access

Abstract

Background

Ensuring that selection processes for Community Health Workers (CHWs) are effective is important due to the scale and scope of modern CHW programmes. However they are relatively understudied. While community involvement in selection should never be eliminated entirely, there are other complementary methods that could be used to help identify those most likely to be high-performing CHWs. This study evaluated the predictive validity of three written tests and two individual sections of a one-to-one interview used for selection into CHW posts in eight areas of Kenya.

Methods

A cohort study of CHWs working for Living Goods in eight local areas of Kenya was undertaken. Data on the selection scores, post-training assessment scores and subsequent on-the-job performance (number of household and pregnancy registrations, number of child assessments, proportion of on-time follow-ups and value of goods sold) were obtained for 547 CHWs. Kendall’s tau-b correlations between each selection score and performance outcome were calculated.

Results

None of the correlations between selection scores and outcomes reached the 0.3 threshold of an “adequate” predictor of performance. Correlations were higher for the written components of the selection process compared to the interview components, with some small negative correlations found for the latter.

Conclusions

If the measures of performance included in this study are considered critical, then further work to develop the CHW selection tools is required. This could include modifying the content of both tools or increasing the length of the written tests to make them more reliable, for if a test is not reliable then it cannot be valid. Other important outcomes not included in this study are retention in post and quality of care. Other CHW programme providers should consider evaluating their own selection tools in partnership with research teams.
Literature
1.
go back to reference Perry HB, Zulliger R, Rogers MM. Community health workers in low-, middle-, and high-income countries. Annu Rev Public Health. 2014;35:399–421.CrossRef Perry HB, Zulliger R, Rogers MM. Community health workers in low-, middle-, and high-income countries. Annu Rev Public Health. 2014;35:399–421.CrossRef
2.
go back to reference Johnson AD, Thiero O, Whidden C, Poudiougou B, Diakité D, Traoré F, et al. Proactive community case management and child survival in periurban Mali. BMJ Global. Health. 2018;3:2.CrossRef Johnson AD, Thiero O, Whidden C, Poudiougou B, Diakité D, Traoré F, et al. Proactive community case management and child survival in periurban Mali. BMJ Global. Health. 2018;3:2.CrossRef
3.
go back to reference WHO. Rational redistribution of tasks among health workforce teams: global recommendations and guidelines. Geneva: World Health Organization; 2008. WHO. Rational redistribution of tasks among health workforce teams: global recommendations and guidelines. Geneva: World Health Organization; 2008.
4.
go back to reference McCord GC, Liu A, Singh P. Deployment of community health workers across rural sub-Saharan Africa. B World Health Organ. 2013;91(4):244–53b.CrossRef McCord GC, Liu A, Singh P. Deployment of community health workers across rural sub-Saharan Africa. B World Health Organ. 2013;91(4):244–53b.CrossRef
5.
6.
go back to reference Schneider H, Okello D, Lehmann U. The global pendulum swing towards community health workers in low-and middle-income countries. Hum Resources Health. 2016;14(1):65.CrossRef Schneider H, Okello D, Lehmann U. The global pendulum swing towards community health workers in low-and middle-income countries. Hum Resources Health. 2016;14(1):65.CrossRef
7.
go back to reference Kok M, Dieleman M, Taegtmeyer M, Broerse J, Kane S, Ormel H, et al. Which intervention design factors influence performance of community health workers in low- and middle-income countries? Health Policy Plan. 2014:1–21. Kok M, Dieleman M, Taegtmeyer M, Broerse J, Kane S, Ormel H, et al. Which intervention design factors influence performance of community health workers in low- and middle-income countries? Health Policy Plan. 2014:1–21.
8.
go back to reference Glenton C, Colvin CJ, Carlsen B, Swartz A, Lewin S, Noyes J, et al. Barriers and facilitators to the implementation of lay health worker programmes to improve access to maternal and child health: qualitative evidence synthesis. Cochrane Database Syst Rev. 2013;10. Glenton C, Colvin CJ, Carlsen B, Swartz A, Lewin S, Noyes J, et al. Barriers and facilitators to the implementation of lay health worker programmes to improve access to maternal and child health: qualitative evidence synthesis. Cochrane Database Syst Rev. 2013;10.
9.
go back to reference Tani K, Stone A, Exavery A, Njozi M, Baynes CD, Phillips JF, et al. A time-use study of community health worker service activities in three rural districts of Tanzania. BMC Health Serv Res. 2016;16(1):461.CrossRef Tani K, Stone A, Exavery A, Njozi M, Baynes CD, Phillips JF, et al. A time-use study of community health worker service activities in three rural districts of Tanzania. BMC Health Serv Res. 2016;16(1):461.CrossRef
10.
go back to reference Chipukuma HM, Zulu JM, Jacobs C, Chongwe G, Chola M, Halwiindi H, et al. Towards a framework for analyzing determinants of performance of community health workers in malaria prevention and control: a systematic review. Hum Resour Health. 2018;16(1):22.CrossRef Chipukuma HM, Zulu JM, Jacobs C, Chongwe G, Chola M, Halwiindi H, et al. Towards a framework for analyzing determinants of performance of community health workers in malaria prevention and control: a systematic review. Hum Resour Health. 2018;16(1):22.CrossRef
12.
13.
go back to reference K'Omudho PA, Tenambergen WM. Effects of Selecting Community Health Volunteers: The case of Makadara Sub-County, Nairobi County. The Journal of Global Health Care Systems. 2015;5(1). K'Omudho PA, Tenambergen WM. Effects of Selecting Community Health Volunteers: The case of Makadara Sub-County, Nairobi County. The Journal of Global Health Care Systems. 2015;5(1).
14.
go back to reference Ashraf N, Bandiera O, Lee SS. Do-gooders and go-getters: career incentives, selection, and performance in public service delivery. STICERD Discussion Papers Series. 2014;54. Ashraf N, Bandiera O, Lee SS. Do-gooders and go-getters: career incentives, selection, and performance in public service delivery. STICERD Discussion Papers Series. 2014;54.
15.
go back to reference Glenton C, Colvin CJ, Carlsen B, Swartz A, Lewin S, Noyes J, et al. Barriers and facilitators to the implementation of lay health worker programmes to improve access to maternal and child health. Coch D Syst Rev. 2013. Glenton C, Colvin CJ, Carlsen B, Swartz A, Lewin S, Noyes J, et al. Barriers and facilitators to the implementation of lay health worker programmes to improve access to maternal and child health. Coch D Syst Rev. 2013.
16.
go back to reference Nkonki L, Cliff J, Sanders D. Lay health worker attrition: important but often ignored. Bull World Health Organ. 2011;89:919–23.CrossRef Nkonki L, Cliff J, Sanders D. Lay health worker attrition: important but often ignored. Bull World Health Organ. 2011;89:919–23.CrossRef
17.
go back to reference World Health Organization. Policy Brief. Community health workers: What do we know about them? Geneva; 2007. World Health Organization. Policy Brief. Community health workers: What do we know about them? Geneva; 2007.
18.
go back to reference Jaskiewicz W, Deussom R, Perry H, Crigler L. Recruitment of community health workers. Washington, DC: MCHIP; 2014. Jaskiewicz W, Deussom R, Perry H, Crigler L. Recruitment of community health workers. Washington, DC: MCHIP; 2014.
19.
go back to reference Ludwick T, Brenner JL, Kyomuhangi T, Wotton KA, Kabakyenga JK. Poor retention does not have to be the rule: retention of volunteer community health workers in Uganda. Health Policy Plan. 2013;29(3):388–95.CrossRef Ludwick T, Brenner JL, Kyomuhangi T, Wotton KA, Kabakyenga JK. Poor retention does not have to be the rule: retention of volunteer community health workers in Uganda. Health Policy Plan. 2013;29(3):388–95.CrossRef
20.
go back to reference Ashraf N, Bandiera O, Lee SS, Musonda M. Can strategic selection and remuneration improve retention and performance of community health workers? MA: Harvard; 2012. Ashraf N, Bandiera O, Lee SS, Musonda M. Can strategic selection and remuneration improve retention and performance of community health workers? MA: Harvard; 2012.
21.
go back to reference Bajpai N, Dholakia R. Improving the performance of Accredited Social Health Activists in India: Working Paper No. 1. Mumbai. South Asia: Columbia Global Centers; 2011. Bajpai N, Dholakia R. Improving the performance of Accredited Social Health Activists in India: Working Paper No. 1. Mumbai. South Asia: Columbia Global Centers; 2011.
22.
go back to reference Rowe SY, Kelly JM, Olewe MA, Kleinbaum DG, McGowan JE, McFarland DA, et al. Effect of multiple interventions on community health workers’ adherence to clinical guidelines in Siaya district, Kenya. Trans Royal Soc Trop Med Hyg. 2007;101(2):188–202.CrossRef Rowe SY, Kelly JM, Olewe MA, Kleinbaum DG, McGowan JE, McFarland DA, et al. Effect of multiple interventions on community health workers’ adherence to clinical guidelines in Siaya district, Kenya. Trans Royal Soc Trop Med Hyg. 2007;101(2):188–202.CrossRef
23.
go back to reference Turinawe EB, Rwemisisi JT, Musinguzi LK, de Groot M, Muhangi D, de Vries DH, et al. Selection and performance of village health teams (VHTs) in Uganda: lessons from the natural helper model of health promotion. Hum Resour Health. 2015;13(1):73.CrossRef Turinawe EB, Rwemisisi JT, Musinguzi LK, de Groot M, Muhangi D, de Vries DH, et al. Selection and performance of village health teams (VHTs) in Uganda: lessons from the natural helper model of health promotion. Hum Resour Health. 2015;13(1):73.CrossRef
24.
go back to reference Ministry of Health. Government of Ghana: National Community Health Worker Program. Accra; 2014. Ministry of Health. Government of Ghana: National Community Health Worker Program. Accra; 2014.
25.
go back to reference Raven J, Akweongo P, Baba A, Baine SO, Sall MG, Buzuzi S, et al. Using a human resource management approach to support community health workers. Hum Resources Health. 2015;13(1):45.CrossRef Raven J, Akweongo P, Baba A, Baine SO, Sall MG, Buzuzi S, et al. Using a human resource management approach to support community health workers. Hum Resources Health. 2015;13(1):45.CrossRef
26.
go back to reference Prideaux D, Roberts C, Eva K, Centeno A, Mccrorie P, Mcmanus C, et al. Assessment for selection for the health care professions and specialty training. Med Teach. 2011;33(3):215–23.CrossRef Prideaux D, Roberts C, Eva K, Centeno A, Mccrorie P, Mcmanus C, et al. Assessment for selection for the health care professions and specialty training. Med Teach. 2011;33(3):215–23.CrossRef
27.
go back to reference Cleland J, Dowell J, McLachlan J, Nicholson S, Patterson F. Identifying best practice in the selection of medical students. London 2012. Cleland J, Dowell J, McLachlan J, Nicholson S, Patterson F. Identifying best practice in the selection of medical students. London 2012.
28.
go back to reference O'Brien MJ, Squires AP, Bixby RA, Larson SC. Role development of community health workers: an examination of selection and training processes in the intervention literature. Am J Prev Med. 2009;37(6):S262–S9.CrossRef O'Brien MJ, Squires AP, Bixby RA, Larson SC. Role development of community health workers: an examination of selection and training processes in the intervention literature. Am J Prev Med. 2009;37(6):S262–S9.CrossRef
29.
go back to reference Redick C, Dini H, Long L. The current state of CHW training programs in sub-Saharan Africa and South Asia: what we know, what we don’t know, and what we need to do. Washington DC: USAID; 2014. Redick C, Dini H, Long L. The current state of CHW training programs in sub-Saharan Africa and South Asia: what we know, what we don’t know, and what we need to do. Washington DC: USAID; 2014.
30.
go back to reference Crispin N, Wamae A, Ndirangu M, Wamalwa D, Wangalwa G, Watako P, et al. Effects of selected socio-demographic characteristics of community health workers on performance of home visits during pregnancy: a cross-sectional study in Busia District, Kenya. Global J Health Sci. 2012;4(5):78.CrossRef Crispin N, Wamae A, Ndirangu M, Wamalwa D, Wangalwa G, Watako P, et al. Effects of selected socio-demographic characteristics of community health workers on performance of home visits during pregnancy: a cross-sectional study in Busia District, Kenya. Global J Health Sci. 2012;4(5):78.CrossRef
31.
go back to reference Geoffrey B, Joab T, Benon M, Mark L, Ceasar MM, Edgar T. Utilization of the community health worker assessment and improvement matrix to Strengthen Village health team Systems in Uganda: a case for Kitgum District. Science Journal of Public Health. 2017;5(4):275.CrossRef Geoffrey B, Joab T, Benon M, Mark L, Ceasar MM, Edgar T. Utilization of the community health worker assessment and improvement matrix to Strengthen Village health team Systems in Uganda: a case for Kitgum District. Science Journal of Public Health. 2017;5(4):275.CrossRef
32.
go back to reference van der Vleuten CPM. The assessment of professional competence: developments, research and practical implications. Adv Health Sci Educ. 1996;1(1):41–67.CrossRef van der Vleuten CPM. The assessment of professional competence: developments, research and practical implications. Adv Health Sci Educ. 1996;1(1):41–67.CrossRef
33.
go back to reference van der Vleuten Cees. Validity of final examinations in undergraduate medical training. BMJ. 2000;321:1217.CrossRef van der Vleuten Cees. Validity of final examinations in undergraduate medical training. BMJ. 2000;321:1217.CrossRef
34.
go back to reference Republic of Kenya Ministry of Health. Strategy for Community Health 2014-2019. Nairobi. p. 2014. Republic of Kenya Ministry of Health. Strategy for Community Health 2014-2019. Nairobi. p. 2014.
35.
go back to reference McCollum R, Otiso L, Mireku M, Theobald S, de Koning K, Hussein S, et al. Exploring perceptions of community health policy in Kenya and identifying implications for policy change. 2015;31(1):10–20. McCollum R, Otiso L, Mireku M, Theobald S, de Koning K, Hussein S, et al. Exploring perceptions of community health policy in Kenya and identifying implications for policy change. 2015;31(1):10–20.
36.
go back to reference Republic of Kenya Ministry of Health. Community Strategy Implementation Guidelines for managers of the Kenya essential package for health at the community level. Nairobi; 2007. Republic of Kenya Ministry of Health. Community Strategy Implementation Guidelines for managers of the Kenya essential package for health at the community level. Nairobi; 2007.
37.
go back to reference Kritchevsky SB, Simmons BP. Continuous quality improvement: concepts and applications for physician care. JAMA. 1991;266(13):1817–23.CrossRef Kritchevsky SB, Simmons BP. Continuous quality improvement: concepts and applications for physician care. JAMA. 1991;266(13):1817–23.CrossRef
38.
go back to reference StataCorp. Stata Statistical Software: Release 14. Texas: College Station; 2015. StataCorp. Stata Statistical Software: Release 14. Texas: College Station; 2015.
39.
go back to reference Cooper D, Robertson IT, Tinline G. Recruitment and selection: a framework for success: Cengage learning EMEA; 2003. Cooper D, Robertson IT, Tinline G. Recruitment and selection: a framework for success: Cengage learning EMEA; 2003.
40.
go back to reference Schmidt FL, Hunter JE. The validity and utility of selection methods in personnel psychology: practical and theoretical implications of 85 years of research findings. Psychol Bull. 1998;124(2):262.CrossRef Schmidt FL, Hunter JE. The validity and utility of selection methods in personnel psychology: practical and theoretical implications of 85 years of research findings. Psychol Bull. 1998;124(2):262.CrossRef
Metadata
Title
The predictive validity of the Living Goods selection tools for community health workers in Kenya: cohort study
Authors
Celia A. Taylor
Richard J. Lilford
Emily Wroe
Frances Griffiths
Ruth Ngechu
Publication date
01-12-2018
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2018
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-018-3620-x

Other articles of this Issue 1/2018

BMC Health Services Research 1/2018 Go to the issue