Skip to main content
Top
Published in: Human Resources for Health 1/2013

Open Access 01-12-2013 | Commentary

Cost-effectiveness analyses of training: a manager’s guide

Authors: Gabrielle O’Malley, Elliot Marseille, Marcia R Weaver

Published in: Human Resources for Health | Issue 1/2013

Login to get access

Abstract

The evidence on the cost and cost-effectiveness of global training programs is sparse. This manager’s guide to cost-effectiveness analysis (CEA) is for professionals who want to recognize and support high quality CEA. It focuses on CEA of training in the context of program implementation or rapid program expansion. Cost analysis provides cost per output and CEA provides cost per outcome. The distinction between these two analyses is essential for making good decisions about value. A hypothetical example of a cost analysis compares the cost per trainee of a computer-based anti-retroviral therapy (ART) training to a more intensive ART training. In a CEA of the same example, cost per trainee who met ART clinical performance standards is compared. The cost analysis is misleading when the effectiveness differs across trainings. Two additional hypothetical examples progress from simple to more complex costs and from a narrow to a broader scope: 1) CEA of the cost per ART patient with 95% adherence that compares the performance of doctors to counselors who attend additional training, and 2) CEA of the cost per infant HIV infection averted for a Prevention of Mother to Child Transmission program that compares the current program to one with additional training. To create an evidence base on CEA of training, more well-designed analyses and data on the cost of training are needed. Analysts should understand more about how capacity is built, how quality is improved within a health facility, and the costs associated with them. Considering the life of an investment in training, evaluations are needed on how many trainees apply the skills taught, how long trainees continue to apply them, and how long the content of the training conforms to national or international guidelines. Better data on effectiveness of training is also needed. It is feasible to measure effectiveness by clinical performance standards, or intermediate outcomes and coverage. Intermediate outcomes and coverage can also be combined with published estimates on health outcomes.
Literature
4.
go back to reference Kinfu Y, Dal Poz MR, Mercer H, Evans D: The Health worker shortage in Africa: are enough physicians and nurses being trained?. Bull WHO. 2009, 87: 225-230.PubMedPubMedCentral Kinfu Y, Dal Poz MR, Mercer H, Evans D: The Health worker shortage in Africa: are enough physicians and nurses being trained?. Bull WHO. 2009, 87: 225-230.PubMedPubMedCentral
6.
go back to reference Evans D, Tan-Torres Edejer T, Adam T, Lim S: WHO Choosing Interventions that are Cost Effective (CHOICE) Millennium Development Goals Team. Achieving the millennium development goals for health: Methods to assess the costs and health effects of interventions for improving health in developing countries. BMJ. 2005, 331: 1137-1140.CrossRefPubMedPubMedCentral Evans D, Tan-Torres Edejer T, Adam T, Lim S: WHO Choosing Interventions that are Cost Effective (CHOICE) Millennium Development Goals Team. Achieving the millennium development goals for health: Methods to assess the costs and health effects of interventions for improving health in developing countries. BMJ. 2005, 331: 1137-1140.CrossRefPubMedPubMedCentral
7.
go back to reference Brown CA, Belfield CR, Field SJ: Cost effectiveness of continuing professional development in health care: a critical review of the evidence. BMJ. 2002, 324: 652-655.CrossRefPubMedPubMedCentral Brown CA, Belfield CR, Field SJ: Cost effectiveness of continuing professional development in health care: a critical review of the evidence. BMJ. 2002, 324: 652-655.CrossRefPubMedPubMedCentral
8.
9.
10.
go back to reference Walker D, McDermott JM, Fox-Rushby J, Tanjung M, Nadjib M, Widiatmoko D, Achadi E: An economic analysis of midwifery training programmes in South Kalimantan, Indonesia. Bull World Health Organ. 2002, 80: 47-55.PubMedPubMedCentral Walker D, McDermott JM, Fox-Rushby J, Tanjung M, Nadjib M, Widiatmoko D, Achadi E: An economic analysis of midwifery training programmes in South Kalimantan, Indonesia. Bull World Health Organ. 2002, 80: 47-55.PubMedPubMedCentral
11.
go back to reference Harlow KC, Sportsman S: An economic analysis of patient simulators clinical training in nursing education. Nurs Econ. 2007, 25: 24-29.PubMed Harlow KC, Sportsman S: An economic analysis of patient simulators clinical training in nursing education. Nurs Econ. 2007, 25: 24-29.PubMed
12.
go back to reference Arreola-Risa C, Mock C, Herrera-Escamilla AJ, Contreras I, Vargas J: Cost-effectiveness and benefit of alternatives to improve training for prehospital trauma care in Mexico. Prehosp Disaster Med. 2004, 19: 318-325.PubMed Arreola-Risa C, Mock C, Herrera-Escamilla AJ, Contreras I, Vargas J: Cost-effectiveness and benefit of alternatives to improve training for prehospital trauma care in Mexico. Prehosp Disaster Med. 2004, 19: 318-325.PubMed
13.
go back to reference Fairall L, Bachmann MO, Zwarenstein M, Bateman ED, Niessen LW, Lombard C, Majara B, English R, Bheekie A, van Rensburg D: Cost-effectiveness of educational outreach to primary care nurses to increase tuberculosis case detection and improve respiratory care: economic evaluation alongside a randomised trial. Trop Med Int Health. 2010, 15: 277-286.CrossRefPubMed Fairall L, Bachmann MO, Zwarenstein M, Bateman ED, Niessen LW, Lombard C, Majara B, English R, Bheekie A, van Rensburg D: Cost-effectiveness of educational outreach to primary care nurses to increase tuberculosis case detection and improve respiratory care: economic evaluation alongside a randomised trial. Trop Med Int Health. 2010, 15: 277-286.CrossRefPubMed
14.
go back to reference Hounton SH, Newlands D, Meda N, De Brouwere V: A cost-effectiveness study of caesarean-section deliveries by clinical officers, general practitioners and obstetricians in Burkina Faso. Human Resources for Health. 2009, 7: 34-CrossRefPubMedPubMedCentral Hounton SH, Newlands D, Meda N, De Brouwere V: A cost-effectiveness study of caesarean-section deliveries by clinical officers, general practitioners and obstetricians in Burkina Faso. Human Resources for Health. 2009, 7: 34-CrossRefPubMedPubMedCentral
15.
go back to reference Clark KA, Mitchell EH, Aboagye PK: Return on investment for essential obstetric care training in Ghana: do trained public sector midwives deliver postabortion care?. J Midwifery Womens Health. 2010, 55: 153-161.CrossRefPubMed Clark KA, Mitchell EH, Aboagye PK: Return on investment for essential obstetric care training in Ghana: do trained public sector midwives deliver postabortion care?. J Midwifery Womens Health. 2010, 55: 153-161.CrossRefPubMed
16.
go back to reference Reynolds HW, Toroitich-Ruto C, Nasution M, Beaston-Blaakman A, Janowitz B: Effectiveness of training supervisors to improve reproductive health quality of care: a cluster-randomized trial in Kenya. Health Policy Plan. 2008, 23: 56-66.CrossRefPubMed Reynolds HW, Toroitich-Ruto C, Nasution M, Beaston-Blaakman A, Janowitz B: Effectiveness of training supervisors to improve reproductive health quality of care: a cluster-randomized trial in Kenya. Health Policy Plan. 2008, 23: 56-66.CrossRefPubMed
17.
go back to reference Goodman CA, Mutemi WM, Baya EK, Willetts A, Marsh V: The cost-effectiveness of improving malaria home management: shopkeeper training in rural Kenya. Health Policy Plan. 2006, 21: 275-288.CrossRefPubMed Goodman CA, Mutemi WM, Baya EK, Willetts A, Marsh V: The cost-effectiveness of improving malaria home management: shopkeeper training in rural Kenya. Health Policy Plan. 2006, 21: 275-288.CrossRefPubMed
18.
go back to reference Sanders J: A family medicine training program in the Republic of Georgia: incorporating a model of chronic disease management. J Am Board Fam Med. 2007, 20: 557-564.CrossRefPubMed Sanders J: A family medicine training program in the Republic of Georgia: incorporating a model of chronic disease management. J Am Board Fam Med. 2007, 20: 557-564.CrossRefPubMed
19.
go back to reference Adam T, Manzi F: Armstrong Schellenberg J, Mgalula L, de Savigny D, Evans DB: Does the integrated management of childhood illness cost more than routine care? Results from the United Republic of Tanzania. Bull World Health Organ. 2005, 83: 369-377.PubMedPubMedCentral Adam T, Manzi F: Armstrong Schellenberg J, Mgalula L, de Savigny D, Evans DB: Does the integrated management of childhood illness cost more than routine care? Results from the United Republic of Tanzania. Bull World Health Organ. 2005, 83: 369-377.PubMedPubMedCentral
20.
go back to reference Armstrong Schellenberg JRM, Adam T, Mshinda H, Masanja H, Kabadi G, Mukasa O, Theopista J, Sosthenes C, Nathan R, Wilczynska K: Effectiveness and cost of facility-based Integrated Management of Childhood Illness (IMCI) in Tanzania. Lancet. 2004, 364: 1583-1594.CrossRefPubMed Armstrong Schellenberg JRM, Adam T, Mshinda H, Masanja H, Kabadi G, Mukasa O, Theopista J, Sosthenes C, Nathan R, Wilczynska K: Effectiveness and cost of facility-based Integrated Management of Childhood Illness (IMCI) in Tanzania. Lancet. 2004, 364: 1583-1594.CrossRefPubMed
21.
go back to reference Harrison A, Karim SA, Floyd K, Lombard C, Lurie M, Ntuli N, Wilkinson D: Syndrome packets and health worker training improve sexually transmitted disease case management in rural South Africa: randomized controlled trial. AIDS. 2000, 14: 2769-2779.CrossRefPubMed Harrison A, Karim SA, Floyd K, Lombard C, Lurie M, Ntuli N, Wilkinson D: Syndrome packets and health worker training improve sexually transmitted disease case management in rural South Africa: randomized controlled trial. AIDS. 2000, 14: 2769-2779.CrossRefPubMed
22.
go back to reference Gold M, Siegel J, Russell L, Weinstein M: (Eds): Cost–Effectiveness in Health and Medicine. 1996, Oxford: Oxford University Press Gold M, Siegel J, Russell L, Weinstein M: (Eds): Cost–Effectiveness in Health and Medicine. 1996, Oxford: Oxford University Press
23.
go back to reference Siegel J, Weinstein M, Russell L, Gold M: Panel on cost-effectiveness in health and medicine: recommendations for reporting cost-effectiveness analyses. JAMA. 1996, 276: 1339-1341.CrossRefPubMed Siegel J, Weinstein M, Russell L, Gold M: Panel on cost-effectiveness in health and medicine: recommendations for reporting cost-effectiveness analyses. JAMA. 1996, 276: 1339-1341.CrossRefPubMed
24.
go back to reference Weinstein M, Siegel J, Gold M, Kamlet M, Russell L: Recommendations of the panel on cost-effectiveness in health and medicine. JAMA. 1996, 276: 1253-1258.CrossRefPubMed Weinstein M, Siegel J, Gold M, Kamlet M, Russell L: Recommendations of the panel on cost-effectiveness in health and medicine. JAMA. 1996, 276: 1253-1258.CrossRefPubMed
25.
go back to reference Russell L, Gold M, Siegel J, Daniels N, Weinstein M: The role of cost-effectiveness analysis in health and medicine. Panel on cost-effectiveness in Health and Medicine. JAMA. 1996, 276: 1172-1177.PubMed Russell L, Gold M, Siegel J, Daniels N, Weinstein M: The role of cost-effectiveness analysis in health and medicine. Panel on cost-effectiveness in Health and Medicine. JAMA. 1996, 276: 1172-1177.PubMed
27.
go back to reference Drummond M, Sculpher M, Torrance G, O’Brien B: Methods for the Economic Evaluation of Health Care Programmes. 2005, Oxford: Oxford University Press, 3 Drummond M, Sculpher M, Torrance G, O’Brien B: Methods for the Economic Evaluation of Health Care Programmes. 2005, Oxford: Oxford University Press, 3
29.
go back to reference Gold M, Stevenson D, Fryback D: HALYS and QALYS and DALYS, OH MY: similarities and differences in summary measures of population health. Annu Rev Public Health. 2002, 23: 115-134.CrossRefPubMed Gold M, Stevenson D, Fryback D: HALYS and QALYS and DALYS, OH MY: similarities and differences in summary measures of population health. Annu Rev Public Health. 2002, 23: 115-134.CrossRefPubMed
30.
go back to reference Hammer S, Squires K, Hughs M, Grimes J, Demeter L, Currier J, Eron J, Feinburg J, Balfour H, Dayton L: AIDS clinical trials group 320 study team: a controlled trial of two nucleoside analogues plus indinavir in person with human immunodeficiency virus infection and CD4 cell counts of 200 per cubic millimeter or less. New England J Med. 1997, 337: 725-733.CrossRef Hammer S, Squires K, Hughs M, Grimes J, Demeter L, Currier J, Eron J, Feinburg J, Balfour H, Dayton L: AIDS clinical trials group 320 study team: a controlled trial of two nucleoside analogues plus indinavir in person with human immunodeficiency virus infection and CD4 cell counts of 200 per cubic millimeter or less. New England J Med. 1997, 337: 725-733.CrossRef
31.
go back to reference Montaner J, Reiss P, Cooper D, Vella S, Harris M, Conway B, Wainberg M, Smith D, Robinson P, Hall D: INCAS study group: A randomized, double-blind trial comparing combinations of nevirapine, didanosine, and zidovudine for HIV-infected patients: the INCAS Trial: Italy, the Netherlands, Canada and Australia study. JAMA. 1998, 279: 930-937.CrossRefPubMed Montaner J, Reiss P, Cooper D, Vella S, Harris M, Conway B, Wainberg M, Smith D, Robinson P, Hall D: INCAS study group: A randomized, double-blind trial comparing combinations of nevirapine, didanosine, and zidovudine for HIV-infected patients: the INCAS Trial: Italy, the Netherlands, Canada and Australia study. JAMA. 1998, 279: 930-937.CrossRefPubMed
32.
go back to reference Palella F, Delaney K, Moorman A, Loveless M, Fuhrer J, Satten G, Aschman D, Holmberg S: Declining morbidity and mortality among patients with advanced human immunodeficiency virus infection. New England J Med. 1998, 338: 853-860.CrossRef Palella F, Delaney K, Moorman A, Loveless M, Fuhrer J, Satten G, Aschman D, Holmberg S: Declining morbidity and mortality among patients with advanced human immunodeficiency virus infection. New England J Med. 1998, 338: 853-860.CrossRef
33.
go back to reference The Antiretroviral Therapy in Lower Income Countries (ART-LINC) Collaboration and ART Cohort Collaboration (ART-CC) groups: Mortality of HIV-1-infected patients in the first year of antiretroviral therapy: comparison between low-income and high-income countries. Lancet. 2006, 367: 817-824.CrossRef The Antiretroviral Therapy in Lower Income Countries (ART-LINC) Collaboration and ART Cohort Collaboration (ART-CC) groups: Mortality of HIV-1-infected patients in the first year of antiretroviral therapy: comparison between low-income and high-income countries. Lancet. 2006, 367: 817-824.CrossRef
34.
go back to reference Lucas G: Antiretroviral adherence, drug resistance, viral fitness and HIV disease progression: a tangled web is woven. J Antimicrob Chemother. 2005, 55: 413-416.CrossRefPubMed Lucas G: Antiretroviral adherence, drug resistance, viral fitness and HIV disease progression: a tangled web is woven. J Antimicrob Chemother. 2005, 55: 413-416.CrossRefPubMed
35.
go back to reference Liu H: Mille rL, Hays R, Golin C, Wu T, Wenger N, Kaplan A: Repeated measures longitudinal analyses of HIV virologic response as a function of percent adherence, dose timing, genotypic sensitivity, and other factors. J Acquir Immune Defic Syndr. 2006, 41: 315-322.CrossRefPubMed Liu H: Mille rL, Hays R, Golin C, Wu T, Wenger N, Kaplan A: Repeated measures longitudinal analyses of HIV virologic response as a function of percent adherence, dose timing, genotypic sensitivity, and other factors. J Acquir Immune Defic Syndr. 2006, 41: 315-322.CrossRefPubMed
36.
go back to reference Chen L, Hoy J, Lewin S: Ten years of highly active antiretroviral therapy for HIV infection. Medical Journal of Australia. 2007, 186: 146-151.PubMed Chen L, Hoy J, Lewin S: Ten years of highly active antiretroviral therapy for HIV infection. Medical Journal of Australia. 2007, 186: 146-151.PubMed
37.
go back to reference Bangsberg D, Hecht F, Charlebois E, Zolopa A, Holodniy M, Sheiner L, Bamberger J, Chesney M, Moss A: Adherence to protease inhibitors, HIV-1 viral load, and development of drug resistance in an indigent population. AIDS. 2000, 14: 357-366.CrossRefPubMed Bangsberg D, Hecht F, Charlebois E, Zolopa A, Holodniy M, Sheiner L, Bamberger J, Chesney M, Moss A: Adherence to protease inhibitors, HIV-1 viral load, and development of drug resistance in an indigent population. AIDS. 2000, 14: 357-366.CrossRefPubMed
38.
go back to reference Paterson D, Swindells S, Mohr J, Brester M, Vergis E, Squier C, Wagener M, Singh N: Adherence to protease inhibitor therapy and outcomes in patients with HIV infection. Ann Intern Med. 2000, 133: 21-30.CrossRefPubMed Paterson D, Swindells S, Mohr J, Brester M, Vergis E, Squier C, Wagener M, Singh N: Adherence to protease inhibitor therapy and outcomes in patients with HIV infection. Ann Intern Med. 2000, 133: 21-30.CrossRefPubMed
39.
go back to reference Hiner C, Mandel B, Weaver M, Bruce D, Lee P, McGaw B, McLaughlin R, Anderson J: Evaluation of a voluntary counseling and testing training program in the Caribbean region. Hum Resour Heal. 2009, 7: 11-CrossRef Hiner C, Mandel B, Weaver M, Bruce D, Lee P, McGaw B, McLaughlin R, Anderson J: Evaluation of a voluntary counseling and testing training program in the Caribbean region. Hum Resour Heal. 2009, 7: 11-CrossRef
40.
go back to reference Namagembi A, Ssekabira U, Weaver M, Blum N, Burnett S, Dorsey G: Mpanga Sebuyira L, Ojaku A, Schneider G, Yeka A: Improved clinical skills after team-based, malaria case-management training of health care workers in Uganda. Malar J. 2012, 11: 44-CrossRef Namagembi A, Ssekabira U, Weaver M, Blum N, Burnett S, Dorsey G: Mpanga Sebuyira L, Ojaku A, Schneider G, Yeka A: Improved clinical skills after team-based, malaria case-management training of health care workers in Uganda. Malar J. 2012, 11: 44-CrossRef
41.
go back to reference Shekelle P, Ortiz E, Rhodes S, Morton S, Eccles M, Grimshaw J, Woolf S: Validity of agency for healthcare research and practice guidelines: how quickly do guidelines become outdated?. JAMA. 2001, 286: 1461-1467.CrossRefPubMed Shekelle P, Ortiz E, Rhodes S, Morton S, Eccles M, Grimshaw J, Woolf S: Validity of agency for healthcare research and practice guidelines: how quickly do guidelines become outdated?. JAMA. 2001, 286: 1461-1467.CrossRefPubMed
43.
go back to reference Mira J, Denis AA: The cost-effectiveness of preventing mother-to-child transmission of HIV in low- and middle-income countries: systematic review. Cost Eff Resour Alloc. 2011, 9: 3-CrossRef Mira J, Denis AA: The cost-effectiveness of preventing mother-to-child transmission of HIV in low- and middle-income countries: systematic review. Cost Eff Resour Alloc. 2011, 9: 3-CrossRef
44.
go back to reference The Petra Study Team: Efficacy of three short-course regimens of zidovudine and lamivudine in preventing early and late transmission of HIV-1 from mother to child in Tanzania, South Africa, and Uganda (Petra study): a randomised, double-blind, placebo-controlled trial. Lancet. 2002, 359: 1178-1186.CrossRef The Petra Study Team: Efficacy of three short-course regimens of zidovudine and lamivudine in preventing early and late transmission of HIV-1 from mother to child in Tanzania, South Africa, and Uganda (Petra study): a randomised, double-blind, placebo-controlled trial. Lancet. 2002, 359: 1178-1186.CrossRef
Metadata
Title
Cost-effectiveness analyses of training: a manager’s guide
Authors
Gabrielle O’Malley
Elliot Marseille
Marcia R Weaver
Publication date
01-12-2013
Publisher
BioMed Central
Published in
Human Resources for Health / Issue 1/2013
Electronic ISSN: 1478-4491
DOI
https://doi.org/10.1186/1478-4491-11-20

Other articles of this Issue 1/2013

Human Resources for Health 1/2013 Go to the issue