Skip to main content
Top
Published in: Human Resources for Health 1/2010

Open Access 01-12-2010 | Methodology

A framework for evaluating the impact of the United Nations fellowship programmes

Authors: Arie Rotem, Michael A Zinovieff, Alexandre Goubarev

Published in: Human Resources for Health | Issue 1/2010

Login to get access

Abstract

The United Nations (UN) System's agencies have been criticized for not adequately assessing the impact of their training and fellowship programmes. Critics point out that beyond documentation of the number of fellows that underwent training, and their immediate reaction to the experience, it is necessary to ascertain that fellows are using what they have learned, and most importantly that their institution and country are benefiting from the significant investments made in the fellowship programmes.
This paper presents an evaluation framework that was adopted by the 17th Meeting of the UN System Senior Fellowship Officers convened in London in 2008 in response to this challenge. It is arranged in three sections. First, the assumptions and constraints concerning impact evaluation of training are presented. Second, a framework for evaluating the impact of training in the context of UN System programmes is proposed. Third, necessary conditions and supportive measures to enable implementation of the impact evaluation framework are identified.
The critical message emerging from this review is the importance of constructing a 'performance story' based on key milestones associated with the design and implementation of fellowship programmes as a way of assessing the contribution of different components of the fellowship programmes to institutional outcomes.
Appendix
Available only for authorised users
Literature
2.
go back to reference 16th Meeting of Senior Fellowships Officers of the United Nations System and Host Country Agencies, Paris, 6 - 8 November 2006, Final Report. 2007, United Nations, New York 16th Meeting of Senior Fellowships Officers of the United Nations System and Host Country Agencies, Paris, 6 - 8 November 2006, Final Report. 2007, United Nations, New York
4.
go back to reference Kirkpatrick DL: Evaluating Training Programmes: The Four Levels. 1994, San Francisco, CA: Berrett-Koehler Kirkpatrick DL: Evaluating Training Programmes: The Four Levels. 1994, San Francisco, CA: Berrett-Koehler
6.
go back to reference Phillips J: Return on Investment in Training and Performance Improvement Programs. 2003, Massachusetts, USA: Butterworth-Heinemann Phillips J: Return on Investment in Training and Performance Improvement Programs. 2003, Massachusetts, USA: Butterworth-Heinemann
7.
go back to reference Alliger GM, Janak EA: Kirkpatrick's levels of training criteria: thirty years later. Personnel Psychology. 1989, 42 (2): 331-342. 10.1111/j.1744-6570.1989.tb00661.x.CrossRef Alliger GM, Janak EA: Kirkpatrick's levels of training criteria: thirty years later. Personnel Psychology. 1989, 42 (2): 331-342. 10.1111/j.1744-6570.1989.tb00661.x.CrossRef
8.
go back to reference Iverson A: Attribution and aid evaluation in international development: a literature review, prepared for CIDA Evaluation Unit, International Development Research Centre. 2003 Iverson A: Attribution and aid evaluation in international development: a literature review, prepared for CIDA Evaluation Unit, International Development Research Centre. 2003
9.
go back to reference Mayne J: Addressing attribution through contribution analysis: using performance measures sensibly. The Canadian Journal of Programme Evaluation. 2001, 16 (1): 1-24. Mayne J: Addressing attribution through contribution analysis: using performance measures sensibly. The Canadian Journal of Programme Evaluation. 2001, 16 (1): 1-24.
10.
go back to reference Brinkerhoff R, Gill S: Managing the total quality of training. Human Resource Development Quarterly. 1992, 3 (2): 121-131. 10.1002/hrdq.3920030204.CrossRef Brinkerhoff R, Gill S: Managing the total quality of training. Human Resource Development Quarterly. 1992, 3 (2): 121-131. 10.1002/hrdq.3920030204.CrossRef
11.
go back to reference Mayne J: Addressing attribution through contribution analysis: using performance measures sensibly: discussion paper, Office of the Auditor General of Canada. 1999 Mayne J: Addressing attribution through contribution analysis: using performance measures sensibly: discussion paper, Office of the Auditor General of Canada. 1999
12.
go back to reference Kotvojs F, Shrimpton B: Contribution Analysis - A new approach to evaluation in international development. Evaluation Journal of Australia. 2007, 7 (1): 27-35. Kotvojs F, Shrimpton B: Contribution Analysis - A new approach to evaluation in international development. Evaluation Journal of Australia. 2007, 7 (1): 27-35.
14.
go back to reference Hendricks M: Performance monitoring: how to measure effectively the results of our efforts', paper presented at the American Evaluation Association Annual Conference, Atlanta. 1996 Hendricks M: Performance monitoring: how to measure effectively the results of our efforts', paper presented at the American Evaluation Association Annual Conference, Atlanta. 1996
15.
go back to reference Dart J, Mayne J: Performance story. Encyclopedia of valuation. Edited by: Mathison S. 2004, Sage. California: Thousand Oaks Dart J, Mayne J: Performance story. Encyclopedia of valuation. Edited by: Mathison S. 2004, Sage. California: Thousand Oaks
16.
go back to reference 17th Meeting of Senior Fellowships Officers of the United Nations System and Host Country Agencies, IMO, London, 17-19 November 2008, Final Report. 2009, United Nations, New York 17th Meeting of Senior Fellowships Officers of the United Nations System and Host Country Agencies, IMO, London, 17-19 November 2008, Final Report. 2009, United Nations, New York
Metadata
Title
A framework for evaluating the impact of the United Nations fellowship programmes
Authors
Arie Rotem
Michael A Zinovieff
Alexandre Goubarev
Publication date
01-12-2010
Publisher
BioMed Central
Published in
Human Resources for Health / Issue 1/2010
Electronic ISSN: 1478-4491
DOI
https://doi.org/10.1186/1478-4491-8-7

Other articles of this Issue 1/2010

Human Resources for Health 1/2010 Go to the issue