Skip to main content
Top
Published in: Implementation Science 1/2013

Open Access 01-12-2013 | Research

Developing program theory for purveyor programs

Authors: Christa Oosthuizen, Johann Louw

Published in: Implementation Science | Issue 1/2013

Login to get access

Abstract

Background

Frequently, social interventions produce less for the intended beneficiaries than was initially planned. One possible reason is that ideas embodied in interventions are not self-executing and require careful and systematic translation to put into practice. The capacity of implementers to deliver interventions is thus paramount. Purveyor organizations provide external support to implementers to develop that capacity and to encourage high-fidelity implementation behavior. Literature on the theory underlying this type of program is not plentiful. Research shows that detailed, explicit, and agreed-upon program theory contributes to and encourages high-fidelity implementation behavior. The process of developing and depicting program theory is flexible and leaves the researcher with what might be seen as an overwhelming number of options.

Methods

This study was designed to develop and depict the program theory underlying the support services delivered by a South African purveyor. The purveyor supports seventeen local organizations in delivering a peer education program to young people as an HIV/AIDS prevention intervention. Purposive sampling was employed to identify and select study participants. An iterative process that involved site visits, a desktop review of program documentation, one-on-one unstructured interviews, and a subsequent verification process, was used to develop a comprehensive program logic model.

Results

The study resulted in a formalized logic model of how the specific purveyor is supposed to function; that model was accepted by all study participants.

Conclusion

The study serves as an example of how program theory of a ‘real life’ program can be developed and depicted. It highlights the strengths and weakness of this evaluation approach, and provides direction and recommendations for future research on programs that employ the purveyor method to disseminate interventions.
Appendix
Available only for authorised users
Literature
2.
go back to reference Patrizi PA, Gross EC, Freedman S: Strength in flexibility: Lessons from a cluster of capacity building grants in the juvenile justice field. Eval Program Plann. 2006, 29: 162-170. 10.1016/j.evalprogplan.2006.01.010.CrossRef Patrizi PA, Gross EC, Freedman S: Strength in flexibility: Lessons from a cluster of capacity building grants in the juvenile justice field. Eval Program Plann. 2006, 29: 162-170. 10.1016/j.evalprogplan.2006.01.010.CrossRef
3.
go back to reference Fixen DL, Blasé KA, Naoom SF, Wallace F: Core implementation components. Res Social Work Prac. 2009, 19 (5): 531-540. 10.1177/1049731509335549.CrossRef Fixen DL, Blasé KA, Naoom SF, Wallace F: Core implementation components. Res Social Work Prac. 2009, 19 (5): 531-540. 10.1177/1049731509335549.CrossRef
4.
go back to reference Frank RP: Role of the intermediary organization in promoting and disseminating best practices for children and youth: The Connecticut center for effective practice. Emotional Behav Disord Youth. 2010, 10 (4): 87-93. Frank RP: Role of the intermediary organization in promoting and disseminating best practices for children and youth: The Connecticut center for effective practice. Emotional Behav Disord Youth. 2010, 10 (4): 87-93.
8.
go back to reference Elliot DS, Mihalic S: Issues in disseminating and replicating effective prevention programs. Prev Sci. 2004, 47 (6): 47-52.CrossRef Elliot DS, Mihalic S: Issues in disseminating and replicating effective prevention programs. Prev Sci. 2004, 47 (6): 47-52.CrossRef
10.
go back to reference Fagan AA, Mihalic A: Strategies for enhancing the adoption of school-based prevention programs: Lessons learned from the blueprints for violence prevention replications of the skills training programme. J Community Psychol. 2003, 31 (Suppl 3): 235-253.CrossRef Fagan AA, Mihalic A: Strategies for enhancing the adoption of school-based prevention programs: Lessons learned from the blueprints for violence prevention replications of the skills training programme. J Community Psychol. 2003, 31 (Suppl 3): 235-253.CrossRef
11.
go back to reference McHugh RK, Barlow DH: The dissemination and implementation of evidence-based psychological treatments: A review of current efforts. Am Psychol. 2010, 65 (2): 73-84.CrossRefPubMed McHugh RK, Barlow DH: The dissemination and implementation of evidence-based psychological treatments: A review of current efforts. Am Psychol. 2010, 65 (2): 73-84.CrossRefPubMed
12.
go back to reference Greenhalgh T, Robert G, MacFarlane F, Bate P, Kyriakidou O: Diffusion of inovations in service organizations: Systematic review and recommendations. Milbank Q. 2004, 82 (4): 581-629. 10.1111/j.0887-378X.2004.00325.x.CrossRefPubMedPubMedCentral Greenhalgh T, Robert G, MacFarlane F, Bate P, Kyriakidou O: Diffusion of inovations in service organizations: Systematic review and recommendations. Milbank Q. 2004, 82 (4): 581-629. 10.1111/j.0887-378X.2004.00325.x.CrossRefPubMedPubMedCentral
13.
go back to reference Madden NA, Slavin RE, Karweit NL, Dolan LJ, Wasik BA: Success for All: Longitudinal effects of a restructring program for inner-city elementary schools. Am Educ Res J. 1993, 30 (1): 123-148.CrossRef Madden NA, Slavin RE, Karweit NL, Dolan LJ, Wasik BA: Success for All: Longitudinal effects of a restructring program for inner-city elementary schools. Am Educ Res J. 1993, 30 (1): 123-148.CrossRef
14.
go back to reference Schoenwald SK, Brown TL, Henggeler SW: Inside multisystemic therapy: Therapist, supervisory, and program practices. J Emot Behav Disord. 2000, 8 (2): 113-127. 10.1177/106342660000800207.CrossRef Schoenwald SK, Brown TL, Henggeler SW: Inside multisystemic therapy: Therapist, supervisory, and program practices. J Emot Behav Disord. 2000, 8 (2): 113-127. 10.1177/106342660000800207.CrossRef
15.
go back to reference Dumas JE, Lynch AM, Laughlin JE, Smith EP, Prinz RJ: Promoting intervention fidelity conceptual issues, methods, and preliminary results from the EARLY ALLIANCE prevention trail. Am J Prev Med. 2001, 20 (1S): 38-47.CrossRefPubMed Dumas JE, Lynch AM, Laughlin JE, Smith EP, Prinz RJ: Promoting intervention fidelity conceptual issues, methods, and preliminary results from the EARLY ALLIANCE prevention trail. Am J Prev Med. 2001, 20 (1S): 38-47.CrossRefPubMed
16.
go back to reference Mazzucchelli TG, Sanders MR: Facilitating practioner flexibility within an empirically supported intervention: Lessons from a system of parenting support. Clin Psychol- Sci Pr. 2010, 17: 238-252. 10.1111/j.1468-2850.2010.01215.x.CrossRef Mazzucchelli TG, Sanders MR: Facilitating practioner flexibility within an empirically supported intervention: Lessons from a system of parenting support. Clin Psychol- Sci Pr. 2010, 17: 238-252. 10.1111/j.1468-2850.2010.01215.x.CrossRef
17.
go back to reference Stetler CB, Legro MW, Rycroft-Malone J, Bowman C, Curran G, Guihan M, Hagedorn H, Pineros S, Wallace CM: Role of “external facilitation” in implementation of research findings: A qualitative evaluation of facilitation experiences in the veterans health administraton. Implementation Sci. 2006, 1: 23-10.1186/1748-5908-1-23.CrossRef Stetler CB, Legro MW, Rycroft-Malone J, Bowman C, Curran G, Guihan M, Hagedorn H, Pineros S, Wallace CM: Role of “external facilitation” in implementation of research findings: A qualitative evaluation of facilitation experiences in the veterans health administraton. Implementation Sci. 2006, 1: 23-10.1186/1748-5908-1-23.CrossRef
18.
go back to reference Cheater FM, Closs SJ: The effectiveness of methods of dissemination and implementation of clinical guidelines for nursing practice: A selective review. Clin Effectiveness Nurs. 1997, 1: 4-15. 10.1016/S1361-9004(97)80022-2.CrossRef Cheater FM, Closs SJ: The effectiveness of methods of dissemination and implementation of clinical guidelines for nursing practice: A selective review. Clin Effectiveness Nurs. 1997, 1: 4-15. 10.1016/S1361-9004(97)80022-2.CrossRef
19.
go back to reference Mullen EJ, Bledsoe SE, Bellamy JL: Implementing evidence-based social work practice. Res Social Work Prac. 2008, 18 (4): 325-338.CrossRef Mullen EJ, Bledsoe SE, Bellamy JL: Implementing evidence-based social work practice. Res Social Work Prac. 2008, 18 (4): 325-338.CrossRef
21.
go back to reference Luna G, Rotheram-Borus M: Youth living with HIV as peer leaders. Am J Community Psychol. 1999, 27 (1): 1-23.CrossRefPubMed Luna G, Rotheram-Borus M: Youth living with HIV as peer leaders. Am J Community Psychol. 1999, 27 (1): 1-23.CrossRefPubMed
22.
go back to reference Stephenson JM, Strange V, Forrest S, Oakley A: Pupil-led sex education in England: Cluster-randomized intervention trail. Lancet. 2004, 364 (9431): 338-346. 10.1016/S0140-6736(04)16722-6.CrossRefPubMed Stephenson JM, Strange V, Forrest S, Oakley A: Pupil-led sex education in England: Cluster-randomized intervention trail. Lancet. 2004, 364 (9431): 338-346. 10.1016/S0140-6736(04)16722-6.CrossRefPubMed
23.
go back to reference Strange V, Forrest S, Oakley A: Peer-led sex education: Characteristics of peer education and their perceptions of the impact on them of participation in a peer education program. Health Educ Res. 2002, 17 (3): 327-337. 10.1093/her/17.3.327.CrossRefPubMed Strange V, Forrest S, Oakley A: Peer-led sex education: Characteristics of peer education and their perceptions of the impact on them of participation in a peer education program. Health Educ Res. 2002, 17 (3): 327-337. 10.1093/her/17.3.327.CrossRefPubMed
24.
go back to reference Campbell C, Foulis CA: Creating context that support youth-led HIV prevention in schools. Soc Transit. 2002, 33 (3): 339-356. Campbell C, Foulis CA: Creating context that support youth-led HIV prevention in schools. Soc Transit. 2002, 33 (3): 339-356.
25.
go back to reference Harrison A, Smit JA, Meyer L: Prevention of HIV/AIDS in South Africa: a review of behaviour change interventions, evidence and options for the future. S Afr J Sci. 2000, 96 (6): 285-291. Harrison A, Smit JA, Meyer L: Prevention of HIV/AIDS in South Africa: a review of behaviour change interventions, evidence and options for the future. S Afr J Sci. 2000, 96 (6): 285-291.
26.
go back to reference Sweifach J, LaPorte HH: Perceptions of peer to peer HIV/AIDS education: A social work perspective. J HIV/AIDS Prev Child Youth. 2006, 7 (2): 119-134.CrossRef Sweifach J, LaPorte HH: Perceptions of peer to peer HIV/AIDS education: A social work perspective. J HIV/AIDS Prev Child Youth. 2006, 7 (2): 119-134.CrossRef
27.
go back to reference Borgia P, Marinacci C, Schifano P, Perucci CA: Is peer education the best approach for HIV prevention in schools? Findings from a randomized controlled trail. J Adolesc Health. 2005, 36: 508-516. 10.1016/j.jadohealth.2004.03.005.CrossRefPubMed Borgia P, Marinacci C, Schifano P, Perucci CA: Is peer education the best approach for HIV prevention in schools? Findings from a randomized controlled trail. J Adolesc Health. 2005, 36: 508-516. 10.1016/j.jadohealth.2004.03.005.CrossRefPubMed
28.
go back to reference Donaldson SI: Program theory-driven evaluation science: Strategies and applications. 2007, New York: Lawrence Erlbaum Associates Donaldson SI: Program theory-driven evaluation science: Strategies and applications. 2007, New York: Lawrence Erlbaum Associates
29.
go back to reference Rossi PH, Lipsey MW, Freeman HE: Tailoring evaluations. Evaluation: A systematic approach. Edited by: Rossi PH, Lipsey MW, Freeman HE. 2004, Thousand Oaks: Sage Publications, 31-65. 7 Rossi PH, Lipsey MW, Freeman HE: Tailoring evaluations. Evaluation: A systematic approach. Edited by: Rossi PH, Lipsey MW, Freeman HE. 2004, Thousand Oaks: Sage Publications, 31-65. 7
30.
go back to reference Donaldson SI, Lipsey MW: Roles for theory in contemporary evaluation practice: Developing practical knowledge. The Handbook of Evaluation: Policies, Programs, and Practices. Edited by: Shaw I, Greene JC, Mark MM. 2006, London: Sage, 56-75. Donaldson SI, Lipsey MW: Roles for theory in contemporary evaluation practice: Developing practical knowledge. The Handbook of Evaluation: Policies, Programs, and Practices. Edited by: Shaw I, Greene JC, Mark MM. 2006, London: Sage, 56-75.
31.
go back to reference Funnell SC, Rogers PJ: Purposeful program theory. 2011, San Francisco: Jossey-Bass Funnell SC, Rogers PJ: Purposeful program theory. 2011, San Francisco: Jossey-Bass
32.
go back to reference Baker EL: Taking programs to scale: A phased approach to expanding proven interventions. J Public Health Manag Pract. 2010, 16 (3): 264-269.CrossRefPubMed Baker EL: Taking programs to scale: A phased approach to expanding proven interventions. J Public Health Manag Pract. 2010, 16 (3): 264-269.CrossRefPubMed
33.
go back to reference Rogers PJ, Petrosino A, Huebner TA, Hacsi TA: Program theory evaluation: Practice, promise, and problems. New Dir Eval. 2000, 87: 5-13.CrossRef Rogers PJ, Petrosino A, Huebner TA, Hacsi TA: Program theory evaluation: Practice, promise, and problems. New Dir Eval. 2000, 87: 5-13.CrossRef
34.
go back to reference Rogers PJ: Causal models in program theory evaluation. New Dir Eval. 2000, 87: 47-55.CrossRef Rogers PJ: Causal models in program theory evaluation. New Dir Eval. 2000, 87: 47-55.CrossRef
35.
go back to reference Patton MQ: Utilization-focused evaluation. 2008, Thousand Oaks: Sage Patton MQ: Utilization-focused evaluation. 2008, Thousand Oaks: Sage
36.
go back to reference Pawson R, Tilley N: Realistic Evaluation. 1995, London: Sage Pawson R, Tilley N: Realistic Evaluation. 1995, London: Sage
37.
go back to reference Torres RT, Preskill H: Evaluation and organizational learning: Past, present, and future. Am J Eval. 2001, 22 (3): 387-395.CrossRef Torres RT, Preskill H: Evaluation and organizational learning: Past, present, and future. Am J Eval. 2001, 22 (3): 387-395.CrossRef
38.
go back to reference Frechtling JA: Logic modelling methods in program evaluation. 2007, San Francisco: John Wiley & Sons Frechtling JA: Logic modelling methods in program evaluation. 2007, San Francisco: John Wiley & Sons
39.
go back to reference Barrett M, Bissell M: A process evaluation of the youth education about health (YEAH) program: A peer-designed and peer-led sexual health education program. Can J Hum Sex. 2005, 14 (3–4): 129-141. Barrett M, Bissell M: A process evaluation of the youth education about health (YEAH) program: A peer-designed and peer-led sexual health education program. Can J Hum Sex. 2005, 14 (3–4): 129-141.
41.
go back to reference Chen HT: Practical program evaluation: Assessing and improving planning, implementation and effectiveness. 2005, Thousand Oaks: SageCrossRef Chen HT: Practical program evaluation: Assessing and improving planning, implementation and effectiveness. 2005, Thousand Oaks: SageCrossRef
42.
go back to reference Donadson SI, Gooler LE, Scriven M: Strategies for managing evaluation anxiety: Toward a psychology of program evaluation. Am J Eval. 2002, 23 (3): 261-273.CrossRef Donadson SI, Gooler LE, Scriven M: Strategies for managing evaluation anxiety: Toward a psychology of program evaluation. Am J Eval. 2002, 23 (3): 261-273.CrossRef
43.
go back to reference Wholey J: Evaluability Assessment. Handbook of Practical Program Evaluation. Edited by: Wholey J, Hatry H, Newcomer K. 2004, San Francisco: Jossey Bass, 33-62. Wholey J: Evaluability Assessment. Handbook of Practical Program Evaluation. Edited by: Wholey J, Hatry H, Newcomer K. 2004, San Francisco: Jossey Bass, 33-62.
44.
go back to reference Weiss CH: How can theory-based evaluation make greater headway?. Evaluation Rev. 1997, 21: 501-524. 10.1177/0193841X9702100405.CrossRef Weiss CH: How can theory-based evaluation make greater headway?. Evaluation Rev. 1997, 21: 501-524. 10.1177/0193841X9702100405.CrossRef
45.
go back to reference Kopf N, Thayer C: Echoes from the field: Proven capacity-building principles for nonprofits. 2001, Washington: Innovation Network Inc Kopf N, Thayer C: Echoes from the field: Proven capacity-building principles for nonprofits. 2001, Washington: Innovation Network Inc
Metadata
Title
Developing program theory for purveyor programs
Authors
Christa Oosthuizen
Johann Louw
Publication date
01-12-2013
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2013
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/1748-5908-8-23

Other articles of this Issue 1/2013

Implementation Science 1/2013 Go to the issue