Skip to main content
Top
Published in: Prevention Science 3/2011

01-09-2011

Sustaining Fidelity Following the Nationwide PMTO™ Implementation in Norway

Authors: Marion S. Forgatch, David S. DeGarmo

Published in: Prevention Science | Issue 3/2011

Login to get access

Abstract

This report describes three studies from the nationwide Norwegian implementation of Parent Management Training—Oregon Model (PMTO™), an empirically supported treatment for families of children with behavior problems (Forgatch and Patterson 2010). Separate stages of the implementation were evaluated using a fidelity measure based on direct observation of intervention sessions. Study 1 assessed growth in fidelity observed early, mid, and late in the training of a group of practitioners. We hypothesized increased fidelity and decreased variability in practice. Study 2 evaluated method fidelity over the course of three generations of practitioners trained in PMTO. Generation 1 (G1) was trained by the PMTO developer/purveyors; Generation 2 (G2) was trained by selected G1 Norwegian trainers; and Generation 3 (G3) was trained by G1 and G2 trainers. We hypothesized decrease in fidelity with each generation. Study 3 tested the predictive validity of fidelity in a cross-cultural replication, hypothesizing that higher fidelity scores would correlate with improved parenting practices observed in parent–child interactions before and after treatment. In Study 1, trainees’ performance improved and became more homogeneous as predicted. In Study 2, a small decline in fidelity followed the transfer from the purveyor trainers to Norwegian trainers in G2, but G3 scores were equivalent to those attained by G1. Thus, the hypothesis was not fully supported. Finally, the FIMP validity model replicated; PMTO fidelity significantly contributed to improvements in parenting practices from pre- to post-treatment. The data indicate that PMTO was transferred successfully to Norwegian implementation with sustained fidelity and cross-cultural generalization.
Literature
go back to reference Arthur, M. W., Hawkins, J. D., Pollard, J. A., Catalano, R. F., & Baglioni, A. J., Jr. (2002). Measuring risk and protective factors for substance use, delinquency, and other adolescent problem behaviors: The Communities That Care Youth Survey. Evaluation Review, 26, 575–601.PubMed Arthur, M. W., Hawkins, J. D., Pollard, J. A., Catalano, R. F., & Baglioni, A. J., Jr. (2002). Measuring risk and protective factors for substance use, delinquency, and other adolescent problem behaviors: The Communities That Care Youth Survey. Evaluation Review, 26, 575–601.PubMed
go back to reference Bagner, D. M., & Eyberg, S. M. (2003). Father involvement in parent training: When does it matter? Journal of Clinical Child and Adolescent Psychology, 32, 599–605.PubMedCrossRef Bagner, D. M., & Eyberg, S. M. (2003). Father involvement in parent training: When does it matter? Journal of Clinical Child and Adolescent Psychology, 32, 599–605.PubMedCrossRef
go back to reference Beauchaine, T. P., Webster-Stratton, C., & Reid, M. J. (2005). Mediators, moderators, and predictors of 1-year outcomes among children treated for early-onset conduct problems: A latent growth curve analysis. Journal of Consulting and Clinical Psychology, 73, 371–388.PubMedCrossRef Beauchaine, T. P., Webster-Stratton, C., & Reid, M. J. (2005). Mediators, moderators, and predictors of 1-year outcomes among children treated for early-onset conduct problems: A latent growth curve analysis. Journal of Consulting and Clinical Psychology, 73, 371–388.PubMedCrossRef
go back to reference Bernal, G., Bonilla, J., & Bellido, J. (1995). Ecological validity and cultural sensitivity for outcome research: Issues for the cultural adaptation and development of psychosocial treatments with Hispanics. Journal of Abnormal Child Psychology, 23, 67–82.PubMedCrossRef Bernal, G., Bonilla, J., & Bellido, J. (1995). Ecological validity and cultural sensitivity for outcome research: Issues for the cultural adaptation and development of psychosocial treatments with Hispanics. Journal of Abnormal Child Psychology, 23, 67–82.PubMedCrossRef
go back to reference Björnsdóttir, A., & Simarsdóttir, M. (2009). Parent Management Training—The Oregon Model (PMTO™): Effect of a prevention and treatment program for behavioral problems among kindergarten and elementary school children in Hafnarfjördur. Icelandic Journal of Education, 18, 9–28. Björnsdóttir, A., & Simarsdóttir, M. (2009). Parent Management Training—The Oregon Model (PMTO™): Effect of a prevention and treatment program for behavioral problems among kindergarten and elementary school children in Hafnarfjördur. Icelandic Journal of Education, 18, 9–28.
go back to reference Brown, H. C., Wang, W., Kellam, S. G., Muthén, B. O., Petras, H., Toyinbo, P., et al. (2008). Methods for testing theory and evaluating impact in randomized field trials: Intent-to-treat analyses for integrating the perspectives of person, place, and time. Drug and Alcohol Dependence, 95, S74–S104.PubMedCrossRef Brown, H. C., Wang, W., Kellam, S. G., Muthén, B. O., Petras, H., Toyinbo, P., et al. (2008). Methods for testing theory and evaluating impact in randomized field trials: Intent-to-treat analyses for integrating the perspectives of person, place, and time. Drug and Alcohol Dependence, 95, S74–S104.PubMedCrossRef
go back to reference Bullard, L., Wachlarowicz, M., DeLeeuw, J., Snyder, J., Low, S., Forgatch, M. S., et al. (2010). Effects of the Oregon Model of Parent Management Training (PMTO) on marital adjustment in new stepfamilies: A randomized trial. Journal of Family Psychology, 24, 485–496.PubMedCrossRef Bullard, L., Wachlarowicz, M., DeLeeuw, J., Snyder, J., Low, S., Forgatch, M. S., et al. (2010). Effects of the Oregon Model of Parent Management Training (PMTO) on marital adjustment in new stepfamilies: A randomized trial. Journal of Family Psychology, 24, 485–496.PubMedCrossRef
go back to reference Chamberlain, P., Davis, B., Forgatch, M. S., Frey, S., Patterson, G. R., Ray, J. R., et al. (1986). The Therapy Process Code: An observational system. Eugene: Oregon Social Learning Center. Chamberlain, P., Davis, B., Forgatch, M. S., Frey, S., Patterson, G. R., Ray, J. R., et al. (1986). The Therapy Process Code: An observational system. Eugene: Oregon Social Learning Center.
go back to reference Clarke, P. (2008). When can group level clustering be ignored? Multilevel models versus single-level models with sparse data. Journal of Epidemiological Community Health, 62, 752–758.CrossRef Clarke, P. (2008). When can group level clustering be ignored? Multilevel models versus single-level models with sparse data. Journal of Epidemiological Community Health, 62, 752–758.CrossRef
go back to reference DeGarmo, D. S., & Forgatch, M. S. (2007). Efficacy of parent training for stepfathers: From playful spectator and polite stranger to effective stepfathering. Parenting: Science and Practice, 7, 1–25. DeGarmo, D. S., & Forgatch, M. S. (2007). Efficacy of parent training for stepfathers: From playful spectator and polite stranger to effective stepfathering. Parenting: Science and Practice, 7, 1–25.
go back to reference DeGarmo, D. S., Patterson, G. R., & Forgatch, M. S. (2004). How do outcomes in a specified parent training intervention maintain or wane over time? Prevention Science, 5, 73–89.PubMedCrossRef DeGarmo, D. S., Patterson, G. R., & Forgatch, M. S. (2004). How do outcomes in a specified parent training intervention maintain or wane over time? Prevention Science, 5, 73–89.PubMedCrossRef
go back to reference Domenech Rodríguez, M. M., Baumann, A. A., & Schwartz, A. L. (2011). Cultural adaptation of an evidence based intervention: From theory to practice in a Latino/a community context. American Journal of Community Psychology, 47, 170–186.PubMedCrossRef Domenech Rodríguez, M. M., Baumann, A. A., & Schwartz, A. L. (2011). Cultural adaptation of an evidence based intervention: From theory to practice in a Latino/a community context. American Journal of Community Psychology, 47, 170–186.PubMedCrossRef
go back to reference Dumas, J. E., Lynch, A. M., Laughlin, J. E., Smith, E. P., & Prinz, R. J. (2001). Promoting intervention fidelity: Conceptual issues, methods, and preliminary results from the EARLY ALLIANCE prevention trial. American Journal of Preventive Medicine, 20, 38–47.PubMedCrossRef Dumas, J. E., Lynch, A. M., Laughlin, J. E., Smith, E. P., & Prinz, R. J. (2001). Promoting intervention fidelity: Conceptual issues, methods, and preliminary results from the EARLY ALLIANCE prevention trial. American Journal of Preventive Medicine, 20, 38–47.PubMedCrossRef
go back to reference Eames, C. (2008). The Leader Observation Tool: A process skills treatment fidelity measure for the Incredible Years parenting programme. Child Care, Health and Development, 34, 391–400.PubMedCrossRef Eames, C. (2008). The Leader Observation Tool: A process skills treatment fidelity measure for the Incredible Years parenting programme. Child Care, Health and Development, 34, 391–400.PubMedCrossRef
go back to reference Eddy, J. M., & Chamberlain, P. (2000). Family management and deviant peer association as mediators of the impact of treatment condition on youth antisocial behavior. Journal of Consulting and Clinical Psychology, 68, 857–863.PubMedCrossRef Eddy, J. M., & Chamberlain, P. (2000). Family management and deviant peer association as mediators of the impact of treatment condition on youth antisocial behavior. Journal of Consulting and Clinical Psychology, 68, 857–863.PubMedCrossRef
go back to reference Fixsen, D. L., Naoom, S. F., Blase, K. A., Friedman, R. M., & Wallace, F. (2005). Implementation research: A synthesis of the literature. Tampa: University of South Florida, Louis de la Parte Florida Mental Health Institute, National Implementation Research Network. Fixsen, D. L., Naoom, S. F., Blase, K. A., Friedman, R. M., & Wallace, F. (2005). Implementation research: A synthesis of the literature. Tampa: University of South Florida, Louis de la Parte Florida Mental Health Institute, National Implementation Research Network.
go back to reference Fixsen, D. L., Naoom, S. F., Blase, K. A., & Wallace, F. (2007). Implementation: The missing link between research and practice. The APSAC Advisor, Winter/Spring, 4–11. Fixsen, D. L., Naoom, S. F., Blase, K. A., & Wallace, F. (2007). Implementation: The missing link between research and practice. The APSAC Advisor, Winter/Spring, 4–11.
go back to reference Follette, W. C., & Beitz, K. (2003). Adding a more rigorous scientific agenda to the empirically supported treatment movement. Behavior Modification, 27, 369–386.PubMedCrossRef Follette, W. C., & Beitz, K. (2003). Adding a more rigorous scientific agenda to the empirically supported treatment movement. Behavior Modification, 27, 369–386.PubMedCrossRef
go back to reference Forgatch, M. S., Principal Investigator. (2002–2007). Implementing parent management training in Norway (Grant No. R0116097). NIDA NNPRI: Community Multi-Site Prevention Trials (CMPT). Eugene: Oregon Social Learning Center. Forgatch, M. S., Principal Investigator. (2002–2007). Implementing parent management training in Norway (Grant No. R0116097). NIDA NNPRI: Community Multi-Site Prevention Trials (CMPT). Eugene: Oregon Social Learning Center.
go back to reference Forgatch, M. S., & DeGarmo, D. S. (1999). Parenting through change: An effective prevention program for single mothers. Journal of Consulting and Clinical Psychology, 67, 711–724.PubMedCrossRef Forgatch, M. S., & DeGarmo, D. S. (1999). Parenting through change: An effective prevention program for single mothers. Journal of Consulting and Clinical Psychology, 67, 711–724.PubMedCrossRef
go back to reference Forgatch, M. S., & Patterson, G. R. (2010). Parent management training—Oregon model: An intervention for antisocial behavior in children and adolescents. In J. R. Weisz & A. E. Kazdin (Eds.), Evidence-based psychotherapies for children and adolescents (2nd ed., pp. 159–178). New York: Guilford. Forgatch, M. S., & Patterson, G. R. (2010). Parent management training—Oregon model: An intervention for antisocial behavior in children and adolescents. In J. R. Weisz & A. E. Kazdin (Eds.), Evidence-based psychotherapies for children and adolescents (2nd ed., pp. 159–178). New York: Guilford.
go back to reference Forgatch, M. S., Knutson, N. M., & Mayne, T. (1992). Coder impressions of ODS lab tasks. Eugene: Oregon Social Learning Center. Forgatch, M. S., Knutson, N. M., & Mayne, T. (1992). Coder impressions of ODS lab tasks. Eugene: Oregon Social Learning Center.
go back to reference Forgatch, M. S., DeGarmo, D. S., & Beldavs, Z. (2005a). An efficacious theory-based intervention for stepfamilies. Behavior Therapy, 36, 357–365.PubMedCrossRef Forgatch, M. S., DeGarmo, D. S., & Beldavs, Z. (2005a). An efficacious theory-based intervention for stepfamilies. Behavior Therapy, 36, 357–365.PubMedCrossRef
go back to reference Forgatch, M. S., Patterson, G. R., & DeGarmo, D. S. (2005b). Evaluating fidelity: Predictive validity for a measure of competent adherence to the Oregon model of parent management training (PMTO). Behavior Therapy, 36, 3–13.PubMedCrossRef Forgatch, M. S., Patterson, G. R., & DeGarmo, D. S. (2005b). Evaluating fidelity: Predictive validity for a measure of competent adherence to the Oregon model of parent management training (PMTO). Behavior Therapy, 36, 3–13.PubMedCrossRef
go back to reference Forgatch, M. S., Patterson, G. R., DeGarmo, D. S., & Beldavs, Z. G. (2009). Testing the Oregon delinquency model with nine-year follow-up of the Oregon Divorce Study. Development and Psychopathology, 21, 637–660.PubMedCrossRef Forgatch, M. S., Patterson, G. R., DeGarmo, D. S., & Beldavs, Z. G. (2009). Testing the Oregon delinquency model with nine-year follow-up of the Oregon Divorce Study. Development and Psychopathology, 21, 637–660.PubMedCrossRef
go back to reference Glisson, C. (2007). Assessing and changing organizational culture and climate for effective services. Research on Social Work Practice, 17, 736–747.CrossRef Glisson, C. (2007). Assessing and changing organizational culture and climate for effective services. Research on Social Work Practice, 17, 736–747.CrossRef
go back to reference Herschell, A. D., McNeil, C. B., & McNeil, D. W. (2004). Clinical child psychology’s progress in disseminating empirically supported treatments. Clinical Psychology: Science and Practice, 11, 267–288.CrossRef Herschell, A. D., McNeil, C. B., & McNeil, D. W. (2004). Clinical child psychology’s progress in disseminating empirically supported treatments. Clinical Psychology: Science and Practice, 11, 267–288.CrossRef
go back to reference Hogue, A., Liddle, H. A., Singer, A., & Leckrone, J. (2005). Intervention fidelity in family-based prevention counseling for adolescent problem behaviors. Journal of Community Psychology, 33, 191–211.CrossRef Hogue, A., Liddle, H. A., Singer, A., & Leckrone, J. (2005). Intervention fidelity in family-based prevention counseling for adolescent problem behaviors. Journal of Community Psychology, 33, 191–211.CrossRef
go back to reference Jeličić, H., Phelps, E., & Lerner, R. M. (2009). Use of missing data methods in longitudinal studies: The persistence of bad practices in developmental psychology. Developmental Psychobiology, 45, 1195–1199. Jeličić, H., Phelps, E., & Lerner, R. M. (2009). Use of missing data methods in longitudinal studies: The persistence of bad practices in developmental psychology. Developmental Psychobiology, 45, 1195–1199.
go back to reference Knutson, N. M., Forgatch, M. S., Rains, L. A., & Sigmarsdóttir, M. (2009). Fidelity of Implementation Rating System (FIMP): The manual for PMTO™ (Revised ed.). Eugene, OR: Implementation Sciences International, Inc. Knutson, N. M., Forgatch, M. S., Rains, L. A., & Sigmarsdóttir, M. (2009). Fidelity of Implementation Rating System (FIMP): The manual for PMTO™ (Revised ed.). Eugene, OR: Implementation Sciences International, Inc.
go back to reference McHugh, R. K., & Barlow, D. H. (2010). The dissemination and implementation of evidence-based psychological treatments: A review of current efforts. American Psychologist, 65, 73–84.PubMedCrossRef McHugh, R. K., & Barlow, D. H. (2010). The dissemination and implementation of evidence-based psychological treatments: A review of current efforts. American Psychologist, 65, 73–84.PubMedCrossRef
go back to reference Muthén, L. K., & Muthén, B. O. (2010). MPlus: Statistical analysis with latent variables user’s guide (6th ed.). Los Angeles, CA: StatModel. Muthén, L. K., & Muthén, B. O. (2010). MPlus: Statistical analysis with latent variables user’s guide (6th ed.). Los Angeles, CA: StatModel.
go back to reference Ogden, T., & Amlund-Hagen, K. (2008). Treatment effectiveness of parent management training in Norway: A randomized controlled trial of children with conduct problems. Journal of Consulting and Clinical Psychology, 76, 607–621.PubMedCrossRef Ogden, T., & Amlund-Hagen, K. (2008). Treatment effectiveness of parent management training in Norway: A randomized controlled trial of children with conduct problems. Journal of Consulting and Clinical Psychology, 76, 607–621.PubMedCrossRef
go back to reference Ogden, T., Forgatch, M. S., Askeland, E., Patterson, G. R., & Bullock, B. M. (2005). Implementation of parent management training at the national level: The case of Norway. Journal of Social Work Practice, 19, 317–329.CrossRef Ogden, T., Forgatch, M. S., Askeland, E., Patterson, G. R., & Bullock, B. M. (2005). Implementation of parent management training at the national level: The case of Norway. Journal of Social Work Practice, 19, 317–329.CrossRef
go back to reference Patterson, G. R., Reid, J. B., & Dishion, T. J. (1992). Antisocial boys (Vol. 4). Eugene, OR: Castalia. Patterson, G. R., Reid, J. B., & Dishion, T. J. (1992). Antisocial boys (Vol. 4). Eugene, OR: Castalia.
go back to reference Perepletchikova, F., Treat, T. A., & Kazdin, A. E. (2007). Treatment integrity in psychotherapy research: Analysis of the studies and examination of the associated factors. Journal of Consulting and Clinical Psychology, 75, 829–841.PubMedCrossRef Perepletchikova, F., Treat, T. A., & Kazdin, A. E. (2007). Treatment integrity in psychotherapy research: Analysis of the studies and examination of the associated factors. Journal of Consulting and Clinical Psychology, 75, 829–841.PubMedCrossRef
go back to reference Price, R. H. (2000, December). Mobilization, reinvention, and scaling up: Three core processes in knowledge exchange, adaptation, and implementation. Paper presented at the Inaugural World Conference, “The Promotion of Mental Health and Prevention of Mental and Behavioral Disorders,” Atlanta, GA. Price, R. H. (2000, December). Mobilization, reinvention, and scaling up: Three core processes in knowledge exchange, adaptation, and implementation. Paper presented at the Inaugural World Conference, “The Promotion of Mental Health and Prevention of Mental and Behavioral Disorders,” Atlanta, GA.
go back to reference Reid, J. B., Fleischman, M. J., Arthur, J., Toobert, D. J., Stern, S., & Patterson, G. R. (1979, December). Therapist performance observational system. Paper presented at the Association for the Advancement of Behavior Therapy, San Francisco. Reid, J. B., Fleischman, M. J., Arthur, J., Toobert, D. J., Stern, S., & Patterson, G. R. (1979, December). Therapist performance observational system. Paper presented at the Association for the Advancement of Behavior Therapy, San Francisco.
go back to reference Reid, J. B., Patterson, G. R., & Snyder, J. (2002). Antisocial behavior in children and adolescents: A developmental analysis and model for intervention. Washington, DC: American Psychological Association.CrossRef Reid, J. B., Patterson, G. R., & Snyder, J. (2002). Antisocial behavior in children and adolescents: A developmental analysis and model for intervention. Washington, DC: American Psychological Association.CrossRef
go back to reference Rogers, E. M. (1995). Diffusion of innovations (4th ed.). New York: Free Press. Rogers, E. M. (1995). Diffusion of innovations (4th ed.). New York: Free Press.
go back to reference Rohrbach, L. (2006). Type II translation: Transporting prevention interventions from research to real-world settings. Evaluation & the Health Professions, 29, 302–333.CrossRef Rohrbach, L. (2006). Type II translation: Transporting prevention interventions from research to real-world settings. Evaluation & the Health Professions, 29, 302–333.CrossRef
go back to reference Salas, E., & Cannon-Bowers, J. A. (2001). The science of training: A decade of progress. Annual Review of Psychology, 52, 471–499.PubMedCrossRef Salas, E., & Cannon-Bowers, J. A. (2001). The science of training: A decade of progress. Annual Review of Psychology, 52, 471–499.PubMedCrossRef
go back to reference Stevens, V., Bourdeaudhuij, I. D., & Oost, P. V. (2001). Anti-bullying interventions at school: Aspects of programme adaptation and critical issues for further programme development. Health Promotion International, 16, 155–167.PubMedCrossRef Stevens, V., Bourdeaudhuij, I. D., & Oost, P. V. (2001). Anti-bullying interventions at school: Aspects of programme adaptation and critical issues for further programme development. Health Promotion International, 16, 155–167.PubMedCrossRef
go back to reference Stoolmiller, M., & Bank, L. (1995). Autoregressive effects in structural equation models: We see some problems. In J. M. Gottman & G. Sackett (Eds.), The analysis of change (pp. 263–276). Hillsdale, NJ: Erlbaum. Stoolmiller, M., & Bank, L. (1995). Autoregressive effects in structural equation models: We see some problems. In J. M. Gottman & G. Sackett (Eds.), The analysis of change (pp. 263–276). Hillsdale, NJ: Erlbaum.
go back to reference Stoolmiller, M., Duncan, T. E., Bank, L., & Patterson, G. R. (1993). Some problems and solutions in the study of change: Significant patterns of client resistance. Journal of Consulting and Clinical Psychology, 61, 920–928.PubMedCrossRef Stoolmiller, M., Duncan, T. E., Bank, L., & Patterson, G. R. (1993). Some problems and solutions in the study of change: Significant patterns of client resistance. Journal of Consulting and Clinical Psychology, 61, 920–928.PubMedCrossRef
go back to reference Tremblay, R. E., Pagani-Kurtz, L., Mâsse, L. C., Vitaro, F., & Pihl, R. O. (1995). A bimodal preventive intervention for disruptive kindergarten boys: Its impact through mid-adolescence. Journal of Consulting and Clinical Psychology, 63, 560–568.PubMedCrossRef Tremblay, R. E., Pagani-Kurtz, L., Mâsse, L. C., Vitaro, F., & Pihl, R. O. (1995). A bimodal preventive intervention for disruptive kindergarten boys: Its impact through mid-adolescence. Journal of Consulting and Clinical Psychology, 63, 560–568.PubMedCrossRef
go back to reference Waller, G. (2009). Evidence-based treatment and therapist drift. Behaviour Research and Therapy, 47, 119–127.PubMedCrossRef Waller, G. (2009). Evidence-based treatment and therapist drift. Behaviour Research and Therapy, 47, 119–127.PubMedCrossRef
go back to reference Waltz, J., Addis, M. E., Koerner, K., & Jacobson, N. S. (1993). Testing the integrity of a psychotherapy protocol: Assessment of adherence and competence. Journal of Consulting and Clinical Psychology, 61, 620–630.PubMedCrossRef Waltz, J., Addis, M. E., Koerner, K., & Jacobson, N. S. (1993). Testing the integrity of a psychotherapy protocol: Assessment of adherence and competence. Journal of Consulting and Clinical Psychology, 61, 620–630.PubMedCrossRef
Metadata
Title
Sustaining Fidelity Following the Nationwide PMTO™ Implementation in Norway
Authors
Marion S. Forgatch
David S. DeGarmo
Publication date
01-09-2011
Publisher
Springer US
Published in
Prevention Science / Issue 3/2011
Print ISSN: 1389-4986
Electronic ISSN: 1573-6695
DOI
https://doi.org/10.1007/s11121-011-0225-6

Other articles of this Issue 3/2011

Prevention Science 3/2011 Go to the issue