Top

Administration and Policy in Mental Health and Mental Health Services Research

Published in:

Open Access 01-01-2011 | Original Paper

Mixed Method Designs in Implementation Research

Authors: Lawrence A. Palinkas, Gregory A. Aarons, Sarah Horwitz, Patricia Chamberlain, Michael Hurlburt, John Landsverk

Published in: Administration and Policy in Mental Health and Mental Health Services Research | Issue 1/2011

Abstract

This paper describes the application of mixed method designs in implementation research in 22 mental health services research studies published in peer-reviewed journals over the last 5 years. Our analyses revealed 7 different structural arrangements of qualitative and quantitative methods, 5 different functions of mixed methods, and 3 different ways of linking quantitative and qualitative data together. Complexity of design was associated with number of aims or objectives, study context, and phase of implementation examined. The findings provide suggestions for the use of mixed method designs in implementation research.

Aarons, G. A., Hurlburt, M., & Horwitz, S. M., (2010). Advancing a conceptual model of evidence-based practice implementation in child welfare. Administration and Policy in Mental Health and Mental Health Services Research (submitted).

Aarons, G. A., & Palinkas, L. A. (2007). Implementation of evidence-based practice in child welfare: Service provider perspectives. Administration and Policy in Mental Health and Mental Health Services Research, 34, 411–419.CrossRefPubMed

Aarons, G. A., Wells, R., Zagursky, K., Fettes, D. L., & Palinkas, L. A. (2009). Implementing evidence-based practice in community mental health agencies: Multiple stakeholder perspectives. American Journal of Public Health, 99(11), 2087–2095.CrossRefPubMed

Bachman, M. O., O’Brien, M., Husbands, C., Shreeve, A., Jones, N., Watson, J., et al. (2009). Integrating children’s services in England: National evaluation of children’s trusts. Child: Care, Health and Development, 35, 257–265.CrossRef

Bearsley-Smith, C., Brown, M. O., Sellick, K., Villanueva, E. V., Chesters, J., Francis, K., et al. (2007). Does interpersonal psychotherapy improve clinical care for adolescents with depression attending a rural child and adolescent mental health service? Study protocol for a cluster randomized feasibility trial. BMC Psychiatry, 7, 53. doi:10.1186/1471-244X-7-53.CrossRefPubMed

Bernard, H. R. (1988). Qualitative methods in cultural anthropology. Newbury Park, CA: Sage.

Berwick, D. M. (2008). The science of improvement. Journal of the American Medical Association, 299(10), 1182–1184.CrossRefPubMed

Blasinsky, M., Goldman, H. H., & Unűtzer, J. (2006). Project IMPACT: A report on barriers and facilitators to sustainability. Administration and Policy in Mental Health and Mental Health Services, 33, 718–729.CrossRef

Brunette, M. F., Asher, D., Whitley, R., Lutz, W. J., Weider, B. L., Jones, A. M., et al. (2008). Implementation of integrated dual disorders treatment: A qualitative analysis of facilitators and barriers. Psychiatric Services, 59, 989–995.CrossRefPubMed

Burns, B. J., Phillips, S. D., Wagner, H. R., Barth, R. P., Kolko, D. J., Campbell, C., et al. (2004). Mental health need and access to mental health services by youths involved with child welfare: A national survey. Journal of the American Academy of Child and Adolescent Psychiatry, 43, 960–970.CrossRefPubMed

Chamberlain, P., Leve, L. D., & DeGarmo, D. S. (2007). Multi-dimensional treatment foster care for girls in the juvenile justice system: 2-year follow-up of a randomized clinical trial. Journal of Consulting and Clinical Psychology, 75(1), 187–193.CrossRefPubMed

Cresswell, J. W., & Plano Clark, V. L. (2007). Designing and conducting mixed method research. Thousand Oaks, CA: Sage.

Gioia, D., & Dziadosz, G. (2008). Adoption of evidence-based practices in community mental health: A mixed method study of practitioner experience. Community Mental Health Journal, 44, 347–357.CrossRefPubMed

Glisson, C., & Schoenwald, S. K. (2005). The ARC organizational and community intervention strategy for implementing evidence-based children’s mental health treatments. Mental Health Services Research, 7(4), 243–259.CrossRefPubMed

Greene, J. C., Caracelli, V. J., & Graham, W. F. (1989). Toward a conceptual framework for mixed method evaluation designs. Educational Evaluation and Policy Analysis, 11, 255–274.

Henke, R. M., Chou, A. F., Chanin, J. C., Zides, A. B., & Scholle, S. H. (2008). Physician attitude toward depression care interventions: Implications for implementation of quality improvement initiatives. Implementation Science, 3, 40. doi:10.1186/1748-5908-3-40.CrossRefPubMed

Hoagwood, K., & Olin, S. (2002). The NIMH blueprint for change report: Research priorities in child and adolescent mental health. Journal of the American Academy of Child and Adolescent Psychiatry, 41(7), 760–767.CrossRefPubMed

Hoagwood, K. E., Vogel, J. M., Levitt, J. M., D’Amico, P. J., Paisner, W. I., & Kaplan, S. J. (2007). Implementing an evidence-based trauma treatment in a state system after September 11: The CATS Project. Journal of the American Academy of Child and Adolescent Psychiatry, 46(6), 773–779.CrossRefPubMed

Kramer, T. F., & Burns, B. J. (2008). Implementing cognitive behavioral therapy in the real world: A case study of two mental health centers. Implementation Science, 3, 14. doi:10.1186/1748-3-14.CrossRefPubMed

Landsverk, J., Brown, C. H., Rolls Reutz, J., Palinkas, L. A., & Horwitz, S. M. (2010). Design elements in implementation research: A structured review of child welfare and child mental health studies. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-010-0315-y.

Leslie, L. K., Hurlburt, M. S., Landsverk, J., Barth, R., & Slymen, D. J. (2004). Outpatient mental health services for children in foster care: A national perspective. Child Abuse and Neglect, 28, 697–712.CrossRef

Marshall, T., Rapp, C. A., Becker, D. R., & Bond, G. R. (2008). Key factors for implementing supported employment. Psychiatric Services, 59, 886–892.CrossRefPubMed

Marty, D., Rapp, C., McHugo, G., & Whitley, R. (2008). Factors influencing consumer outcome monitoring in implementation of evidence-based practices: Results from the National EBP Implementation Project. Administration and Policy In Mental Health, 35, 204–211.CrossRefPubMed

McKibbon, K. A., & Gadd, C. S. (2004). A quantitative analysis of qualitative studies in clinical journals for the 2000 publishing year. BMC Medical Informatics and Decision Making, 4, 11. doi:10.1186/1472-6947-4-11.CrossRefPubMed

Miles, M. B., & Huberman, A. M. (1994). Qualitative data analysis: An expanded sourcebook (2nd ed.). Thousand Oaks, CA: Sage.

Morse, J. M. (1991). Approaches to qualitative–quantitative methodological triangulation. Nursing Research, 40, 120–123.CrossRefPubMed

National Institute of Mental Health. (2004). Advancing the science of implementation: Improving the fit between mental health intervention development and service systems. Retrieved January 2010 from http://www/nimh.nih.gov/scientific meetings/scienceofimplementation.pdf.

Palinkas, L. A., & Aarons, G. A. (2009). A view from the top: Executive and management challenges in a statewide implementation of an evidence-based practice to reduce child neglect. International Journal of Child Health and Human Development, 2, 47–55.

Palinkas, L. A., Aarons, G. A., Chorpita, B. F., Hoagwood, K., Landsverk, J., Weisz, J. R., et al. (2009). Cultural exchange and the implementation of evidence-based practice: Two case studies. Research on Social Work Practice, 19, 602–612.CrossRef

Palinkas, L. A., Horwitz, S. M., Chamberlain, P., Hulrburt, M., & Landsverk, J. (2010). Mixed method designs in mental health services research. Psychiatric Services (in press).

Palinkas, L. A., Schoenwald, S. K., Hoagwood, K., Landsverk, J., Chorpita, B., Weisz, J. R., et al. (2008). An ethnographic study of implementation of evidence-based treatments in child mental health: First steps. Psychiatric Services, 59(7), 738–746.CrossRefPubMed

Patton, M. Q. (2001). Qualitative research and evaluation methods (3rd ed.). Thousand Oaks, CA: Sage Publications.

Proctor, E. K., Knudsen, K. J., Fedoracivius, N., Hovmand, P., Rosen, A., & Perron, B. (2007). Implementation of evidence-based practice in community behavioral health: Agency director perspectives. Administration and Policy In Mental Health, 34, 479–488.CrossRefPubMed

Proctor, E. K., Landsverk, J., Aarons, G., Chambers, D., Glisson, C., & Mittman, C. (2009). Implementation research in mental health services: An emerging science with conceptual, methodological, and training challenges. Administration and Policy in Mental Health and Mental Health Services, 36, 24–34.CrossRef

Rapp, C. A., Etzel-Wise, D., Marty, D., Coffman, M., Carlson, L., Asher, D., Callaghan, J., & Holter M. (2009). Barriers to evidence-based practice implementation: Results of a qualitative study. Community Mental Health Journal. doi:10.1007/s10597-009-9238-z.

Robins, C. S., Ware, N. C., dosReis, S., Willging, C. E., Chung, J. Y., & Lewis-Fernández, R. (2008). Dialogues on mixed methods and mental health services research: Anticipating challenges, building solutions. Psychiatric Services, 59, 727–731.CrossRefPubMed

Schoenwald, S. K., Garland, A. F., Chapman, J. E., Frazier S. L., Sheidow, A. J., & Southam-Gerow, M. A. (2010). Toward an effective and efficient measurement of implementation fidelity. Administration and Policy in Mental Health and Mental Health Services Research (submitted).

Sharkey, S., MacIver, S., Cameron, D., Reynolds, W., Lauder, W., & Veitch, T. (2005). An exploration of factors affecting the implementation of a randomized controlled trial of a transitional discharge model for people with serious mental illness. Journal of Psychiatric and Mental Health Nursing, 12, 51–56.CrossRefPubMed

Slade, M., Gask, L., Leese, M., McCrone, P., Montana, C., Powell, R., et al. (2008). Failure to improve appropriateness of referrals to adult community mental health services–lessons from a multi-site cluster randomized controlled trial. Family Practice, 25, 181–190.CrossRefPubMed

Sofaer, S. (1999). Qualitative methods: What are they and why use them? Health Services Research, 34, 1101–1118.PubMed

Swain, K., Whitley, R., McHugo, G. J., & Drake, R. E. (2009). The sustainability of evidence-based practices in routine mental health agencies. Community Mental Health Journal. epub ahead of print. doi:10.1007/s10597-009-9202y.

Tashakkori, A., & Teddlie, C. (1998). Mixed methodology: Combining the qualitative and quantitative approaches. Thousand Oaks: Sage.

Teddlie, C., & Tashakkori, A. (2003). Major issues and controversies in the use of mixed methods in the social and behavioral sciences. In A. Tashakkori & C. Teddlie (Eds.), Handbook of mixed methods in the social and behavioral sciences (pp. 3–50). Thousand Oaks, CA: Sage.

Trochim, W. M. (1989). An introduction to concept mapping for planning and evaluation. Evaluation and Program Planning, 12, 1–16.CrossRef

Usher, C. L., & Wildfire, J. B. (2003). Evidence-based practice in community-based child welfare systems. Child Welfare, 82, 597–614.PubMed

Whitley, R., Gingerich, S., Lutz, W. J., & Mueser, K. T. (2009). Implementing the illness management and recovery program in community mental health settings: Facilitators and barriers. Psychiatric Services, 60, 202–209.CrossRefPubMed

Woltman, E. M., Whitley, R., McHugo, G. J., et al. (2008). The role of staff turnover in the implementation of evidence-based practices in health care. Psychiatric Services, 59, 732–737.CrossRef

Zazzali, J. L., Sherbourne, C., Hoagwood, K. E., Greene, D., Bigley, M. F., & Sexton, T. L. (2008). The adoption and implementation of an evidence based practice in child and family mental health services organizations: A pilot study of functional family therapy in New York State. Administration and Policy In Mental Health, 35, 38–49.CrossRefPubMed

Title: Mixed Method Designs in Implementation Research
Authors: Lawrence A. Palinkas
Gregory A. Aarons
Sarah Horwitz
Patricia Chamberlain
Michael Hurlburt
John Landsverk
Publication date: 01-01-2011
Publisher: Springer US
Published in: Administration and Policy in Mental Health and Mental Health Services Research / Issue 1/2011
Print ISSN: 0894-587X
Electronic ISSN: 1573-3289
DOI: https://doi.org/10.1007/s10488-010-0314-z

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Mixed Method Designs in Implementation Research

Abstract

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Abstract

Please log in to get access to this content

Other articles of this Issue 1/2011

Toward the Effective and Efficient Measurement of Implementation Fidelity

Design Elements in Implementation Research: A Structured Review of Child Welfare and Child Mental Health Studies

Advancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors

Methodological Issues in Child Welfare and Children’s Mental Health Implementation Research

A Strategy for Assessing Costs of Implementing New Practices in the Child Welfare System: Adapting the English Cost Calculator in the United States