Top

Administration and Policy in Mental Health and Mental Health Services Research

Published in:

01-09-2015 | Original Article

Purposeful Sampling for Qualitative Data Collection and Analysis in Mixed Method Implementation Research

Authors: Lawrence A. Palinkas, Sarah M. Horwitz, Carla A. Green, Jennifer P. Wisdom, Naihua Duan, Kimberly Hoagwood

Published in: Administration and Policy in Mental Health and Mental Health Services Research | Issue 5/2015

Abstract

Purposeful sampling is widely used in qualitative research for the identification and selection of information-rich cases related to the phenomenon of interest. Although there are several different purposeful sampling strategies, criterion sampling appears to be used most commonly in implementation research. However, combining sampling strategies may be more appropriate to the aims of implementation research and more consistent with recent developments in quantitative methods. This paper reviews the principles and practice of purposeful sampling in implementation research, summarizes types and categories of purposeful sampling strategies and provides a set of recommendations for use of single strategy or multistage strategy designs, particularly for state implementation research.

Aarons, G. A., Green, A. E., Palinkas, L. A., Self-Brown, S., Whitaker, D. J., Lutzker, J. R., et al. (2012). Dynamic adaptation process to implement an evidence-based maltreatment intervention. Implementation Science, 7, 32.PubMedCentralCrossRefPubMed

Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011). Advancing a conceptual model of evidence-based practice implementation in child welfare. Administration and Policy in Mental Health and Mental Health Services Research, 38, 4–23.PubMedCentralCrossRefPubMed

Aarons, G. A., & Palinkas, L. A. (2007). Implementation of evidence-based practice in child welfare: Service provider perspectives. Administration and Policy in Mental Health and Mental Health Services Research, 34, 411–419.CrossRefPubMed

Aarons, G. A., Wells, R., Zagursky, K., Fettes, D. L., & Palinkas, L. A. (2009). Implementing evidence-based practice in community mental health agencies: Multiple stakeholder perspectives. American Journal of Public Health, 99(11), 2087–2095.PubMedCentralCrossRefPubMed

Bachman, M. O., O’Brien, M., Husbands, C., Shreeve, A., Jones, N., Watson, J., et al. (2009). Integrating children’s services in England: National evaluation of children’s trusts. Child: Care, Health and Development, 35, 257–265.

Bernard, H. R. (2002). Research methods in anthropology: Qualitative and quantitative approaches (3rd ed.). Walnut Creek, CA: Alta Mira Press.

Bloom, H. S., & Michalopoulos, C. (2013). When is the story in the subgroups? Strategies for interpreting and reporting intervention effects for subgroups. Prevention Science, 14, 179–188.CrossRefPubMed

Brown, C., Ten Have, T., Jo, B., Dagne, G., Wyman, P., Muthén, B., et al. (2009). Adaptive designs for randomized trials in public health. Annual Review of Public Health, 30, 1–25.PubMedCentralCrossRefPubMed

Brown, C. H., Wang, W., Kellam, S. G., Muthén, B. O., & Prevention Science and Methodology Group. (2008). Methods for testing theory and evaluating impact in randomized field trials: Intent-to-treat analyses for integrating the perspectives of person, place, and time. Drug and Alcohol Dependence, S95, S74–S104.CrossRef

Brown, C. H., Wyman, P. A., Guo, J., & Peña, J. (2006). Dynamic wait-listed designs for randomized trials: New designs for prevention of youth suicide. Clinical Trials, 3, 259–271.CrossRefPubMed

Brunette, M. F., Asher, D., Whitley, R., Lutz, W. J., Weider, B. L., Jones, A. M., et al. (2008). Implementation of integrated dual disorders treatment: A qualitative analysis of facilitators and barriers. Psychiatric Services, 59, 989–995.CrossRefPubMed

Cresswell, J. W., & Plano Clark, V. L. (2011). Designing and conducting mixed method research (2nd ed.). Thousand Oaks, CA: Sage.

Curran, G. M., Bauer, M., Mittman, B., Pyne, J. M., & Stetler, C. (2012). Effectiveness-implementation hybrid designs: Combining elements of clinical effectiveness and implementation research to enhance public health impact. Medical Care, 50, 217–226.PubMedCentralCrossRefPubMed

Denzen, N. K. (1978). The research act: A theoretical introduction to sociological methods (2nd ed.). New York: McGraw Hill.

Duan, N., Bhaumik, D. K., Palinkas, L. A., & Hoagwood, K. (this issue). Purposeful sampling and optimal design. Administration and Policy in Mental Health and Mental Health Services Research.

Gioia, D., & Dziadosz, G. (2008). Adoption of evidence-based practices in community mental health: A mixed method study of practitioner experience. Community Mental Health Journal, 44, 347–357.CrossRefPubMed

Glaser, B. G. (1978). Theoretical sensitivity. Mill Valley, CA: Sociology Press.

Glaser, B. G., & Straus, A. L. (1967). The discovery of grounded theory: Strategies for qualitative research. New York: Aldine de Gruyter.

Glasgow, R., Magid, D., Beck, A., Ritzwoller, D., & Estabrooks, P. (2005). Practical clinical trials for translating research to practice: Design and measurement recommendations. Medical Care, 43(6), 551.CrossRefPubMed

Green, A. E., & Aarons, G. A. (2011). A comparison of policy and direct practice stakeholder perceptions of factors affecting evidence-based practice implementation using concept mapping. Implementation Science, 6, 104.PubMedCentralCrossRefPubMed

Guest, G., Bunce, A., & Johnson, L. (2006). How many interviews are enough? An experiment with data saturation and variability. Field Methods, 18(1), 59–82.CrossRef

Henke, R. M., Chou, A. F., Chanin, J. C., Zides, A. B., & Scholle, S. H. (2008). Physician attitude toward depression care interventions: Implications for implementation of quality improvement initiatives. Implementation Science, 3, 40.PubMedCentralCrossRefPubMed

Hoagwood, K. E., Vogel, J. M., Levitt, J. M., D’Amico, P. J., Paisner, W. I., & Kaplan, S. J. (2007). Implementing an evidence-based trauma treatment in a state system after September 11: The CATS Project. Journal of the American Academy of Child and Adolescent Psychiatry, 46(6), 773–779.CrossRefPubMed

Kemper, E. A., Stringfield, S., & Teddlie, C. (2003). Mixed methods sampling strategies in social science research. In A. Tashakkori & C. Teddlie (Eds.), Handbook of mixed methods in the social and behavioral sciences (pp. 273–296). Thousand Oaks, CA: Sage.

Kramer, T. F., & Burns, B. J. (2008). Implementing cognitive behavioral therapy in the real world: A case study of two mental health centers. Implementation Science, 3, 14.PubMedCentralCrossRefPubMed

Landsverk, J., Brown, H., Chamberlain, P., Palinkas, L. A., & Horwitz, S. M. (2012). Design and analysis in dissemination and implementation research. In R. C. Brownson, G. A. Colditz, & E. K. Proctor (Eds.), Translating science to practice (pp. 225–260). New York: Oxford University Press.

Marshall, T., Rapp, C. A., Becker, D. R., & Bond, G. R. (2008). Key factors for implementing supported employment. Psychiatric Services, 59, 886–892.CrossRefPubMed

Marty, D., Rapp, C., McHugo, G., & Whitley, R. (2008). Factors influencing consumer outcome monitoring in implementation of evidence-based practices: Results from the National EBP Implementation Project. Administration and Policy In Mental Health, 35, 204–211.CrossRefPubMed

Miles, M. B., & Huberman, A. M. (1994). Qualitative data analysis: An expanded sourcebook (2nd ed.). Thousand Oaks, CA: Sage.

Minkler, M., & Wallerstein, N. (Eds.). (2003). Community-based participatory research for health. San Francisco, CA: Jossey-Bass.

Morgan, D. L. (1997). Focus groups as qualitative research. Newbury Park, CA: Sage.

Morse, J. M., & Niehaus, L. (2009). Mixed method design: Principles and procedures. Walnut Creek, CA: Left Coast Press.

Padgett, D. K. (2008). Qualitative methods in social work research (2nd ed.). Los Angeles: Sage.

Palinkas, L. A., Aarons, G. A., Horwitz, S. M., Chamberlain, P., Hurlburt, M., & Landsverk, J. (2011a). Mixed method designs in implementation research. Administration and Policy in Mental Health and Mental Health Services Research, 38, 44–53.PubMedCentralCrossRefPubMed

Palinkas, L. A., Ell, K., Hansen, M., Cabassa, L. J., & Wells, A. A. (2011b). Sustainability of collaborative care interventions in primary care settings. Journal of Social Work, 11, 99–117.CrossRef

Palinkas, L. A., Holloway, I. W., Rice, E., Fuentes, D., Wu, Q., & Chamberlain, P. (2011c). Social networks and implementation of evidence-based practices in public youth-serving systems: A mixed methods study. Implementation Science, 6, 113.PubMedCentralCrossRefPubMed

Palinkas, L. A., Fuentes, D., Garcia, A. R., Finno, M., Holloway, I. W., & Chamberlain, P. (2012). Inter-organizational collaboration in the implementation of evidence-based practices among agencies serving abused and neglected youth. Administration and Policy in Mental Health and Mental Health Services Research. doi:10.1007/s10488-012-0437-5.

Palinkas, L. A., & Soydan, H. (2012). Translation and implementation of evidence-based practice. New York: Oxford University Press.

Patton, M. Q. (2002). Qualitative research and evaluation methods (3rd ed.). Thousand Oaks, CA: Sage.

Proctor, E. K., Knudsen, K. J., Fedoracivius, N., Hovmand, P., Rosen, A., & Perron, B. (2007). Implementation of evidence-based practice in community behavioral health: Agency director perspectives. Administration and Policy in Mental Health, 34, 479–488.CrossRefPubMed

Proctor, E. K., Landsverk, J., Aarons, G., Chambers, D., Glisson, C., & Mittman, C. (2009). Implementation research in mental health services: An emerging science with conceptual, methodological, and training challenges. Administration and Policy in Mental Health and Mental Health Services Research, 36, 24–34.CrossRefPubMed

Rapp, C. A., Etzel-Wise, D., Marty, D., Coffman, M., Carlson, L., Asher, D., et al. (2010). Barriers to evidence-based practice implementation: Results of a qualitative study. Community Mental Health Journal, 46, 112–118.CrossRefPubMed

Raudenbush, S., & Liu, X. (2000). Statistical power and optimal design for multisite randomized trials. Psychological Methods, 5, 199–213.CrossRefPubMed

Slade, M., Gask, L., Leese, M., McCrone, P., Montana, C., Powell, R., et al. (2008). Failure to improve appropriateness of referrals to adult community mental health services—Lessons from a multi-site cluster randomized controlled trial. Family Practice, 25, 181–190.CrossRefPubMed

Spradley, J. P. (1979). The ethnographic interview. New York: Holt, Rinehart & Winston.

Swain, K., Whitley, R., McHugo, G. J., & Drake, R. E. (2010). The sustainability of evidence-based practices in routine mental health agencies. Community Mental Health Journal, 46, 119–129.CrossRefPubMed

Teddlie, C., & Tashakkori, A. (2003). Major issues and controversies in the use of mixed methods in the social and behavioral sciences. In A. Tashakkori & C. Teddlie (Eds.), Handbook of mixed methods in the social and behavioral sciences (pp. 3–50). Thousand Oaks, CA: Sage.

Tunis, S. R., Stryer, D. B., & Clancey, C. M. (2003). Increasing the value of clinical research for decision making in clinical and health policy. Journal of the American Medical Association, 290(1624–1632), 2003.

Wisdom, J. P., Cavaleri, M. C., Onwuegbuzie, A. T., & Green, C. A. (2011). Methodological reporting in qualitative, quantitative, and mixed methods health services research articles. Health Services Research, 47, 721–745.PubMedCentralCrossRefPubMed

Woltmann, E. M., Whitley, R., McHugo, G. J., et al. (2008). The role of staff turnover in the implementation of evidence-based practices in health care. Psychiatric Services, 59, 732–737.CrossRefPubMed

Zazzali, J. L., Sherbourne, C., Hoagwood, K. E., Greene, D., Bigley, M. F., & Sexton, T. L. (2008). The adoption and implementation of an evidence based practice in child and family mental health services organizations: A pilot study of functional family therapy in New York State. Administration and Policy in Mental Health, 35, 38–49.CrossRefPubMed

Title: Purposeful Sampling for Qualitative Data Collection and Analysis in Mixed Method Implementation Research
Authors: Lawrence A. Palinkas
Sarah M. Horwitz
Carla A. Green
Jennifer P. Wisdom
Naihua Duan
Kimberly Hoagwood
Publication date: 01-09-2015
Publisher: Springer US
Published in: Administration and Policy in Mental Health and Mental Health Services Research / Issue 5/2015
Print ISSN: 0894-587X
Electronic ISSN: 1573-3289
DOI: https://doi.org/10.1007/s10488-013-0528-y

Keynote webinar | Spotlight on sleep in brain health

Springer Medicine

Purposeful Sampling for Qualitative Data Collection and Analysis in Mixed Method Implementation Research

Abstract

Keynote webinar | Spotlight on sleep in brain health

Springer Medicine

Abstract

Please log in to get access to this content

Other articles of this Issue 5/2015

Clinicians’ Attitudes Towards Outcome and Process Monitoring: A Validation of the Outcome Measurement Questionnaire

Optimal Design and Purposeful Sampling: Complementary Methodologies for Implementation Research

Integrating Science and Engineering to Implement Evidence-Based Practices in Health Care Settings

Long-Term Clinical Outcomes from a Randomized Controlled Trial of Two Implementation Strategies to Promote Collaborative Care Attendance in Community Practices

Special Issue Overview: Optimizing Mixed Methods for Implementation Research in Large Systems

Approaches to Mixed Methods Dissemination and Implementation Research: Methods, Strengths, Caveats, and Opportunities