Skip to main content
Top
Published in: Administration and Policy in Mental Health and Mental Health Services Research 5/2015

01-09-2015 | Original Paper

Approaches to Mixed Methods Dissemination and Implementation Research: Methods, Strengths, Caveats, and Opportunities

Authors: Carla A. Green, Naihua Duan, Robert D. Gibbons, Kimberly E. Hoagwood, Lawrence A. Palinkas, Jennifer P. Wisdom

Published in: Administration and Policy in Mental Health and Mental Health Services Research | Issue 5/2015

Login to get access

Abstract

Limited translation of research into practice has prompted study of diffusion and implementation, and development of effective methods of encouraging adoption, dissemination and implementation. Mixed methods techniques offer approaches for assessing and addressing processes affecting implementation of evidence-based interventions. We describe common mixed methods approaches used in dissemination and implementation research, discuss strengths and limitations of mixed methods approaches to data collection, and suggest promising methods not yet widely used in implementation research. We review qualitative, quantitative, and hybrid approaches to mixed methods dissemination and implementation studies, and describe methods for integrating multiple methods to increase depth of understanding while improving reliability and validity of findings.
Footnotes
1
For analyzing and reporting qualitative and mixed methods data, see Miles and Huberman (1994), Creswell (1998), Creswell and Plano Clark (2007), Denzin and Lincoln (1998, 2005), Bernard (2011), and Bourgeault et al. (2010). For focus group interviews, see Morgan and Krueger (1998). Those interested in grounded theory and constant comparative analyses should refer to: (Charmaz 2001, 2006; Creswell 1998; Glaser and Strauss 1967). See (Hsieh and Shannon 2005; Krippendorff 2004) for detailed explanations of content analysis. For discussions of rigor and threats to validity in qualitative research, including of reliability, validity, and trustworthiness, see (Davies and Dodd 2002; Krefting 1991; Morse et al. 2002; Poland 1995; Whittemore et al. 2001).
 
Literature
go back to reference Aarons, G. A., Miller, E. A., Green, A. E., Perrott, J. A., & Bradway, R. (2012). Adaptation happens: A qualitative case study of implementation of the incredible years evidence-based parent training programme in a residential substance abuse treatment programme. Journal of Children’s Services, 7(4), 233–245.CrossRef Aarons, G. A., Miller, E. A., Green, A. E., Perrott, J. A., & Bradway, R. (2012). Adaptation happens: A qualitative case study of implementation of the incredible years evidence-based parent training programme in a residential substance abuse treatment programme. Journal of Children’s Services, 7(4), 233–245.CrossRef
go back to reference Adler, P. A., & Adler, P. (1998). Observational techniques. In N. K. Denzin & Y. S. Lincoln (Eds.), Collecting and interpreting qualitative materials (pp. 79–109). Thousand Oaks: Sage Publications. Adler, P. A., & Adler, P. (1998). Observational techniques. In N. K. Denzin & Y. S. Lincoln (Eds.), Collecting and interpreting qualitative materials (pp. 79–109). Thousand Oaks: Sage Publications.
go back to reference Angrist, J. D., Imbens, G. W., & Rubin, D. B. (1996). Identification of causal e!ects using instrumental variable. Journal of the American Statistical Association, 91, 444–455.CrossRef Angrist, J. D., Imbens, G. W., & Rubin, D. B. (1996). Identification of causal e!ects using instrumental variable. Journal of the American Statistical Association, 91, 444–455.CrossRef
go back to reference Angrosino, M. V. (2005). Recontextualizing observation: Ethnography, pedagogy, adn the prospects for a progressive political agenda. In N. K. Denzin & Y. S. Lincoln (Eds.), Handbook of qualitative research (3rd ed., pp. 729–745). Thousand Oaks: Sage Publications. Angrosino, M. V. (2005). Recontextualizing observation: Ethnography, pedagogy, adn the prospects for a progressive political agenda. In N. K. Denzin & Y. S. Lincoln (Eds.), Handbook of qualitative research (3rd ed., pp. 729–745). Thousand Oaks: Sage Publications.
go back to reference Babbie, E. (1990). Survey research methods (2nd ed.). Belmont: Wadsworth. Babbie, E. (1990). Survey research methods (2nd ed.). Belmont: Wadsworth.
go back to reference Beatty, P. C., & Willis, G. B. (2007). Research synthesis: The practice of cognitive interviewing. Public Opinion Quarterly, 71(2), 287–311.CrossRef Beatty, P. C., & Willis, G. B. (2007). Research synthesis: The practice of cognitive interviewing. Public Opinion Quarterly, 71(2), 287–311.CrossRef
go back to reference Beebe, J. (2001). Rapid assessment process: An introduction. Lanham: AltaMira Press. Beebe, J. (2001). Rapid assessment process: An introduction. Lanham: AltaMira Press.
go back to reference Bernard, H. R. (2002). Research methods in anthropology: Qualitative and quantitative approaches. Walnut Creek: Alta Mira Press. Bernard, H. R. (2002). Research methods in anthropology: Qualitative and quantitative approaches. Walnut Creek: Alta Mira Press.
go back to reference Bernard, H. R. (2011). Research methods in anthropology: Qualitative and quantitative approaches (5th ed.). Lanham: AltaMira Press. Bernard, H. R. (2011). Research methods in anthropology: Qualitative and quantitative approaches (5th ed.). Lanham: AltaMira Press.
go back to reference Blankertz, L. (1998). The value and practicality of deliberate sampling for heterogeneity: A critical multiplist perspective. American Journal of Evaluation, 19(3), 307–324.CrossRef Blankertz, L. (1998). The value and practicality of deliberate sampling for heterogeneity: A critical multiplist perspective. American Journal of Evaluation, 19(3), 307–324.CrossRef
go back to reference Bourgeault, I., Dingwall, R., & de Vries, R. (2010). Handbook of qualitative methods in health research. Los Angeles: Sage Publications. Bourgeault, I., Dingwall, R., & de Vries, R. (2010). Handbook of qualitative methods in health research. Los Angeles: Sage Publications.
go back to reference Caronna, C. A. (2010). Why use qualitative methods to study health care organizations? Insights from multi-level case studies. In I. Bourgeault, R. Dingwall, & R. de Vries (Eds.), Handbook of qualitative methods in health research (pp. 71–87). Los Angeles: Sage Publications.CrossRef Caronna, C. A. (2010). Why use qualitative methods to study health care organizations? Insights from multi-level case studies. In I. Bourgeault, R. Dingwall, & R. de Vries (Eds.), Handbook of qualitative methods in health research (pp. 71–87). Los Angeles: Sage Publications.CrossRef
go back to reference Charmaz, K. (2001). Qualitative interviewing and grounded theory analysis. In J. F. Gubrium & S. Hutchinson (Eds.), Handbook of interview research (pp. 675–694). Thousand Oaks: Sage Publications.CrossRef Charmaz, K. (2001). Qualitative interviewing and grounded theory analysis. In J. F. Gubrium & S. Hutchinson (Eds.), Handbook of interview research (pp. 675–694). Thousand Oaks: Sage Publications.CrossRef
go back to reference Charmaz, K. (2006). Constructing grounded theory. Thousand Oaks: Sage Publications Inc. Charmaz, K. (2006). Constructing grounded theory. Thousand Oaks: Sage Publications Inc.
go back to reference Chase, S. E. (2005). Narrative inquiry: Multiple lenses, approaches, voices. In N. K. Denzin & Y. S. Lincoln (Eds.), Handbook of qualitative research (3rd ed., pp. 651–679). Thousand Oaks: Sage Publications. Chase, S. E. (2005). Narrative inquiry: Multiple lenses, approaches, voices. In N. K. Denzin & Y. S. Lincoln (Eds.), Handbook of qualitative research (3rd ed., pp. 651–679). Thousand Oaks: Sage Publications.
go back to reference Cook, T. D., & Campbell, D. T. (1979). Quasi-experimentation : Design & analysis issues for field settings. Boston: Houghton Mifflin. Cook, T. D., & Campbell, D. T. (1979). Quasi-experimentation : Design & analysis issues for field settings. Boston: Houghton Mifflin.
go back to reference Corsaro, W. A., & Heise, D. R. (1990). Event structure models from ethnographic data. In C. C. Clogg (Ed.), Sociological methodology: 1990 (pp. 1–57). Cambridge: Basil Blackwell. Corsaro, W. A., & Heise, D. R. (1990). Event structure models from ethnographic data. In C. C. Clogg (Ed.), Sociological methodology: 1990 (pp. 1–57). Cambridge: Basil Blackwell.
go back to reference Couper, M. P. (2008). Designing effective web surveys. Cambridge: Cambridge University Press.CrossRef Couper, M. P. (2008). Designing effective web surveys. Cambridge: Cambridge University Press.CrossRef
go back to reference Couper, M. P., Baker, R., Bethlehem, J., Clark, C., Martin, J., Nicholls, W. I., et al. (1998). Computer-assisted survey information collection. New York: John Wiley. Couper, M. P., Baker, R., Bethlehem, J., Clark, C., Martin, J., Nicholls, W. I., et al. (1998). Computer-assisted survey information collection. New York: John Wiley.
go back to reference Creswell, J. W. (1998). Qualitative inquiry and research design: Choosing among five traditions. Thousand Oaks: Sage Publications. Creswell, J. W. (1998). Qualitative inquiry and research design: Choosing among five traditions. Thousand Oaks: Sage Publications.
go back to reference Creswell, J. W., & Plano Clark, V. L. (2007). Designing and conducting mixed methods research. Thousand Oaks: Sage Publications Inc. Creswell, J. W., & Plano Clark, V. L. (2007). Designing and conducting mixed methods research. Thousand Oaks: Sage Publications Inc.
go back to reference Davies, D., & Dodd, J. (2002). Qualitative research and the question of rigor. Qualitative Health Research, 12(2), 279–289.PubMedCrossRef Davies, D., & Dodd, J. (2002). Qualitative research and the question of rigor. Qualitative Health Research, 12(2), 279–289.PubMedCrossRef
go back to reference de Leeuw, E. D. (2005). To mix or not to mix data collection modes in surveys. Journal of Official Statistics, 2, 233–255. de Leeuw, E. D. (2005). To mix or not to mix data collection modes in surveys. Journal of Official Statistics, 2, 233–255.
go back to reference Denzin, N. K., & Lincoln, Y. S. (1998). Collecting and interpreting qualitative materials. Thousand Oaks: Sage Publications. Denzin, N. K., & Lincoln, Y. S. (1998). Collecting and interpreting qualitative materials. Thousand Oaks: Sage Publications.
go back to reference Denzin, N. K., & Lincoln, Y. S. (2005). Handbook of qualitative research (3rd ed.). Thousand Oaks: Sage Publications. Denzin, N. K., & Lincoln, Y. S. (2005). Handbook of qualitative research (3rd ed.). Thousand Oaks: Sage Publications.
go back to reference Donner, A. (1998). Some aspects of the design and analysis of cluster randomization trials. Journal of the Royal Statistical Society: Series C (Applied Statistics), 47(1), 95–113.CrossRef Donner, A. (1998). Some aspects of the design and analysis of cluster randomization trials. Journal of the Royal Statistical Society: Series C (Applied Statistics), 47(1), 95–113.CrossRef
go back to reference Donner, A., & Klar, N. (1994). Cluster randomization trials in epidemiology: Theory and application. Journal of Statistical Planning and Inference, 42(1), 37–56.CrossRef Donner, A., & Klar, N. (1994). Cluster randomization trials in epidemiology: Theory and application. Journal of Statistical Planning and Inference, 42(1), 37–56.CrossRef
go back to reference Draucker, C. B., Martsolf, D. S., Ross, R., & Rusk, T. B. (2007). Theoretical sampling and category development in grounded theory. Qualitative Health Research, 17(8), 1137–1148.PubMedCrossRef Draucker, C. B., Martsolf, D. S., Ross, R., & Rusk, T. B. (2007). Theoretical sampling and category development in grounded theory. Qualitative Health Research, 17(8), 1137–1148.PubMedCrossRef
go back to reference Finkelstein, M. O., Levin, B., & Robbins, H. (1996a). Clinical and prophylactic trials with assured new treatment for those at greater risk: I. A design proposal. American Journal of Public Health, 86(5), 691–695.PubMedCentralPubMedCrossRef Finkelstein, M. O., Levin, B., & Robbins, H. (1996a). Clinical and prophylactic trials with assured new treatment for those at greater risk: I. A design proposal. American Journal of Public Health, 86(5), 691–695.PubMedCentralPubMedCrossRef
go back to reference Finkelstein, M. O., Levin, B., & Robbins, H. (1996b). Clinical and prophylactic trials with assured new treatment for those at greater risk: II. Examples. American Journal of Public Health, 86(5), 696–705.PubMedCentralPubMedCrossRef Finkelstein, M. O., Levin, B., & Robbins, H. (1996b). Clinical and prophylactic trials with assured new treatment for those at greater risk: II. Examples. American Journal of Public Health, 86(5), 696–705.PubMedCentralPubMedCrossRef
go back to reference Fisher, R. A. (1925). Statistical methods for research workers (14th ed.). Edinburgh: Oliver and Boyd. Fisher, R. A. (1925). Statistical methods for research workers (14th ed.). Edinburgh: Oliver and Boyd.
go back to reference Fowler, F. J. (2009). Survey research methods (4th ed.)., Applied social research methods series Thousand Oaks: Sage Publications. Fowler, F. J. (2009). Survey research methods (4th ed.)., Applied social research methods series Thousand Oaks: Sage Publications.
go back to reference Fowler, F. J, Jr, Gallagher, P. M., Stringfellow, V. L., Zaslavsky, A. M., Thompson, J. W., & Cleary, P. D. (2002). Using telephone interviews to reduce nonresponse bias to mail surveys of health plan members. Medical Care, 40(3), 190–200.PubMedCrossRef Fowler, F. J, Jr, Gallagher, P. M., Stringfellow, V. L., Zaslavsky, A. M., Thompson, J. W., & Cleary, P. D. (2002). Using telephone interviews to reduce nonresponse bias to mail surveys of health plan members. Medical Care, 40(3), 190–200.PubMedCrossRef
go back to reference Frankel, M. R., Shapiro, M. F., Duan, N., Morton, S. C., Berry, S. H., Brown, J. A., et al. (1999). National probability samples in studies of low-prevalence diseases. Part II: Designing and implementing the HIV cost and services utilization study sample. Health Services Research, 34(5 Pt 1), 969–992.PubMedCentralPubMed Frankel, M. R., Shapiro, M. F., Duan, N., Morton, S. C., Berry, S. H., Brown, J. A., et al. (1999). National probability samples in studies of low-prevalence diseases. Part II: Designing and implementing the HIV cost and services utilization study sample. Health Services Research, 34(5 Pt 1), 969–992.PubMedCentralPubMed
go back to reference Gibbons, R. D., Weiss, D. J., Pilkonis, P. A., Frank, E., Moore, T., Kim, J. B. et al. (2013). The CAT-DI: A computerized adaptive test for depression. Archives of General Psychiatry, in press. Gibbons, R. D., Weiss, D. J., Pilkonis, P. A., Frank, E., Moore, T., Kim, J. B. et al. (2013). The CAT-DI: A computerized adaptive test for depression. Archives of General Psychiatry, in press.
go back to reference Gilchrist, V. J., & Williams, R. L. (1999). Key informant interviews. In B. F. Crabtree & W. L. Miller (Eds.), Doing qualitative research (Second ed., pp. 71–88). Thousand Oaks: Sage Publications. Gilchrist, V. J., & Williams, R. L. (1999). Key informant interviews. In B. F. Crabtree & W. L. Miller (Eds.), Doing qualitative research (Second ed., pp. 71–88). Thousand Oaks: Sage Publications.
go back to reference Glaser, B. G., & Strauss, A. L. (1967). The discovery of grounded theory: Strategies for qualitative research. Chicago: Aldine Publishing Company. Glaser, B. G., & Strauss, A. L. (1967). The discovery of grounded theory: Strategies for qualitative research. Chicago: Aldine Publishing Company.
go back to reference Hotopf, M. (2002). The pragmatic randomised controlled trial. Advances in Psychiatric Treatment, 8(5), 326–333.CrossRef Hotopf, M. (2002). The pragmatic randomised controlled trial. Advances in Psychiatric Treatment, 8(5), 326–333.CrossRef
go back to reference Imbens, G. W., & Lemieux, T. (2008). Regression discontinuity designs: A guide to practice. Journal of Econometrics, 142(2), 615–635.CrossRef Imbens, G. W., & Lemieux, T. (2008). Regression discontinuity designs: A guide to practice. Journal of Econometrics, 142(2), 615–635.CrossRef
go back to reference Kamberelis, G., & Dimitriadis, G. (2005). Focus groups: Strategic Articulations of Pedagogy, Politics, and Inquiry. In N. K. Denzin & Y. S. Lincoln (Eds.), The sage handbook of qualitative research (3rd ed.). Thousand Oaks: Sage Publications Inc. Kamberelis, G., & Dimitriadis, G. (2005). Focus groups: Strategic Articulations of Pedagogy, Politics, and Inquiry. In N. K. Denzin & Y. S. Lincoln (Eds.), The sage handbook of qualitative research (3rd ed.). Thousand Oaks: Sage Publications Inc.
go back to reference Kish, L. (1995). Survey sampling. New York: Wiley Classics Library John Wiley and Sons Inc. Kish, L. (1995). Survey sampling. New York: Wiley Classics Library John Wiley and Sons Inc.
go back to reference Krefting, L. (1991). Rigor in qualitative research: The assessment of trustworthiness. American Journal of Occupational Therapy, 45(3), 214–222.PubMedCrossRef Krefting, L. (1991). Rigor in qualitative research: The assessment of trustworthiness. American Journal of Occupational Therapy, 45(3), 214–222.PubMedCrossRef
go back to reference Krippendorff, K. (2004). Content analysis: An introduction to methodology. Thousand Oaks: Sage Publications Inc. Krippendorff, K. (2004). Content analysis: An introduction to methodology. Thousand Oaks: Sage Publications Inc.
go back to reference Lee, D. S., & Lemieux, T. (2010). Regression discontinuity designs in economics. Journal of Economic Literature, 48(2), 281–355. Lee, D. S., & Lemieux, T. (2010). Regression discontinuity designs in economics. Journal of Economic Literature, 48(2), 281–355.
go back to reference Lensvelt-Mulders, G. J. L. M., Hox, J. J., van der Heijden, P. G. M., & Maas, C. J. M. (2005). Meta-analysis of randomized response research: Thirty-five years of validation. Sociological Methods and Research, 33(3), 319–348.CrossRef Lensvelt-Mulders, G. J. L. M., Hox, J. J., van der Heijden, P. G. M., & Maas, C. J. M. (2005). Meta-analysis of randomized response research: Thirty-five years of validation. Sociological Methods and Research, 33(3), 319–348.CrossRef
go back to reference Luce, B. R., Kramer, J. M., Goodman, S. N., Connor, J. T., Tunis, S., Whicher, D., et al. (2009). Rethinking randomized clinical trials for comparative effectiveness research: The need for transformational change. Annals of Internal Medicine, 151(3), 206–209.PubMedCrossRef Luce, B. R., Kramer, J. M., Goodman, S. N., Connor, J. T., Tunis, S., Whicher, D., et al. (2009). Rethinking randomized clinical trials for comparative effectiveness research: The need for transformational change. Annals of Internal Medicine, 151(3), 206–209.PubMedCrossRef
go back to reference Marsden, P. V., & Wright, J. D. (2010). Handbook of survey research (2nd ed.). Bingley: Emerald Group Publishing Limited. Marsden, P. V., & Wright, J. D. (2010). Handbook of survey research (2nd ed.). Bingley: Emerald Group Publishing Limited.
go back to reference McNall, M., & Foster-Fishman, P. G. (2007). Methods of rapid evaluation, assessment, and appraisal. American Journal of Evaluation, 28(2), 151–168.CrossRef McNall, M., & Foster-Fishman, P. G. (2007). Methods of rapid evaluation, assessment, and appraisal. American Journal of Evaluation, 28(2), 151–168.CrossRef
go back to reference Miles, M. B., & Huberman, A. M. (1994). Qualitative data analysis (2nd ed.). Thousand Oaks: Sage Publications. Miles, M. B., & Huberman, A. M. (1994). Qualitative data analysis (2nd ed.). Thousand Oaks: Sage Publications.
go back to reference Miller, W. L., & Crabtree, B. F. (1999). Depth interviewing. Doing qualitative research (pp. 123–201). Thousand Oaks: Sage Publications. Miller, W. L., & Crabtree, B. F. (1999). Depth interviewing. Doing qualitative research (pp. 123–201). Thousand Oaks: Sage Publications.
go back to reference Morgan, D. L. (1993). Successful focus groups: Advancing the state of the art. Newbury Park: Sage Publications. Morgan, D. L. (1993). Successful focus groups: Advancing the state of the art. Newbury Park: Sage Publications.
go back to reference Morgan, D. L., & Krueger, R. A. (1998). The focus group kit. Thousand Oaks: Sage Publications. Morgan, D. L., & Krueger, R. A. (1998). The focus group kit. Thousand Oaks: Sage Publications.
go back to reference Morse, J. M. (2000). Determining sample size. Qualitative Health Research, 10(1), 3–5.CrossRef Morse, J. M. (2000). Determining sample size. Qualitative Health Research, 10(1), 3–5.CrossRef
go back to reference Murray, D. M. (1998). Design and analysis of group-randomized trials (29th ed.). Oxford: Oxford University Press. Murray, D. M. (1998). Design and analysis of group-randomized trials (29th ed.). Oxford: Oxford University Press.
go back to reference Murray, S. A., Tapson, J., Turnbull, L., McCallum, J., & Little, A. (1994). Listening to local voices: Adapting rapid appraisal to assess health and social needs in general practice. BMJ, 308(6930), 698–700.PubMedCentralPubMedCrossRef Murray, S. A., Tapson, J., Turnbull, L., McCallum, J., & Little, A. (1994). Listening to local voices: Adapting rapid appraisal to assess health and social needs in general practice. BMJ, 308(6930), 698–700.PubMedCentralPubMedCrossRef
go back to reference Needle, R. H., Trotter, R. T., Singer, M., Bates, C., Page, J. B., Metzger, D., et al. (2003). Rapid assessment of the HIV/AIDS crisis in racial and ethnic minority communities: An approach for timely community interventions. American Journal of Public Health, 93(6), 970–979.PubMedCentralPubMedCrossRef Needle, R. H., Trotter, R. T., Singer, M., Bates, C., Page, J. B., Metzger, D., et al. (2003). Rapid assessment of the HIV/AIDS crisis in racial and ethnic minority communities: An approach for timely community interventions. American Journal of Public Health, 93(6), 970–979.PubMedCentralPubMedCrossRef
go back to reference Palinkas, L. A., Aarons, G. A., Horwitz, S., Chamberlain, P., Hurlburt, M., & Landsverk, J. (2011b). Mixed method designs in implementation research. Administration and Policy in Mental Health, 38(1), 44–53.PubMedCentralPubMedCrossRef Palinkas, L. A., Aarons, G. A., Horwitz, S., Chamberlain, P., Hurlburt, M., & Landsverk, J. (2011b). Mixed method designs in implementation research. Administration and Policy in Mental Health, 38(1), 44–53.PubMedCentralPubMedCrossRef
go back to reference Palinkas, L. A., Horwitz, S. M., Green, C. A., Wisdom, J. P., Duan, N., & Hoagwood, K. (2013). Purposeful sampling for qualitative data collection and analysis in mixed method implementation research. Administration and Policy in Mental Health Palinkas, L. A., Horwitz, S. M., Green, C. A., Wisdom, J. P., Duan, N., & Hoagwood, K. (2013). Purposeful sampling for qualitative data collection and analysis in mixed method implementation research. Administration and Policy in Mental Health
go back to reference Pentland, B. T. (1999). Building process theory with narrative: From description to explanation. Academy of Management Review, 24(4), 711-724. Pentland, B. T. (1999). Building process theory with narrative: From description to explanation. Academy of Management Review, 24(4), 711-724.
go back to reference Poland, B. D. (1995). Transcription quality as an aspect of rigor in qualitative research. Qualitative Inquiry, 1(3), 290–310.CrossRef Poland, B. D. (1995). Transcription quality as an aspect of rigor in qualitative research. Qualitative Inquiry, 1(3), 290–310.CrossRef
go back to reference Proctor, E. K., Landsverk, J., Aarons, G., Chambers, D., Glisson, C., & Mittman, B. (2009). Implementation research in mental health services: An emerging science with conceptual, methodological, and training challenges. Administration and Policy In Mental Health, 36(1), 24–34. doi:10.1007/s10488-008-0197-4.PubMedCrossRef Proctor, E. K., Landsverk, J., Aarons, G., Chambers, D., Glisson, C., & Mittman, B. (2009). Implementation research in mental health services: An emerging science with conceptual, methodological, and training challenges. Administration and Policy In Mental Health, 36(1), 24–34. doi:10.​1007/​s10488-008-0197-4.PubMedCrossRef
go back to reference Ragin, C. C. (1997). Turning the tables: How case-oriented research challenges variable-oriented research. Comparative Social Research, 16, 27–42. Ragin, C. C. (1997). Turning the tables: How case-oriented research challenges variable-oriented research. Comparative Social Research, 16, 27–42.
go back to reference Ragin, C. C. (1999a). The distinctiveness of case-oriented research. Health Services Research, 34(5 Pt 2), 1137–1151.PubMedCentralPubMed Ragin, C. C. (1999a). The distinctiveness of case-oriented research. Health Services Research, 34(5 Pt 2), 1137–1151.PubMedCentralPubMed
go back to reference Ragin, C. C. (1999b). Using qualitative comparative analysis to study causal complexity. Health Services Research, 34(5 Pt 2), 1225–1239.PubMedCentralPubMed Ragin, C. C. (1999b). Using qualitative comparative analysis to study causal complexity. Health Services Research, 34(5 Pt 2), 1225–1239.PubMedCentralPubMed
go back to reference Ragin, C. C., Shulman, D., Weinberg, A., & Gran, B. (2003). Complexity, generality, and qualitative comparative analysis. Field Methods, 15, 323–340.CrossRef Ragin, C. C., Shulman, D., Weinberg, A., & Gran, B. (2003). Complexity, generality, and qualitative comparative analysis. Field Methods, 15, 323–340.CrossRef
go back to reference Rosenbaum, P. R. (2002). Observational studies (2nd ed.). New York: Springer Science+Business Media.CrossRef Rosenbaum, P. R. (2002). Observational studies (2nd ed.). New York: Springer Science+Business Media.CrossRef
go back to reference Rosenbaum, P. R., & Rubin, D. B. (1983). The central role of the propensity score in observational studies for causal effects. Biometrika, 70(1), 41–55. Rosenbaum, P. R., & Rubin, D. B. (1983). The central role of the propensity score in observational studies for causal effects. Biometrika, 70(1), 41–55.
go back to reference Rosenbaum, P. R., & Rubin, D. B. (1984). Reducing bias in observational studies using subclassification on the propensity score. Journal of the American Statistical Association, 79(387), 516–524.CrossRef Rosenbaum, P. R., & Rubin, D. B. (1984). Reducing bias in observational studies using subclassification on the propensity score. Journal of the American Statistical Association, 79(387), 516–524.CrossRef
go back to reference Rossi, P. H., Wright, J. D., & Anderson, A. B. (1983). Handbook of survey research: Quantitative studies in social relations (First ed.). Waltham: Academic Press. Rossi, P. H., Wright, J. D., & Anderson, A. B. (1983). Handbook of survey research: Quantitative studies in social relations (First ed.). Waltham: Academic Press.
go back to reference Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Boston: Houghton Mifflin. Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Boston: Houghton Mifflin.
go back to reference Shiffman, S., Stone, A. A., & Hufford, M. R. (2008). Ecological momentary assessment. Annual Review of Clinical Psychology, 4, 1–32.PubMedCrossRef Shiffman, S., Stone, A. A., & Hufford, M. R. (2008). Ecological momentary assessment. Annual Review of Clinical Psychology, 4, 1–32.PubMedCrossRef
go back to reference Shortell, S. M. (1999). The emergence of qualitative methods in health services research. Health Services Research, 34(5 Pt 2), 1083–1090.PubMedCentralPubMed Shortell, S. M. (1999). The emergence of qualitative methods in health services research. Health Services Research, 34(5 Pt 2), 1083–1090.PubMedCentralPubMed
go back to reference Stake, R. E. (2005). Qualitative case studies. In N. K. Denzin & Y. S. Lincoln (Eds.), Handbook of qualitative research (pp. 443–466). Thousand Oaks: Sage Publications. Stake, R. E. (2005). Qualitative case studies. In N. K. Denzin & Y. S. Lincoln (Eds.), Handbook of qualitative research (pp. 443–466). Thousand Oaks: Sage Publications.
go back to reference Stetler, C. B., Legro, M. W., Wallace, C. M., Bowman, C., Guihan, M., Hagedorn, H., et al. (2006). The role of formative evaluation in implementation research and the QUERI experience. Journal of General Internal Medicine, 21(Suppl 2), S1–S8.PubMedCentralPubMedCrossRef Stetler, C. B., Legro, M. W., Wallace, C. M., Bowman, C., Guihan, M., Hagedorn, H., et al. (2006). The role of formative evaluation in implementation research and the QUERI experience. Journal of General Internal Medicine, 21(Suppl 2), S1–S8.PubMedCentralPubMedCrossRef
go back to reference Stevenson, W. B., & Greenberg, D. N. (1998). The formal analysis of narratives of organizational change. Journal of Management, 24(6), 741–762. Stevenson, W. B., & Greenberg, D. N. (1998). The formal analysis of narratives of organizational change. Journal of Management, 24(6), 741–762.
go back to reference Strauss, A. L., & Corbin, J. (1998). Theoretical sampling. Basics of qualitative research: Techniques and procedures for developing grounded theory (pp. 201–215). Thousand Oaks: SAGE Publications Inc. Strauss, A. L., & Corbin, J. (1998). Theoretical sampling. Basics of qualitative research: Techniques and procedures for developing grounded theory (pp. 201–215). Thousand Oaks: SAGE Publications Inc.
go back to reference Thistlethwaite, D., & Campbell, D. (1960). Regression-discontinuity analysis: an alternative to the ex post facto experiment. Journal of Educational Psychology, 51, 309–317.CrossRef Thistlethwaite, D., & Campbell, D. (1960). Regression-discontinuity analysis: an alternative to the ex post facto experiment. Journal of Educational Psychology, 51, 309–317.CrossRef
go back to reference Thorpe, K. E., Zwarenstein, M., Oxman, A. D., Treweek, S., Furberg, C. D., Altman, D. G., et al. (2009). A pragmatic-explanatory continuum indicator summary (PRECIS): A tool to help trial designers. CMAJ: Canadian Medical Association Journal, 180(10), E47–E57.PubMedCentralPubMedCrossRef Thorpe, K. E., Zwarenstein, M., Oxman, A. D., Treweek, S., Furberg, C. D., Altman, D. G., et al. (2009). A pragmatic-explanatory continuum indicator summary (PRECIS): A tool to help trial designers. CMAJ: Canadian Medical Association Journal, 180(10), E47–E57.PubMedCentralPubMedCrossRef
go back to reference Torrey, W. C., Bond, G. R., McHugo, G. J., & Swain, K. (2012). Evidence-based practice implementation in community mental health settings: The relative importance of key domains of implementation activity. Administration and Policy In Mental Health, 39(5), 353–364. doi:10.1007/s10488-011-0357-9.PubMedCrossRef Torrey, W. C., Bond, G. R., McHugo, G. J., & Swain, K. (2012). Evidence-based practice implementation in community mental health settings: The relative importance of key domains of implementation activity. Administration and Policy In Mental Health, 39(5), 353–364. doi:10.​1007/​s10488-011-0357-9.PubMedCrossRef
go back to reference Tourangeau, R., & Smith, T. W. (1996). Asking sensitive questions: The impact of data collection mode, question format, and question context. Public Opinion Quarterly, 60(2), 275–304. Tourangeau, R., & Smith, T. W. (1996). Asking sensitive questions: The impact of data collection mode, question format, and question context. Public Opinion Quarterly, 60(2), 275–304.
go back to reference Trochim, W. M. (1989). Introduction to concept mapping for planning and evaluation. Evaluation and Program Planning, 12, 1–16.CrossRef Trochim, W. M. (1989). Introduction to concept mapping for planning and evaluation. Evaluation and Program Planning, 12, 1–16.CrossRef
go back to reference Trotter, R. T., Needle, R. H., Goosby, E., Bates, C., & Singer, M. (2001). A methodological model for rapid assessment, response, and evaluation: The RARE program in public health. Field Methods, 13(2), 137–159.CrossRef Trotter, R. T., Needle, R. H., Goosby, E., Bates, C., & Singer, M. (2001). A methodological model for rapid assessment, response, and evaluation: The RARE program in public health. Field Methods, 13(2), 137–159.CrossRef
go back to reference Trumpy, A. J. (2008). Subject to negotiation: The mechanisms behind co-optation and corporate reform. Social Problems, 55, 519–536.CrossRef Trumpy, A. J. (2008). Subject to negotiation: The mechanisms behind co-optation and corporate reform. Social Problems, 55, 519–536.CrossRef
go back to reference Tunis, S. R., Stryer, D. B., & Clancy, C. M. (2003). Practical clinical trials: Increasing the value of clinical research for decision making in clinical and health policy. The Journal of the American Medical Association, 290(12), 1624–1632.PubMedCrossRef Tunis, S. R., Stryer, D. B., & Clancy, C. M. (2003). Practical clinical trials: Increasing the value of clinical research for decision making in clinical and health policy. The Journal of the American Medical Association, 290(12), 1624–1632.PubMedCrossRef
go back to reference Weiss, D. J. (1985). Adaptive testing by computer. Journal of Consulting and Clinical Psychology, 53(6), 774–789.PubMedCrossRef Weiss, D. J. (1985). Adaptive testing by computer. Journal of Consulting and Clinical Psychology, 53(6), 774–789.PubMedCrossRef
go back to reference Weller, S. C., & Romeny, A. K. (1988). Systematic data collection (12th ed.). Newbury Park: Sage. Weller, S. C., & Romeny, A. K. (1988). Systematic data collection (12th ed.). Newbury Park: Sage.
go back to reference West, S. G., Duan, N., Pequegnat, W., Gaist, P., Des Jarlais, D. C., Holtgrave, D., et al. (2008). Alternatives to the randomized controlled trial. American Journal of Public Health, 98(8), 1359–1366.PubMedCentralPubMedCrossRef West, S. G., Duan, N., Pequegnat, W., Gaist, P., Des Jarlais, D. C., Holtgrave, D., et al. (2008). Alternatives to the randomized controlled trial. American Journal of Public Health, 98(8), 1359–1366.PubMedCentralPubMedCrossRef
go back to reference Whittemore, R., Chase, S. K., & Mandle, C. L. (2001). Validity in qualitative research. Qualitative Health Research, 11(4), 522–537.PubMedCrossRef Whittemore, R., Chase, S. K., & Mandle, C. L. (2001). Validity in qualitative research. Qualitative Health Research, 11(4), 522–537.PubMedCrossRef
go back to reference Yates, F. (1935). Complex experiments, with discussion. Supplement to the Journal of the Royal Statistical Society, Series B 2, 2(2), 181–247.CrossRef Yates, F. (1935). Complex experiments, with discussion. Supplement to the Journal of the Royal Statistical Society, Series B 2, 2(2), 181–247.CrossRef
go back to reference Yin, R. K. (1999). Enhancing the quality of case studies in health services research. Health Services Research, 34(5 Pt 2), 1209–1224.PubMedCentralPubMed Yin, R. K. (1999). Enhancing the quality of case studies in health services research. Health Services Research, 34(5 Pt 2), 1209–1224.PubMedCentralPubMed
go back to reference Yin, R. K. (2003a). Applications of case study research (2nd ed.)., Applied social research methods series Thousand Oaks: Sage Publications Inc. Yin, R. K. (2003a). Applications of case study research (2nd ed.)., Applied social research methods series Thousand Oaks: Sage Publications Inc.
go back to reference Yin, R. K. (2003b). Case study research: Design and methods (3rd ed.)., Applied social research methods series Thousand Oaks: Sage Publications. Yin, R. K. (2003b). Case study research: Design and methods (3rd ed.)., Applied social research methods series Thousand Oaks: Sage Publications.
Metadata
Title
Approaches to Mixed Methods Dissemination and Implementation Research: Methods, Strengths, Caveats, and Opportunities
Authors
Carla A. Green
Naihua Duan
Robert D. Gibbons
Kimberly E. Hoagwood
Lawrence A. Palinkas
Jennifer P. Wisdom
Publication date
01-09-2015
Publisher
Springer US
Published in
Administration and Policy in Mental Health and Mental Health Services Research / Issue 5/2015
Print ISSN: 0894-587X
Electronic ISSN: 1573-3289
DOI
https://doi.org/10.1007/s10488-014-0552-6

Other articles of this Issue 5/2015

Administration and Policy in Mental Health and Mental Health Services Research 5/2015 Go to the issue