Top

Administration and Policy in Mental Health and Mental Health Services Research

Published in:

Open Access 01-11-2016 | Original Paper

Participatory System Dynamics Modeling: Increasing Stakeholder Engagement and Precision to Improve Implementation Planning in Systems

Authors: Lindsey Zimmerman, David W. Lounsbury, Craig S. Rosen, Rachel Kimerling, Jodie A. Trafton, Steven E. Lindley

Published in: Administration and Policy in Mental Health and Mental Health Services Research | Issue 6/2016

Abstract

Implementation planning typically incorporates stakeholder input. Quality improvement efforts provide data-based feedback regarding progress. Participatory system dynamics modeling (PSD) triangulates stakeholder expertise, data and simulation of implementation plans prior to attempting change. Frontline staff in one VA outpatient mental health system used PSD to examine policy and procedural “mechanisms” they believe underlie local capacity to implement evidence-based psychotherapies (EBPs) for PTSD and depression. We piloted the PSD process, simulating implementation plans to improve EBP reach. Findings indicate PSD is a feasible, useful strategy for building stakeholder consensus, and may save time and effort as compared to trial-and-error EBP implementation planning.

Aarons, G. A., Ehrhart, M. G., & Farahnak, L. R. (2014). The implementation leadership scale (ILS): Development of a brief measure of unit level implementation leadership. Implementation Science, 9(1), 45. doi:https://doi.org/10.1007/s10488-010-0327-7 CrossRefPubMedPubMedCentral

Aarons, G. A., Hurlburt, M., & Horwitz, S. M. (2011). Advancing a conceptual model of evidence-based practice implementation in public services sectors. Administrative Policy Mental Health Services Research, 38, 4–23. doi:https://doi.org/10.1186/1748-5908-9-45 CrossRef

Bendoly, E. (2014). System dynamics understanding in projects: Information sharing, psychological safety, and performance effects. Production and Operations Management, 23(8), 1352–1369. doi:https://doi.org/10.1111/poms.12024 CrossRef

Caro, J. J., Briggs, A. H., Siebert, U., & Kuntz, K. M. (2012). Modeling good research practices—overview: A report of the ISPOR-SMDM modeling good research practices task force-1. Value in Health, 15, 796–803. doi:https://doi.org/10.1016/j.jval.2012.06.012 CrossRefPubMed

Centers for Medicare & Medicaid Services Alliance to Modernize Healthcare (CAMH). (2015). Independent Assessment of the Health Care Delivery Systems and Management Processes of the Department of Veterans Affairs (Volume 1: Integrated Report). Retrieved October, 2015 from http://www.va.gov/opa/choiceact/documents/assessments/Integrated_Report.pdf

Chambers, D., Glasgow, R., & Stange, K. (2013). The dynamic sustainability framework: Addressing the paradox of sustainment amid ongoing change. Implementation Science, 8, 117. doi:https://doi.org/10.1186/1748-5908-8-117 CrossRefPubMedPubMedCentral

Chard, K. M., Ricksecker, E. G., Healy, E. T., Karlin, B. E., & Resick, P. A. (2012). Dissemination and experience with cognitive processing therapy. Journal of Rehabilitation Research and Development, 49, 667–678. doi:https://doi.org/10.1682/JRRD.2011.10.0198 CrossRefPubMed

Cook, J. M., O’Donnell, C., Dinnen, S., Bernardy, N., Rosenheck, R., & Hoff, R. (2013). A formative evaluation of two evidence-based psychotherapies for PTSD in VA residential treatment programs. Journal of Traumatic Stress, 26, 56–63. doi:https://doi.org/10.1002/jts.21769 CrossRefPubMedPubMedCentral

Damschroder, L., Aron, D., Keith, R., Kirsh, S., Alexander, J., & Lowery, J. (2009). Fostering implementation of health services research findings into practice: A consolidated framework for advancing implementation science. Implementation Science, 4(1), 50. doi:https://doi.org/10.1186/1748-5908-4-50 CrossRefPubMedPubMedCentral

Damschroder, L. & Lowery, J. (2015). Efficient synthesis: Using qualitative comparative analysis (QCA) and the CFIR across diverse studies. Plenary presentation at the 2015 Society for Implementation Research Collaboration, Seattle, WA.

DelliFraine, J. L., Langabeer, J. R., & Nembhard, I. M. (2010). Assessing the evidence of Six Sigma and Lean in the health care industry. Quality Management in Healthcare, 19(3), 211–225. doi:https://doi.org/10.1097/QMH.0b013e3181eb140e CrossRef

Department of Veterans Affairs. (2008). Uniform mental health services in VA medical centers and clinics. In Veterans Health Administration (Ed.), VHA handbook 260.01. Washington, DC.

Department of Veterans Affairs. (2014). VA mental health services: public report. Retrieved November, 2014 from http://www.mentalhealth.va.gov/docs/Mental_Health_Transparency_Report_11-24-14.pdf

Department of Veterans Affairs and Department of Defense. (2009a). The management of MDD working group. VA/DOD clinical practice guideline for management of major depressive disorder (MDD). Retrieved from http://www.healthquality.va.gov/guidelines/MH/mdd/MDDFULL053013.pdf

Department of Veterans Affairs and Department of Defense. (2009b). VA/DoD clinical practice guideline for the management of substance use disorders. Retrieved from http://www.healthquality.va.gov/guidelines/MH/sud/sud_full_601f.pdf

Department of Veterans Affairs and Department of Defense. (2010). VA/DoD clinical practice guideline for the management of post-traumatic stress. Retrieved from http://www.healthquality.va.gov/guidelines/MH/ptsd/cpgPTSDFULL201011612c.pdf

Derickson, R., Fishman, J., Osatuke, K., Teclaw, R., & Ramsel, D. (2015). Psychological safety and error reporting within veterans health administration hospitals. Journal of Patient Safety, 11(1), 60–66. doi:https://doi.org/10.1097/PTS.0000000000000082 CrossRefPubMed

Doty, D. H., Glick, W. H., & Huber, G. P. (1993). Fit, equifinality, and organizational effectiveness: a test of two configurational theories. Academy of Management Journal, 36(6), 1196–1250. doi:https://doi.org/10.2307/256810 CrossRef

Eftekhari, A., Ruzek, J. I., Crowley, J. J., Rosen, C. S., Greenbaum, M. A., & Karlin, B. E. (2013). Effectiveness of national implementation of prolonged exposure therapy in Veterans Affairs care. JAMA Psychiatry, 70, 49–955.CrossRef

Elbogen, E. B., Wagner, H. R., Johnson, S. C., Kinneer, P., Kang, H., Vasterling, J. J., et al. (2013). Are Iraq and Afghanistan veterans using mental health services? New data from a national random-sample survey. Psychiatric Services, 64, 134–141. doi:https://doi.org/10.1176/appi.ps.004792011 CrossRefPubMed

Finley, E. P., Garcia, H. A., Ketchum, N. S., McGeary, D. D., McGeary, C. A., Stirman, S. W., et al. (2015). Utilization of evidence-based psychotherapies in Veterans Affairs posttraumatic stress disorder outpatient clinics. Psychological services, 12(1), 73. doi:https://doi.org/10.1037/ser0000014 CrossRefPubMed

Flaspohler, P., Stillman, L., Duffy, J. L., Wandersman, A., & Maras, M. (2008). Unpacking capacity: The intersection of research to practice and community centered models. American Journal of Community Psychology, 41(3–4), 182–196. doi:https://doi.org/10.1007/s10464-008-9162-3 CrossRefPubMed

Forrester, J. W. (1985). The model versus a modeling process. System Dynamics Review, 1, 133–134. doi:https://doi.org/10.1002/sdr.4260010112 CrossRef

Forrester, J. W. (1961). Industrial Dynamics. Cambridge: MIT Press.

Garcia, H. A., McGeary, C. A., Finley, E. P., Ketchum, N. S., McGeary, D. D., & Peterson, A. L. (2015). Burnout among psychiatrists in the Veterans Health Administration. Burnout Research, 2(4), 108–114. doi:https://doi.org/10.1016/j.burn.2015.10.001 CrossRef

Glasgow, R. E., Vinson, C., Chambers, D., Khoury, M. J., Kaplan, R. M., & Hunter, C. (2012). National Institutes of Health approaches to dissemination and implementation science: Current and future directions. American Journal of Public Health, 102(7), 1274–1281. doi:https://doi.org/10.2105/AJPH.2012.300755 CrossRefPubMedPubMedCentral

Glasser, S., Ellis, W., Chin, J., Glazner, C. & Kane, V. (2014). A model for eliminating veteran homelessness in the USA. Presentation at the 32nd International Conference of the System Dynamics Society, Delft, The Netherlands.

Harris, A. H., Humphreys, K., Bowe, T., Kivlahan, D. R., & Finney, J. W. (2009). Measuring the quality of substance use disorder treatment: Evaluating the validity of the Department of Veterans Affairs continuity of care performance measure. Journal of Substance Abuse Treatment, 36(3), 294–305. doi:https://doi.org/10.1016/j.jsat.2008.05.011 CrossRefPubMed

Hermes, E. D., Hoff, R., & Rosenheck, R. A. (2014). Sources of the increasing number of Vietnam era veterans with a diagnosis of PTSD using VHA services. Psychiatric Services, 65(6), 830–832. doi:https://doi.org/10.1176/appi.ps.201300232 CrossRefPubMed

Homer, J., Jones, A., Seville, D., Essien, J., Milstein, B., & Murphy, D. (2004). The CDC’s diabetes systems modeling project: developing a new tool for chronic disease prevention and control. In 22nd International Conference of the System Dynamics Society (pp. 25–29). Retrieved from http://www.donellameadows.org/wp-content/userfiles/Diabetes_SystemISDC041.pdf.

Hovmand, P. (2014). Community-based system dynamics modeling. New York: Springer.CrossRef

Karlin, B. E., Brown, G. K., Trockel, M., Cunning, D., Zeiss, A. M., & Taylor, C. B. (2012). National dissemination of cognitive behavioral therapy for depression in the Department of Veterans Affairs health care system: therapist and patient-level outcomes. Journal of Consulting and Clinical Psychology, 80, 707–718. doi:https://doi.org/10.1037/a0029328 CrossRefPubMed

Karlin, B., & Cross, G. (2014). From the laboratory to the therapy room: National dissemination and implementation of evidence-based psychotherapies in the U.S. Department of Veterans Affairs Health Care System. American Psychologist, 69(1), 19–33. doi:https://doi.org/10.1037/a0033888 CrossRef

Köpetz, C., Faber, T., Fishbach, A., & Kruglanski, A. W. (2011). The multifinality constraints effect: How goal multiplicity narrows the means set to a focal end. Journal of Personality and Social Psychology, 100(5), 810–826. doi:https://doi.org/10.1037/a0022980 CrossRefPubMed

Lich, K. H., Tian, Y., Beadles, C. A., Williams, L. S., Bravata, D. M., Cheng, E. M., et al. (2014). Strategic planning to reduce the burden of stroke among Veterans using simulation modeling to inform decision-making. Stroke, 45, 2078–2084. doi:https://doi.org/10.1161/STROKEAHA.114.004694 CrossRefPubMedPubMedCentral

Luke, D. A., & Stamatakis, K. A. (2012). Systems science methods in public health: Dynamics, networks, and agents. Annual Review of Public Health, 33, 357–376. doi:https://doi.org/10.1146/annurev-publhealth-031210-101222 CrossRefPubMedPubMedCentral

Lyon, A. R., Maras, M. A., Pate, C. M., Igusa, T., & Vander Stoep, A. (2015). Modeling the impact of school-based universal depression screening on additional service capacity needs: A system dynamics approach. Administration and Policy in Mental Health and Mental Health Services Research,. doi:https://doi.org/10.1007/s10488-015-0628-y CrossRefPubMed

Mabry, P. (2014). Simulation as a tool to inform health policy. Part 1: Introduction to health systems simulations for policy. Academy Health Webinar.

Mabry, P. L., Milstein, B., Abraido-Lanza, A. F., Livingood, W. C., & Allegrante, J. P. (2013). Opening on window on systems science research in health promotion and public health. Health Education & Behavior, 40, 5S–8S. doi:https://doi.org/10.1177/1090198113503343 CrossRef

Martinez-Moyana, I. J., & Richardson, G. P. (2013). Best practices in system dynamics modeling. System Dynamics Review, 29, 102–123. doi:https://doi.org/10.1002/sdr.1495 CrossRef

Masnick, K., & McDonnell, G. (2010). A model linking clinical workforce skill mix planning to health and health care dynamics. Human Resources for Health, 8(1), 1. doi:https://doi.org/10.1186/1478-4491-8-11 CrossRef

Mazzocato, P., Savage, C., Brommels, M., Aronsson, H., & Thor, J. (2010). Lean thinking in healthcare: A realist review of the literature. Quality and Safety in Health Care, 19(5), 376–382. doi:https://doi.org/10.1136/qshc.2009.037986 CrossRefPubMed

Meadows, D. H., & Robinson, J. M. (1985). The Electronic Oracle: Computer models and social decisions. NewYork: Wiley.

Meadows, D. H., & Wright, D. (2008). Thinking in systems: A primer. White River Junction: Chelsea Green Publishing.

Morecroft, J., & Sterman, J. (1994). Modeling for learning organizations. Portland, OR: Productivity Press.

Mott, J., Hundt, N., Sansgiry, S., Mignogna, J., & Cully, J. (2014). Changes in psychotherapy utilization among veterans with depression, anxiety, and PTSD. Psychiatric Services, 65(1), 106–112. doi:https://doi.org/10.1176/appi.ps.201300056 CrossRefPubMed

Powell, B. J., McMillen, J. C., Proctor, E. K., Carpenter, C. R., Griffey, R. T., Bunger, A. C., et al. (2012). A compilation of strategies for implementing clinical innovations in health and mental health. Medical Care Research and Review, 69(2), 123–157. doi:https://doi.org/10.1177/1077558711430690 CrossRefPubMed

Proctor, E. K., Powell, B. J., Baumann, A. A., Hamilton, A. M., & Santens, R. L. (2012). Writing implementation research grant proposals: Ten key ingredients. Implement Science, 7(1), 96. doi:https://doi.org/10.1186/1748-5908-7-96 CrossRef

Proctor, E., Silmere, H., Raghavan, R., Hovmand, P., Aarons, G., Bunger, A., et al. (2011). Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda. Administration and Policy In Mental Health, 38(2), 65–76. doi:https://doi.org/10.1007/s10488-010-0319-7 CrossRefPubMed

Rahmandad, H., Repenning, N., & Sterman, J. (2009). Effects of feedback delay on learning. System Dynamics Review, 25, 309–338. doi:https://doi.org/10.1002/sdr.427 CrossRef

Richardson, G. P., & Pugh, A. L. (1981). Introduction to system dynamics modeling with dynamo. Cambridge: MIT Press.

Rogers, E. M. (2003). Diffusion of innovations. New York: Free Press.

Ruzek, J., Karlin, B. E., & Zeiss, A. (2012). Implementation of evidence-based psychological treatments in the veterans health administration. In R. K. McHugh & D. H. Barlow (Eds.), Dissemination of evidence-based psychological treatments. New York: Oxford University Press.

Rycroft-Malone, J. (2004). The PARIHS framework—a framework for guiding the implementation of evidence-based practice. Journal of Nursing Care Quality, 19(4), 297–304.CrossRefPubMed

Rycroft-Malone, J., Kitson, A., Harvey, G., McCormack, B., Seers, K., Titchen, A., et al. (2002). Ingredients for change: Revisiting a conceptual framework. Quality and Safety in Health Care, 11(2), 174–180. doi:https://doi.org/10.1136/qhc.11.2.174 CrossRefPubMedPubMedCentral

Scaccia, J. P., Cook, B. S., Lamont, A., Wandersman, A., Castellow, J., Katz, J., et al. (2015). A practical implementation science heuristic for organizational readiness: R = MC2. Journal of Community Psychology, 43(4), 484–501. doi:https://doi.org/10.1002/jcop.21698 CrossRefPubMedPubMedCentral

Senge, P. M. (2006). The fifth discipline: The art and practice of the learning organization. Vancouver, BC: Broadway Business.

Shiner, B., D’Avolio, L. W., Nguyen, T. M., Zayed, M. H., Young-Xu, Y., Desai, R. A., et al. (2013). Measuring use of evidence based psychotherapy for posttraumatic stress disorder. Administration and Policy in Mental Health and Mental Health Services Research, 40(4), 311–318. doi:https://doi.org/10.1007/s10488-012-0421-0 CrossRefPubMed

Simon, H. (1991). Bounded rationality and organizational learning. Organization Science, 2(1), 125–134. doi:https://doi.org/10.1287/orsc.2.1.125 CrossRef

Sterman, J. (1994). Learning in and about complex systems. System Dynamics Review, 10, 291–330. doi:https://doi.org/10.1002/sdr.4260100214 CrossRef

Sterman, J. D. (2000). Business dynamics: Systems thinking and modeling for a complex world (Vol. 19). Boston: Irwin/McGraw-Hill.

Sterman, J. D. (2006). Learning from evidence in a complex world. American Journal of Public Health, 6, 505–514. doi:https://doi.org/10.2105/AJPH.2005.066043 CrossRef

Stetler, C., Legro, M., Rycroft-Malone, J., Bowman, C., Curran, G., Guihan, M., et al. (2006). Role of “external facilitation” in implementation of research findings: A qualitative evaluation of facilitation experiences in the Veterans Health Administration. Implementation Science, 1, 23. doi:https://doi.org/10.1186/1748-5908-1-23 CrossRefPubMedPubMedCentral

System Dynamics Review. Hoboken: John Wiley & Sons, Inc. Retrieved from http://onlinelibrary.wiley.com/journal/10.1002/(ISSN)1099-1727

U.S. Department of Housing and Urban Development. (2014). The 2014 Annual Homeless Assessment Report (AHAR) to congress: PART 1 point-in-time estimates of homelessness. Retrieved October 1, 2015 from https://www.hudexchange.info/resources/documents/2014-AHAR-Part1.pdf

U.S. Interagency Council on Homelessness. (2013). Ending homelessness among veterans: A report by the United States interagency council on homelessness. Retrieved October, 2015 from http://usich.gov/resources/uploads/asset_library/USICH_Ending_Homelessness_Among_Veterans_Rpt_February_2013_FINAL.pdf

Vennix, J. (1996). Group model building: facilitating team learning using system dynamics. Chichester: Wiley.

Ventana Systems, Inc. (2014). Vensim^® Version 6.3.

Vest, J. R., & Gamm, L. D. (2009). A critical review of the research literature on Six Sigma, Lean and StuderGroup’s Hardwiring Excellence in the United States: the need to demonstrate and communicate the effectiveness of transformation strategies in healthcare. Implementation Science, 4(1), 35. doi:https://doi.org/10.1186/1748-5908-4-35 CrossRefPubMedPubMedCentral

Warren, K. (2004). Why has feedback systems thinking struggled to influence strategy and policy formulation? Suggestive evidence, explanations and solutions. Systems Research and Behavioral Science, 21(4), 331–347. doi:https://doi.org/10.1002/sres.651 CrossRef

Warren, K. (2005). Improving strategic management with the fundamental principles of system dynamics. System Dynamics Review, 21(4), 329–350. doi:https://doi.org/10.1002/sdr.325 CrossRef

Watts, B. V., Shiner, B., Zubkoff, L., Carpenter-Song, E., Ronconi, J. M., & Coldwell, C. M. (2014). Implementation of evidence-based psychotherapies for posttraumatic stress disorder in VA specialty clinics. Psychiatric Services, 65, 648–653. doi:https://doi.org/10.1176/appi.ps.201300176 CrossRefPubMed

Weiner, B. J. (2009). A theory of organizational readiness for change. Implementation Science, 4, 67. doi:https://doi.org/10.1186/1748-5908-4-67 CrossRefPubMedPubMedCentral

Yanchus, N. J., Periard, D., Moore, S. C., Carle, A. C., & Osatuke, K. (2015). Predictors of job satisfaction and turnover intention in VHA mental health employees: A comparison between psychiatrists, psychologists, social workers, and mental health nurses. Human Service Organizations: Management, Leadership & Governance, 39(3), 219–244. doi:https://doi.org/10.1080/23303131.2015.1014953 CrossRef

Title: Participatory System Dynamics Modeling: Increasing Stakeholder Engagement and Precision to Improve Implementation Planning in Systems
Authors: Lindsey Zimmerman
David W. Lounsbury
Craig S. Rosen
Rachel Kimerling
Jodie A. Trafton
Steven E. Lindley
Publication date: 01-11-2016
Publisher: Springer US
Published in: Administration and Policy in Mental Health and Mental Health Services Research / Issue 6/2016
Print ISSN: 0894-587X
Electronic ISSN: 1573-3289
DOI: https://doi.org/10.1007/s10488-016-0754-1

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Participatory System Dynamics Modeling: Increasing Stakeholder Engagement and Precision to Improve Implementation Planning in Systems

Abstract

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Abstract

Please log in to get access to this content

Other articles of this Issue 6/2016

A Review of Studies on the System-Wide Implementation of Evidence-Based Psychotherapies for Posttraumatic Stress Disorder in the Veterans Health Administration

What Predicts Clinician Dropout from State-Sponsored Managing and Adapting Practice Training

Evidence-Based Program Service Deserts: A Geographic Information Systems (GIS) Approach to Identifying Service Gaps for State-Level Implementation Planning

Applying the Policy Ecology Framework to Philadelphia’s Behavioral Health Transformation Efforts

A Multi-Level Examination of Stakeholder Perspectives of Implementation of Evidence-Based Practices in a Large Urban Publicly-Funded Mental Health System

System-Wide Implementation of Routine Outcome Monitoring and Measurement Feedback System in a National Network of Operational Stress Injury Clinics