Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2018

Open Access 01-12-2018 | Research article

Periodic reflections: a method of guided discussions for documenting implementation phenomena

Authors: Erin P. Finley, Alexis K. Huynh, Melissa M. Farmer, Bevanne Bean-Mayberry, Tannaz Moin, Sabine M. Oishi, Jessica L. Moreau, Karen E. Dyer, Holly Jordan Lanham, Luci Leykum, Alison B. Hamilton

Published in: BMC Medical Research Methodology | Issue 1/2018

Login to get access

Abstract

Background

Ethnography has been proposed as a valuable method for understanding how implementation occurs within dynamic healthcare contexts, yet this method can be time-intensive and challenging to operationalize in pragmatic implementation. The current study describes an ethnographically-informed method of guided discussions developed for use by a multi-project national implementation program.

Methods

The EMPOWER QUERI is conducting three projects to implement innovative care models in VA women’s health for high-priority health concerns – prediabetes, cardiovascular risk, and mental health – utilizing the Replicating Effective Programs (REP) implementation strategy enhanced with stakeholder engagement and complexity science. Drawing on tenets of ethnographic research, we developed a lightly-structured method of guided “periodic reflections” to aid in documenting implementation phenomena over time. Reflections are completed as 30–60 min telephone discussions with implementation team members at monthly or bi-monthly intervals, led by a member of the implementation core. Discussion notes are coded to reflect key domains of interest and emergent themes, and can be analyzed singly or in triangulation with other qualitative and quantitative assessments to inform evaluation and implementation activities.

Results

Thirty structured reflections were completed across the three projects during a 15-month period spanning pre-implementation, implementation, and sustainment activities. Reflections provide detailed, near-real-time information on projects’ dynamic implementation context, including characteristics of implementation settings and changes in the local or national environment, adaptations to the intervention and implementation plan, and implementation team sensemaking and learning. Reflections also provide an opportunity for implementation teams to engage in recurring reflection and problem-solving.

Conclusions

To implement new, complex interventions into dynamic organizations, we must better understand the implementation process as it unfolds in real time. Ethnography is well suited to this task, but few approaches exist to aid in integrating ethnographic insights into implementation research. Periodic reflections show potential as a straightforward and low-burden method for documenting events across the life cycle of an implementation effort.
They offer an effective means for capturing information on context, unfolding process and sensemaking, unexpected events, and diverse viewpoints, illustrating their value for use as part of an ethnographically-minded implementation approach.

Trial registration

The two implementation research studies described in this article have been registered as required: Facilitating Cardiovascular Risk Screening and Risk Reduction in Women Veterans (NCT02991534); and Implementation of Tailored Collaborative Care for Women Veterans (NCT02950961).
Literature
1.
go back to reference Schensul JJ. Community, culture and sustainability in multilevel dynamic systems intervention science. Am J Community Psychol. 2009;43:241–56.CrossRef Schensul JJ. Community, culture and sustainability in multilevel dynamic systems intervention science. Am J Community Psychol. 2009;43:241–56.CrossRef
5.
go back to reference Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337:a1655.CrossRef Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337:a1655.CrossRef
11.
14.
go back to reference Brewer J. Ethnography. Essent Guide Qual Methods Organ Res. SAGE Publications; 2004. p. 312–322. Brewer J. Ethnography. Essent Guide Qual Methods Organ Res. SAGE Publications; 2004. p. 312–322.
16.
go back to reference Geertz C. The interpretation of cultures: BasicBooks; 1973. Geertz C. The interpretation of cultures: BasicBooks; 1973.
19.
go back to reference Thirsk LM, Clark AM. Using qualitative research for complex interventions: the contributions of hermeneutics. Int J Qual Methods. 2017;16:160940691772106.CrossRef Thirsk LM, Clark AM. Using qualitative research for complex interventions: the contributions of hermeneutics. Int J Qual Methods. 2017;16:160940691772106.CrossRef
20.
go back to reference McCullough MB, Chou AF, Solomon JL, Petrakis BA, Kim B, Park AM, et al. The interplay of contextual elements in implementation: an ethnographic case study. BMC Health Serv Res. 2015;15:62.CrossRef McCullough MB, Chou AF, Solomon JL, Petrakis BA, Kim B, Park AM, et al. The interplay of contextual elements in implementation: an ethnographic case study. BMC Health Serv Res. 2015;15:62.CrossRef
21.
go back to reference Lanham HJ, Leykum LK, Taylor BS, McCannon CJ, Lindberg C, Lester RT. How complexity science can inform scale-up and spread in health care: understanding the role of self-organization in variation across local contexts. Soc Sci Med. 2013;93:194–202.CrossRef Lanham HJ, Leykum LK, Taylor BS, McCannon CJ, Lindberg C, Lester RT. How complexity science can inform scale-up and spread in health care: understanding the role of self-organization in variation across local contexts. Soc Sci Med. 2013;93:194–202.CrossRef
22.
go back to reference Stroebel CK, McDaniel RR, Crabtree BF, Miller WL, Nutting PA, Stange KC. How complexity science can inform a reflective process for improvement in primary care practices. Jt Comm J Qual Patient Saf. 2005;31:438–46.CrossRef Stroebel CK, McDaniel RR, Crabtree BF, Miller WL, Nutting PA, Stange KC. How complexity science can inform a reflective process for improvement in primary care practices. Jt Comm J Qual Patient Saf. 2005;31:438–46.CrossRef
23.
go back to reference Lanham HJ, Palmer RF, Leykum LK, McDaniel RR, Nutting PA, Stange KC, et al. Trust and reflection in primary care practice redesign. Health Serv Res. 2016;51:1489–514.CrossRef Lanham HJ, Palmer RF, Leykum LK, McDaniel RR, Nutting PA, Stange KC, et al. Trust and reflection in primary care practice redesign. Health Serv Res. 2016;51:1489–514.CrossRef
24.
go back to reference Stensaker I, Falkenberg J, Grønhaug K. Implementation activities and organizational Sensemaking. J Appl Behav Sci. 2008;44:162–85.CrossRef Stensaker I, Falkenberg J, Grønhaug K. Implementation activities and organizational Sensemaking. J Appl Behav Sci. 2008;44:162–85.CrossRef
25.
go back to reference Weick KE. Sensemaking in organizations. Thou: Sage Publications; 1995. Weick KE. Sensemaking in organizations. Thou: Sage Publications; 1995.
26.
go back to reference Lanham HJ, McDaniel RR, Crabtree BF, Miller WL, Stange KC, Tallia AF, et al. How improving practice relationships among clinicians and nonclinicians can improve quality in primary care. J Comm J Qual Patient Saf. 2009;35:457–66.CrossRef Lanham HJ, McDaniel RR, Crabtree BF, Miller WL, Stange KC, Tallia AF, et al. How improving practice relationships among clinicians and nonclinicians can improve quality in primary care. J Comm J Qual Patient Saf. 2009;35:457–66.CrossRef
29.
go back to reference Hamilton A, Farmer M, Moin T, Finley E, Haskell S, Lang A, et al. Enhancing mental and physical health of women through engagement and retention (EMPOWER): a protocol for a program of research. Implement Sci. In press. Hamilton A, Farmer M, Moin T, Finley E, Haskell S, Lang A, et al. Enhancing mental and physical health of women through engagement and retention (EMPOWER): a protocol for a program of research. Implement Sci. In press.
32.
go back to reference Sogolow ED, Kay LS, Doll LS, Neumann MS, Mezoff JS, Eke AN, et al. Strengthening HIV prevention: application of a research-to-practice framework. AIDS Educ Prev Off Publ Int Soc AIDS Educ. 2000;12:21–32. Sogolow ED, Kay LS, Doll LS, Neumann MS, Mezoff JS, Eke AN, et al. Strengthening HIV prevention: application of a research-to-practice framework. AIDS Educ Prev Off Publ Int Soc AIDS Educ. 2000;12:21–32.
33.
go back to reference Carman KL, Dardess P, Maurer M, Sofaer S, Adams K, Bechtel C, et al. Patient and family engagement: a framework for understanding the elements and developing interventions and policies. Health Aff (Millwood). 2013;32:223–31.CrossRef Carman KL, Dardess P, Maurer M, Sofaer S, Adams K, Bechtel C, et al. Patient and family engagement: a framework for understanding the elements and developing interventions and policies. Health Aff (Millwood). 2013;32:223–31.CrossRef
34.
go back to reference McDaniel RR, Lanham HJ, Anderson RA. Implications of complex adaptive systems theory for the design of research on health care organizations. Health Care Manage Rev. 2009;34:191–9.CrossRef McDaniel RR, Lanham HJ, Anderson RA. Implications of complex adaptive systems theory for the design of research on health care organizations. Health Care Manage Rev. 2009;34:191–9.CrossRef
35.
go back to reference Gates EF. Making sense of the emerging conversation in evaluation about systems thinking and complexity science. Eval Program Plann. 2016;59:62–73.CrossRef Gates EF. Making sense of the emerging conversation in evaluation about systems thinking and complexity science. Eval Program Plann. 2016;59:62–73.CrossRef
36.
go back to reference Ali MK, Echouffo-Tcheugui JB, Williamson DF. How Effective Were Lifestyle Interventions In Real-World Settings That Were Modeled On The Diabetes Prevention Program, Health Aff (Millwood). 2012;31:67–75.CrossRef Ali MK, Echouffo-Tcheugui JB, Williamson DF. How Effective Were Lifestyle Interventions In Real-World Settings That Were Modeled On The Diabetes Prevention Program, Health Aff (Millwood). 2012;31:67–75.CrossRef
37.
go back to reference Lawlor MS, Blackwell CS, Isom SP, Katula JA, Vitolins MZ, Morgan TM, et al. Cost of a group translation of the diabetes prevention program. Am J Prev Med. 2013;44:S381–9.CrossRef Lawlor MS, Blackwell CS, Isom SP, Katula JA, Vitolins MZ, Morgan TM, et al. Cost of a group translation of the diabetes prevention program. Am J Prev Med. 2013;44:S381–9.CrossRef
38.
go back to reference Moin T, Ertl K, Schneider J, Vasti E, Makki F, Richardson C, et al. Women veterans’ experience with a web-based diabetes prevention program: a qualitative study to inform future practice. J Med Internet Res. 2015, e127;17. Moin T, Ertl K, Schneider J, Vasti E, Makki F, Richardson C, et al. Women veterans’ experience with a web-based diabetes prevention program: a qualitative study to inform future practice. J Med Internet Res. 2015, e127;17.
39.
go back to reference Goldstein KM, Melnyk SD, Zullig LL, Stechuchak KM, Oddone E, Bastian LA, et al. Heart matters: gender and racial differences cardiovascular disease risk factor control among veterans. Womens Health Issues. 2014;24:477–83.CrossRef Goldstein KM, Melnyk SD, Zullig LL, Stechuchak KM, Oddone E, Bastian LA, et al. Heart matters: gender and racial differences cardiovascular disease risk factor control among veterans. Womens Health Issues. 2014;24:477–83.CrossRef
40.
go back to reference Vimalananda VG, Biggs ML, Rosenzweig JL, Carnethon MR, Meigs JB, Thacker EL, et al. The influence of sex on cardiovascular outcomes associated with diabetes among older black and white adults. J Diabetes Complicat. 2014;28:316–22.CrossRef Vimalananda VG, Biggs ML, Rosenzweig JL, Carnethon MR, Meigs JB, Thacker EL, et al. The influence of sex on cardiovascular outcomes associated with diabetes among older black and white adults. J Diabetes Complicat. 2014;28:316–22.CrossRef
41.
go back to reference Runnals JJ, Garovoy N, McCutcheon SJ, Robbins AT, Mann-Wrobel MC, Elliott A, et al. Systematic review of women veterans’ mental health. Womens Health Issues. 2014;24:485–502.CrossRef Runnals JJ, Garovoy N, McCutcheon SJ, Robbins AT, Mann-Wrobel MC, Elliott A, et al. Systematic review of women veterans’ mental health. Womens Health Issues. 2014;24:485–502.CrossRef
42.
go back to reference Washington DL, Bean-Mayberry B, Riopelle D, Yano EM. Access to Care for Women Veterans: delayed healthcare and unmet need. J Gen Intern Med. 2011;26:655–61.CrossRef Washington DL, Bean-Mayberry B, Riopelle D, Yano EM. Access to Care for Women Veterans: delayed healthcare and unmet need. J Gen Intern Med. 2011;26:655–61.CrossRef
43.
go back to reference Vogt DS, Bergeron A, Salgado D, Daley J, Ouimette P, Wolfe J. Barriers to veterans health administration care in a nationally representative sample of women veterans. J Gen Intern Med. 2006;21. Vogt DS, Bergeron A, Salgado D, Daley J, Ouimette P, Wolfe J. Barriers to veterans health administration care in a nationally representative sample of women veterans. J Gen Intern Med. 2006;21.
44.
go back to reference Report of the Under Secretary for Health Workgroup. Provision of Primary Care to Women Veterans. In: US Department of Veterans Affairs, Office of Public Health and Environmental Hazards. Washington DC: Women Veterans Health Strategic Health Care Group; 2008. Report of the Under Secretary for Health Workgroup. Provision of Primary Care to Women Veterans. In: US Department of Veterans Affairs, Office of Public Health and Environmental Hazards. Washington DC: Women Veterans Health Strategic Health Care Group; 2008.
45.
go back to reference Hamilton AB, Poza I, Washington DL. “Homelessness and trauma go hand-in-hand”: pathways to homeless among women veterans. Womens Health Issues. 2011;21:s203–9.CrossRef Hamilton AB, Poza I, Washington DL. “Homelessness and trauma go hand-in-hand”: pathways to homeless among women veterans. Womens Health Issues. 2011;21:s203–9.CrossRef
46.
go back to reference Hamilton AB, Frayne SM, Cordasco KM, Washington DL. Factors related to Attrition from VA healthcare use: findings from the National Survey of women veterans. J Gen Intern Med. 2013;28:510–6.CrossRef Hamilton AB, Frayne SM, Cordasco KM, Washington DL. Factors related to Attrition from VA healthcare use: findings from the National Survey of women veterans. J Gen Intern Med. 2013;28:510–6.CrossRef
47.
go back to reference Friedman SA, Frayne SM, Berg E, Hamilton AB, Washington DL, Saechao F, et al. Travel time and attrition from VHA care among women veterans: how far is too far? Med Care. 2015;53:S15–22.CrossRef Friedman SA, Frayne SM, Berg E, Hamilton AB, Washington DL, Saechao F, et al. Travel time and attrition from VHA care among women veterans: how far is too far? Med Care. 2015;53:S15–22.CrossRef
48.
go back to reference Jordon M, Lanham HJ, Anderson RA, McDaniel RR Jr. Implications of complex adaptive systems theory for interpreting research about health care organizations. J Eval Clin Pract. 2010;16:228–31.CrossRef Jordon M, Lanham HJ, Anderson RA, McDaniel RR Jr. Implications of complex adaptive systems theory for interpreting research about health care organizations. J Eval Clin Pract. 2010;16:228–31.CrossRef
51.
go back to reference Bernard HR. Research methods in anthropology, second edition: qualitative and quantitative approaches. Walnut Creek: AltaMira Press; 1995. Bernard HR. Research methods in anthropology, second edition: qualitative and quantitative approaches. Walnut Creek: AltaMira Press; 1995.
52.
go back to reference Stirman SW, Kimberly J, Cook N, Calloway A, Castro F, Charns M. The sustainability of new programs and innovations: a review of the empirical literature and recommendations for future research. Implement Sci. 2012;7:17.CrossRef Stirman SW, Kimberly J, Cook N, Calloway A, Castro F, Charns M. The sustainability of new programs and innovations: a review of the empirical literature and recommendations for future research. Implement Sci. 2012;7:17.CrossRef
54.
go back to reference Manzano A. The craft of interviewing in realist evaluation. Evaluation. 2016;22:342–60.CrossRef Manzano A. The craft of interviewing in realist evaluation. Evaluation. 2016;22:342–60.CrossRef
55.
go back to reference Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health Ment Health Serv Res. 2011;38:65–76.CrossRef Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health Ment Health Serv Res. 2011;38:65–76.CrossRef
56.
go back to reference Sharp A, Nguyen H, Hahn E, et al. The just do it playbook for implementation science. Arizona: Phoenix; 2014.CrossRef Sharp A, Nguyen H, Hahn E, et al. The just do it playbook for implementation science. Arizona: Phoenix; 2014.CrossRef
57.
go back to reference Fetters MD, Curry LA, Creswell JW. Achieving integration in mixed methods designs-principles and practices. Health Serv Res. 2013;48:2134–56.CrossRef Fetters MD, Curry LA, Creswell JW. Achieving integration in mixed methods designs-principles and practices. Health Serv Res. 2013;48:2134–56.CrossRef
58.
go back to reference Averill JB. Matrix analysis as a complementary analytic strategy in qualitative inquiry. Qual Health Res. 2002;12:855–66.CrossRef Averill JB. Matrix analysis as a complementary analytic strategy in qualitative inquiry. Qual Health Res. 2002;12:855–66.CrossRef
60.
go back to reference Atlas. ti 7.0 software. Berlin: Scientific Software Development. Atlas. ti 7.0 software. Berlin: Scientific Software Development.
61.
go back to reference Kedward J, Dakin L. A qualitative study of barriers to the use of statins and the implementation of coronary heart disease prevention in primary care. Br J Gen Pract. 2003;53:684–9. Kedward J, Dakin L. A qualitative study of barriers to the use of statins and the implementation of coronary heart disease prevention in primary care. Br J Gen Pract. 2003;53:684–9.
62.
go back to reference Stewart RE, Stirman SW, Chambliss DL. A qualitative investigation of practicing psychologists’ attitudes toward research-informed practice: implications for dissemination strategies. Prof Psychol Res Pract. 2012;43:100–9.CrossRef Stewart RE, Stirman SW, Chambliss DL. A qualitative investigation of practicing psychologists’ attitudes toward research-informed practice: implications for dissemination strategies. Prof Psychol Res Pract. 2012;43:100–9.CrossRef
63.
go back to reference Raphael K. Recall bias: a proposal for assessment and control. Int J Epidemiol. 1987;16:167–70.CrossRef Raphael K. Recall bias: a proposal for assessment and control. Int J Epidemiol. 1987;16:167–70.CrossRef
64.
go back to reference Li J, Hinami K, Hansen LO, Maynard G, Budnitz T, Williams MV. The physician mentored implementation model: a promising quality improvement framework for health care change. Acad Med. 2015;90:303–10.CrossRef Li J, Hinami K, Hansen LO, Maynard G, Budnitz T, Williams MV. The physician mentored implementation model: a promising quality improvement framework for health care change. Acad Med. 2015;90:303–10.CrossRef
65.
go back to reference Balasubramanian BA, Chase SM, Nutting PA, Cohen DJ, Strickland PAO, Crosson JC, et al. Using learning teams for reflective adaptation (ULTRA): insights from a team-based change management strategy in primary care. Ann Fam Med. 2010;8:425–32.CrossRef Balasubramanian BA, Chase SM, Nutting PA, Cohen DJ, Strickland PAO, Crosson JC, et al. Using learning teams for reflective adaptation (ULTRA): insights from a team-based change management strategy in primary care. Ann Fam Med. 2010;8:425–32.CrossRef
67.
go back to reference Kitson A, Harvey G, McCormack B. Enabling the implementation of evidence based practice: a conceptual framework. Qual Health Care QHC. 1998;7:149–58.CrossRef Kitson A, Harvey G, McCormack B. Enabling the implementation of evidence based practice: a conceptual framework. Qual Health Care QHC. 1998;7:149–58.CrossRef
70.
go back to reference Weick K. Managing the unexpected: complexity as distributed sensemaking. Uncertain Surprise Complex Syst Quest Work Unexpected. Springer-Verlag; 2005. Weick K. Managing the unexpected: complexity as distributed sensemaking. Uncertain Surprise Complex Syst Quest Work Unexpected. Springer-Verlag; 2005.
71.
go back to reference Baum F. Participatory action research. J Epidemiol Community Health. 2006;60:854–7.CrossRef Baum F. Participatory action research. J Epidemiol Community Health. 2006;60:854–7.CrossRef
73.
go back to reference Tabak RG, Khoong EC, Chambers DA, Brownson RC. Bridging research and practices: models for dissemination and implementation research. Am J Prev Med. 2012;43:337–50.CrossRef Tabak RG, Khoong EC, Chambers DA, Brownson RC. Bridging research and practices: models for dissemination and implementation research. Am J Prev Med. 2012;43:337–50.CrossRef
Metadata
Title
Periodic reflections: a method of guided discussions for documenting implementation phenomena
Authors
Erin P. Finley
Alexis K. Huynh
Melissa M. Farmer
Bevanne Bean-Mayberry
Tannaz Moin
Sabine M. Oishi
Jessica L. Moreau
Karen E. Dyer
Holly Jordan Lanham
Luci Leykum
Alison B. Hamilton
Publication date
01-12-2018
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2018
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-018-0610-y

Other articles of this Issue 1/2018

BMC Medical Research Methodology 1/2018 Go to the issue