Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress
Clinical Collections
Advances in Alzheimer’s

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.
ADVANCED SEARCH
Log in
Top
Implementation Science
Published in: Implementation Science 1/2013

Open Access 01-12-2013 | Research

Between and within-site variation in qualitative implementation research

Authors: Justin K Benzer, Sarah Beehler, Irene E Cramer, David C Mohr, Martin P Charns, James F Burgess Jr

Published in: Implementation Science | Issue 1/2013

Login to get access

Abstract

Background

Multisite qualitative studies are challenging in part because decisions regarding within-site and between-site sampling must be made to reduce the complexity of data collection, but these decisions may have serious implications for analyses. There is not yet consensus on how to account for within-site and between-site variations in qualitative perceptions of the organizational context of interventions. The purpose of this study was to analyze variation in perceptions among key informants in order to demonstrate the importance of broad sampling for identifying both within-site and between-site implementation themes.

Methods

Case studies of four sites were compared to identify differences in how Department of Veterans Affairs (VA) medical centers implemented a Primary Care/Mental Health Integration (PC/MHI) intervention. Qualitative analyses focused on between-profession variation in reported referral and implementation processes within and between sites.

Results

Key informants identified co-location, the consultation-liaison service, space, access, and referral processes as important topics. Within-site themes revealed the importance of coordination, communication, and collaboration for implementing PC/MHI. The between-site theme indicated that the preexisting structure of mental healthcare influenced how PC/MHI was implemented at each site and that collaboration among both leaders and providers was critical to overcoming structural barriers.

Conclusions

Within- and between-site variation in perceptions among key informants within different professions revealed barriers and facilitators to the implementation not available from a single source. Examples provide insight into implementation barriers for PC/MHI. Multisite implementation studies may benefit from intentionally eliciting and analyzing variation within and between sites. Suggestions for implementation research design are presented.
Appendix
Available only for authorised users
Literature
1.
Malterud K: Qualitative research: standards, challenges, and guidelines. Lancet. 2001, 358: 483-488. 10.1016/S0140-6736(01)05627-6.CrossRefPubMed
2.
Mbindyo P, Gilson L, Blaauw D, English M: Contextual influences on health worker motivation in district hospitals in Kenya. Implement Sci. 2009, 4: 43-10.1186/1748-5908-4-43.CrossRefPubMedPubMedCentral
3.
Franx G, Oud M, De Lange J, Wensing M, Grol R: Implementing a stepped care approach in primary care. Results of a qualitative study. Implement Sci. 2012, 7: 8-10.1186/1748-5908-7-8.CrossRefPubMedPubMedCentral
4.
Fickel JJ, Yano EM, Parker LE, Rubenstein LV: Clinic-level process of care for depression in primary care settings. Adm Policy Ment Health. 2009, 36: 144-158. 10.1007/s10488-009-0207-1.CrossRefPubMed
5.
Magnabosco JL: Innovations in mental health services implementation: a report on state-level data from the U.S. Evidence-Based Practices Project. Implement Sci. 2006, 1: 13-10.1186/1748-5908-1-13.CrossRefPubMedPubMedCentral
6.
Green AE, Aarons GA: A comparison of policy and direct practice stakeholder perceptions of factors affecting evidence-based practice implementation using concept mapping. Implement Sci. 2011, 6: 104-10.1186/1748-5908-6-104.CrossRefPubMedPubMedCentral
7.
Asiimwe C, Kyabayinze DJ, Kyalisiima Z, Nabakooza J, Bajabaite M, Counihan H, Tibenderana JK: Early experiences on the feasibility, acceptability, and use of malaria rapid diagnostic tests at peripheral health centres in Uganda–insights into some barriers and facilitators. Implement Sci. 2012, 7: 5-10.1186/1748-5908-7-5.CrossRefPubMedPubMedCentral
8.
Hysong SJ, Esquivel A, Sittig DF, Paul LA, Espadas D, Singh S, Singh H: Towards successful coordination of electronic health record based-referrals: a qualitative analysis. Implement Sci. 2011, 6: 84-10.1186/1748-5908-6-84.CrossRefPubMedPubMedCentral
9.
Donovan J, Mills N, Smith M, Brindle L, Jacoby A, Peters T, Frankel S, Neal D, Hamdy F: Quality improvement report: Improving design and conduct of randomised trials by embedding them in qualitative research: ProtecT (prostate testing for cancer and treatment) study. Commentary: presenting unbiased information to patients can be difficult. BMJ. 2002, 325: 766-770. 10.1136/bmj.325.7367.766.CrossRefPubMedPubMedCentral
10.
Rogers A, Day J, Randall F, Bentall RP: Patients’ understanding and participation in a trial designed to improve the management of anti-psychotic medication: a qualitative study. Soc Psychiatry Psychiatr Epidemiol. 2003, 38: 720-727. 10.1007/s00127-003-0693-5.CrossRefPubMed
11.
Aarons GA, Hurlburt M, Horwitz SM: Advancing a conceptual model of evidence-based practice implementation in public service sectors. Adm Policy Ment Health. 2011, 38: 4-23. 10.1007/s10488-010-0327-7.CrossRefPubMed
12.
Stetler CB, Ritchie JA, Rycroft-Malone J, Schultz AA, Charns MP: Institutionalizing evidence-based practice: an organizational case study using a model of strategic change. Implement Sci. 2009, 4: 78-10.1186/1748-5908-4-78.CrossRefPubMedPubMedCentral
13.
McHugh RK, Barlow DH: The dissemination and implementation of evidence-based psychological treatments. A review of current efforts. Am Psychol. 2010, 65: 73-84.CrossRefPubMed
14.
Torrey WC, Bond GR, McHugo GJ, Swain K: Evidence-based practice implementation in community mental health settings: the relative importance of key domains of implementation activity. Adm Policy Ment Health. 2012, 39 (5): 353-364. 10.1007/s10488-011-0357-9.CrossRefPubMed
15.
Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC: Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009, 4: 50-10.1186/1748-5908-4-50.CrossRefPubMedPubMedCentral
16.
Ford JH, Krahn D, Wise M, Oliver KA: Measuring sustainability within the veterans administration mental health system redesign initiative. Qual Manag Health Care. 2011, 20: 263-279.CrossRefPubMedPubMedCentral
17.
Stetler CB, Damschroder LJ, Helfrich CD, Hagedorn HJ: A Guide for applying a revised version of the PARIHS framework for implementation. Implement Sci. 2011, 6: 99-10.1186/1748-5908-6-99.CrossRefPubMedPubMedCentral
18.
Lewin S, Glenton C, Oxman AD: Use of qualitative methods alongside randomised controlled trials of complex healthcare interventions: methodological study. BMJ. 2009, 339: b3496-10.1136/bmj.b3496.CrossRefPubMedPubMedCentral
19.
Barnett J, Vasileiou K, Djemil F, Brooks L, Young T: Understanding innovators’ experiences of barriers and facilitators in implementation and diffusion of healthcare service innovations: a qualitative study. BMC Health Serv Res. 2011, 11: 342-10.1186/1472-6963-11-342.CrossRefPubMedPubMedCentral
20.
Kitson A, Harvey G, McCormack B: Enabling the implementation of evidence based practice: a conceptual framework. Qual Health Care. 1998, 7: 149-158. 10.1136/qshc.7.3.149.CrossRefPubMedPubMedCentral
21.
Kitson AL, Rycroft-Malone J, Harvey G, McCormack B, Seers K, Titchen A: Evaluating the successful implementation of evidence into practice using the PARiHS framework: theoretical and practical challenges. Implement Sci. 2008, 3: 1-10.1186/1748-5908-3-1.CrossRefPubMedPubMedCentral
22.
Leblanc A, Legare F, Labrecque M, Godin G, Thivierge R, Laurier C, Cote L, O’Connor AM, Rousseau M: Feasibility of a randomised trial of a continuing medical education program in shared decision-making on the use of antibiotics for acute respiratory infections in primary care: the DECISION+ pilot trial. Implement Sci. 2011, 6: 5-10.1186/1748-5908-6-5.CrossRefPubMedPubMedCentral
23.
Schouten LM, Hulscher ME, van Everdingen JJ, Huijsman R, Niessen LW, Grol RP: Short- and long-term effects of a quality improvement collaborative on diabetes management. Implement Sci. 2010, 5: 94-10.1186/1748-5908-5-94.CrossRefPubMedPubMedCentral
24.
Vos L, Duckers ML, Wagner C, van Merode GG: Applying the quality improvement collaborative method to process redesign: a multiple case study. Implement Sci. 2010, 5: 19-10.1186/1748-5908-5-19.CrossRefPubMedPubMedCentral
25.
Forsner T, Wistedt AA, Brommels M, Janszky I, de Leon AP, Forsell Y: Supported local implementation of clinical guidelines in psychiatry: a two-year follow-up. Implement Sci. 2010, 5: 4-10.1186/1748-5908-5-4.CrossRefPubMedPubMedCentral
26.
Vollmar HC, Mayer H, Ostermann T, Butzlaff ME, Sandars JE, Wilm S, Rieger MA: Knowledge transfer for the management of dementia: a cluster randomised trial of blended learning in general practice. Implement Sci. 2010, 5: 1-10.1186/1748-5908-5-1.CrossRefPubMedPubMedCentral
27.
Driessen MT, Groenewoud K, Proper KI, Anema JR, Bongers PM, van der Beek AJ: What are possible barriers and facilitators to implementation of a Participatory Ergonomics programme?. Implement Sci. 2010, 5: 64-10.1186/1748-5908-5-64.CrossRefPubMedPubMedCentral
28.
Kauth MR, Sullivan G, Blevins D, Cully JA, Landes RD, Said Q, Teasdale TA: Employing external facilitation to implement cognitive behavioral therapy in VA clinics: a pilot study. Implement Sci. 2010, 5: 75-10.1186/1748-5908-5-75.CrossRefPubMedPubMedCentral
29.
Murray E, Burns J, May C, Finch T, O’Donnell C, Wallace P, Mair F: Why is it difficult to implement e-health initiatives? A qualitative study. Implement Sci. 2011, 6: 6-10.1186/1748-5908-6-6.CrossRefPubMedPubMedCentral
30.
Ferlie E, Fitzgerald L, Wood M, Hawkins C: The nonspread of innovations: the mediating role of professionals. Acad Manage J. 2005, 48: 117-134. 10.5465/AMJ.2005.15993150.CrossRef
31.
Veterans Health Administration: VSSC Primary Care-Mental Health Integration Dashboard. 2011, Washington DC: Department of Veterans Affairs
32.
Benzer JK, Beehler S, Miller C, Burgess JF, Sullivan JL, Mohr DC, Meterko M, Cramer IE: Grounded theory of barriers and facilitators to mandated implementation of mental health care in the primary care setting. Depress Res Treat. 2012, 2012: 597157-PubMedPubMedCentral
33.
Stetler CB, Legro MW, Wallace CM, Bowman C, Guihan M, Hagedorn H, Kimmel B, Sharp ND, Smith JL: The role of formative evaluation in implementation research and the QUERI experience. J Gen Intern Med. 2006, 21 (Suppl 2): S1-S8.CrossRefPubMedPubMedCentral
34.
Patton MQ: Qualitative Research and Evaluation Methods. 2002, Thousand Oaks, CA: Sage, 3
35.
Yin RK: Case Study Research: Design and Methods. 1994, Thousand Oaks, CA: Sage, 2
36.
Charmaz K: Constructing grounded theory: A practical guide through qualitative analysis. 2006, Thousand Oaks, CA: Sage
37.
Johnson JM: depth interviewing. Handbook of Qualitative Research. Edited by: Gubrium JF, Holstein JA. 2002, Thousand Oaks, CA: Sage, 103-119.
38.
Miller W, Crabtree B: Depth interviewing. Doing Qualitative Research. Edited by: Miller W, Crabtree B. 1999, Thousand Oaks, CA: Sage, 89-107. 2
39.
Spradley JP: The ethnographic interview. 1979, Belmont, CA: Wadsworth
40.
Farmer T, Robinson K, Elliott SJ, Eyles J: Developing and implementing a triangulation protocol for qualitative health research. Qual Health Res. 2006, 16: 377-394. 10.1177/1049732305285708.CrossRefPubMed
41.
Erzberger C, Prein G: Triangulation: validity and empirically-based hypothesis construction. Qual Quant. 1997, 31: 141-154. 10.1023/A:1004249313062.CrossRef
42.
43.
Lincoln YS: Emerging criteria for quality in qualitative and interpretive research. Qual Inq. 1995, 1: 275-289. 10.1177/107780049500100301.CrossRef
44.
Auerbach C, Silverstein L: Qualitative data: an introduction to coding and analysis. 2003, New York: New York University Press
45.
Lincoln YS, Guba EG: Naturalistic Inquiry. 1985, Newbury Park, CA: Sage
46.
Rogers EM: Diffusion of Innovations. 1995, New York: The Free Press
47.
Miles MB, Huberman AM: Qualitative Data Analysis. 1994, Thousand Oaks, CA: Sage
Metadata
Title
Between and within-site variation in qualitative implementation research
Authors
Justin K Benzer
Sarah Beehler
Irene E Cramer
David C Mohr
Martin P Charns
James F Burgess Jr
Publication date
01-12-2013
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2013
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/1748-5908-8-4

Other articles of this Issue 1/2013

Implementation Science 1/2013 Go to the issue

Study protocol

Integrating evidence on patient preferences in healthcare policy decisions: protocol of the patient-VIP study

Study protocol

Partnership for fragility bone fracture care provision and prevention program (P4Bones): study protocol for a secondary fracture prevention pragmatic controlled trial

Study protocol

Improving physician hand hygiene compliance using behavioural theories: a study protocol

Study protocol

Improving evidence-based primary care for chronic kidney disease: study protocol for a cluster randomized control trial for translating evidence into practice (TRANSLATE CKD)

Methodology

The demonstration of a theory-based approach to the design of localized patient safety interventions

Study protocol

Evaluating the effectiveness of a clinical practice change intervention in increasing clinician provision of preventive care in a network of community-based mental health services: a study protocol of a non-randomized, multiple baseline trial