Skip to main content
Top
Published in: BMC Health Services Research 1/2014

Open Access 01-12-2014 | Debate

Ethnographic process evaluation in primary care: explaining the complexity of implementation

Authors: Arwen E Bunce, Rachel Gold, James V Davis, Carmit K McMullen, Victoria Jaworski, MaryBeth Mercer, Christine Nelson

Published in: BMC Health Services Research | Issue 1/2014

Login to get access

Abstract

Background

The recent growth of implementation research in care delivery systems has led to a renewed interest in methodological approaches that deliver not only intervention outcome data but also deep understanding of the complex dynamics underlying the implementation process. We suggest that an ethnographic approach to process evaluation, when informed by and integrated with quantitative data, can provide this nuanced insight into intervention outcomes. The specific methods used in such ethnographic process evaluations are rarely presented in detail; our objective is to stimulate a conversation around the successes and challenges of specific data collection methods in health care settings. We use the example of a translational clinical trial among 11 community clinics in Portland, OR that are implementing an evidence-based, health-information technology (HIT)-based intervention focused on patients with diabetes.

Discussion

Our ethnographic process evaluation employed weekly diaries by clinic-based study employees, observation, informal and formal interviews, document review, surveys, and group discussions to identify barriers and facilitators to implementation success, provide insight into the quantitative study outcomes, and uncover lessons potentially transferable to other implementation projects. These methods captured the depth and breadth of factors contributing to intervention uptake, while minimizing disruption to clinic work and supporting mid-stream shifts in implementation strategies. A major challenge is the amount of dedicated researcher time required.

Summary

The deep understanding of the ‘how’ and ‘why’ behind intervention outcomes that can be gained through an ethnographic approach improves the credibility and transferability of study findings. We encourage others to share their own experiences with ethnography in implementation evaluation and health services research, and to consider adapting the methods and tools described here for their own research.
Appendix
Available only for authorised users
Literature
1.
go back to reference Miller WL, Crabtree BF, Harrison MI, Fennell ML: Integrating mixed methods in health services and delivery system research. Health Serv Res. 2013, 48: 2125-2133. 10.1111/1475-6773.12123.CrossRefPubMedPubMedCentral Miller WL, Crabtree BF, Harrison MI, Fennell ML: Integrating mixed methods in health services and delivery system research. Health Serv Res. 2013, 48: 2125-2133. 10.1111/1475-6773.12123.CrossRefPubMedPubMedCentral
2.
go back to reference Creswell JW: Controversies in Mixed Methods Research. The SAGE Handbook of Qualitative Research. Edited by: Denzin NK, Lincoln YS. 2011, SAGE Publications, Inc, Thousand Oaks, CA, 269-283. 4 Creswell JW: Controversies in Mixed Methods Research. The SAGE Handbook of Qualitative Research. Edited by: Denzin NK, Lincoln YS. 2011, SAGE Publications, Inc, Thousand Oaks, CA, 269-283. 4
3.
go back to reference Teddlie C, Thashakkori A: Mixed Methods Research: Contemporary Issues in an Emerging Field. The SAGE Handbook of Qualitative Research. Edited by: Denzin NK, Lincoln YS. 2014, SAGE Publications, Inc, Thousand Oaks, CA, 285-299. 4 Teddlie C, Thashakkori A: Mixed Methods Research: Contemporary Issues in an Emerging Field. The SAGE Handbook of Qualitative Research. Edited by: Denzin NK, Lincoln YS. 2014, SAGE Publications, Inc, Thousand Oaks, CA, 285-299. 4
4.
go back to reference Special edition: integrating mixed methods in health services and delivery system research. Health Serv Res. 2013, 48: 2125-10.1111/1475-6773.12123. Special edition: integrating mixed methods in health services and delivery system research. Health Serv Res. 2013, 48: 2125-10.1111/1475-6773.12123.
5.
go back to reference Wisdom JP, Cavaleri MA, Onwuegbuzie AJ, Green CA: Methodological reporting in qualitative, quantitative, and mixed methods health services research articles. Health Serv Res. 2012, 47: 721-745. 10.1111/j.1475-6773.2011.01344.x.CrossRefPubMed Wisdom JP, Cavaleri MA, Onwuegbuzie AJ, Green CA: Methodological reporting in qualitative, quantitative, and mixed methods health services research articles. Health Serv Res. 2012, 47: 721-745. 10.1111/j.1475-6773.2011.01344.x.CrossRefPubMed
6.
go back to reference Scammon DL, Tomoaia-Cotisel A, Day RL, Day J, Kim J, Waitzman NJ, Farrell TW, Magill MK: Connecting the dots and merging meaning: using mixed methods to study primary care delivery transformation. Health Serv Res. 2013, 48: 2181-2207. 10.1111/1475-6773.12114.CrossRefPubMedPubMedCentral Scammon DL, Tomoaia-Cotisel A, Day RL, Day J, Kim J, Waitzman NJ, Farrell TW, Magill MK: Connecting the dots and merging meaning: using mixed methods to study primary care delivery transformation. Health Serv Res. 2013, 48: 2181-2207. 10.1111/1475-6773.12114.CrossRefPubMedPubMedCentral
7.
go back to reference Powell BJ, Proctor EK, Glisson CA, Kohl PL, Raghavan R, Brownson RC, Stoner BP, Carpenter CR, Palinkas LA: A mixed methods multiple case study of implementation as usual in children’s social service organizations: study protocol. Implement Sci. 2013, 8: 92-10.1186/1748-5908-8-92.CrossRefPubMedPubMedCentral Powell BJ, Proctor EK, Glisson CA, Kohl PL, Raghavan R, Brownson RC, Stoner BP, Carpenter CR, Palinkas LA: A mixed methods multiple case study of implementation as usual in children’s social service organizations: study protocol. Implement Sci. 2013, 8: 92-10.1186/1748-5908-8-92.CrossRefPubMedPubMedCentral
8.
go back to reference Aarons GA, Fettes DL, Sommerfeld DH, Palinkas LA: Mixed methods for implementation research: application to evidence-based practice implementation and staff turnover in community-based organizations providing child welfare services. Child Maltreat. 2012, 17: 67-79. 10.1177/1077559511426908.CrossRefPubMed Aarons GA, Fettes DL, Sommerfeld DH, Palinkas LA: Mixed methods for implementation research: application to evidence-based practice implementation and staff turnover in community-based organizations providing child welfare services. Child Maltreat. 2012, 17: 67-79. 10.1177/1077559511426908.CrossRefPubMed
9.
go back to reference Fetters MD, Curry LA, Creswell JW: Achieving integration in mixed methods designs: principles and practices. Health Serv Res. 2013, 48: 2134-2156. 10.1111/1475-6773.12117.CrossRefPubMedPubMedCentral Fetters MD, Curry LA, Creswell JW: Achieving integration in mixed methods designs: principles and practices. Health Serv Res. 2013, 48: 2134-2156. 10.1111/1475-6773.12117.CrossRefPubMedPubMedCentral
10.
go back to reference Dixon-Woods M, Bosk C: Learning through observation: the role of ethnography in improving critical care. Curr Opin Crit Care. 2010, 16: 639-642. 10.1097/MCC.0b013e32833ef5ef.CrossRefPubMed Dixon-Woods M, Bosk C: Learning through observation: the role of ethnography in improving critical care. Curr Opin Crit Care. 2010, 16: 639-642. 10.1097/MCC.0b013e32833ef5ef.CrossRefPubMed
11.
go back to reference Smith-Morris C, Lopez G, Ottomanelli L, Goetz L, Dixon-Lawson K: Ethnography, fidelity, and the evidence that anthropology adds: supplementing the fidelity process in a clinical trial of supported employment. Med Anthropol Q. 2014, 28: 141-161. 10.1111/maq.12093.CrossRefPubMed Smith-Morris C, Lopez G, Ottomanelli L, Goetz L, Dixon-Lawson K: Ethnography, fidelity, and the evidence that anthropology adds: supplementing the fidelity process in a clinical trial of supported employment. Med Anthropol Q. 2014, 28: 141-161. 10.1111/maq.12093.CrossRefPubMed
12.
go back to reference Greenhalgh T, Swinglehurst D: Studying technology use as social practice: the untapped potential of ethnography. BMC Med. 2011, 9: 45-10.1186/1741-7015-9-45.CrossRefPubMedPubMedCentral Greenhalgh T, Swinglehurst D: Studying technology use as social practice: the untapped potential of ethnography. BMC Med. 2011, 9: 45-10.1186/1741-7015-9-45.CrossRefPubMedPubMedCentral
13.
go back to reference Myers MD: Investigating information systems with ethnographic research. Commun Assoc Inf Syst. 1999, 2: 2-19. Myers MD: Investigating information systems with ethnographic research. Commun Assoc Inf Syst. 1999, 2: 2-19.
14.
go back to reference Dudl RJ, Wang MC, Wong M, Bellows J: Preventing myocardial infarction and stroke with a simplified bundle of cardioprotective medications. Am J Manag Care. 2009, 15: e88-e94.PubMed Dudl RJ, Wang MC, Wong M, Bellows J: Preventing myocardial infarction and stroke with a simplified bundle of cardioprotective medications. Am J Manag Care. 2009, 15: e88-e94.PubMed
15.
go back to reference Bellg AJ, Borrelli B, Resnick B, Hecht J, Minicucci DS, Ory M, Ogedegbe G, Orwig D, Ernst D, Czajkowski S: Enhancing treatment fidelity in health behavior change studies: best practices and recommendations from the NIH behavior change consortium. Health Psychol. 2004, 23: 443-451. 10.1037/0278-6133.23.5.443.CrossRefPubMed Bellg AJ, Borrelli B, Resnick B, Hecht J, Minicucci DS, Ory M, Ogedegbe G, Orwig D, Ernst D, Czajkowski S: Enhancing treatment fidelity in health behavior change studies: best practices and recommendations from the NIH behavior change consortium. Health Psychol. 2004, 23: 443-451. 10.1037/0278-6133.23.5.443.CrossRefPubMed
16.
go back to reference Saunders RP, Evans AE, Kenison K, Workman L, Dowda M, Chu YH: Conceptualizing, implementing, and monitoring a structural health promotion intervention in an organizational setting. Health Promot Pract. 2013, 14: 343-353. 10.1177/1524839912454286.CrossRefPubMed Saunders RP, Evans AE, Kenison K, Workman L, Dowda M, Chu YH: Conceptualizing, implementing, and monitoring a structural health promotion intervention in an organizational setting. Health Promot Pract. 2013, 14: 343-353. 10.1177/1524839912454286.CrossRefPubMed
17.
go back to reference Wilson DK, Griffin S, Saunders RP, Kitzman-Ulrich H, Meyers DC, Mansard L: Using process evaluation for program improvement in dose, fidelity and reach: the ACT trial experience. Int J Behav Nutr Phys Act. 2009, 6: 79-10.1186/1479-5868-6-79.CrossRefPubMedPubMedCentral Wilson DK, Griffin S, Saunders RP, Kitzman-Ulrich H, Meyers DC, Mansard L: Using process evaluation for program improvement in dose, fidelity and reach: the ACT trial experience. Int J Behav Nutr Phys Act. 2009, 6: 79-10.1186/1479-5868-6-79.CrossRefPubMedPubMedCentral
18.
go back to reference Greenhalgh T, Russell J: Why do evaluations of eHealth programs fail? An alternative set of guiding principles. PLoS Med. 2010, 7: e1000360-10.1371/journal.pmed.1000360.CrossRefPubMedPubMedCentral Greenhalgh T, Russell J: Why do evaluations of eHealth programs fail? An alternative set of guiding principles. PLoS Med. 2010, 7: e1000360-10.1371/journal.pmed.1000360.CrossRefPubMedPubMedCentral
19.
go back to reference Hasson H: Systematic evaluation of implementation fidelity of complex interventions in health and social care. Implement Sci. 2010, 5: 67-10.1186/1748-5908-5-67.CrossRefPubMedPubMedCentral Hasson H: Systematic evaluation of implementation fidelity of complex interventions in health and social care. Implement Sci. 2010, 5: 67-10.1186/1748-5908-5-67.CrossRefPubMedPubMedCentral
20.
go back to reference Patton MQ: The view from evaluation. NAPA Bulletin. 2005, 24: 31-40. 10.1525/napa.2005.24.1.031.CrossRef Patton MQ: The view from evaluation. NAPA Bulletin. 2005, 24: 31-40. 10.1525/napa.2005.24.1.031.CrossRef
21.
go back to reference LeCompte MD, Schensul JJ: Designing and Conducting Ethnographic Research. 2010, AltaMira Press, Lanham, MD LeCompte MD, Schensul JJ: Designing and Conducting Ethnographic Research. 2010, AltaMira Press, Lanham, MD
22.
go back to reference Cefkin M: The Limits to Speed in Ethnography. Advancing Ethnography in Corporate Environments: Challenges and Emerging Opportunities. Edited by: Jordan B. 2013, Left Coast Press, Walnut Creek, CA, 108. Cefkin M: The Limits to Speed in Ethnography. Advancing Ethnography in Corporate Environments: Challenges and Emerging Opportunities. Edited by: Jordan B. 2013, Left Coast Press, Walnut Creek, CA, 108.
23.
go back to reference Stange KC, Glasgow RE: Considering and Reporting Important Contextual Factors in Research on the Patient-Centered Medical Home. 2013, Agency for Healthcare Research and Quality, Rockville, MD Stange KC, Glasgow RE: Considering and Reporting Important Contextual Factors in Research on the Patient-Centered Medical Home. 2013, Agency for Healthcare Research and Quality, Rockville, MD
24.
go back to reference Tomoaia-Cotisel A, Scammon DL, Waitzman NJ, Cronholm PF, Halladay JR, Driscoll DL, Solberg LI, Hsu C, Tai-Seale M, Hiratsuka V, Shih SC, Fetters MD, Wise CG, Alexander JA, Hauser D, McMullen CK, Scholle SH, Tirodkar MA, Schmidt L, Donahue KE, Parchman ML, Stange KC: Context matters: the experience of 14 research teams in systematically reporting contextual factors important for practice change. Ann Fam Med. 2013, 11 (Suppl 1): S115-S123. 10.1370/afm.1549.CrossRefPubMedPubMedCentral Tomoaia-Cotisel A, Scammon DL, Waitzman NJ, Cronholm PF, Halladay JR, Driscoll DL, Solberg LI, Hsu C, Tai-Seale M, Hiratsuka V, Shih SC, Fetters MD, Wise CG, Alexander JA, Hauser D, McMullen CK, Scholle SH, Tirodkar MA, Schmidt L, Donahue KE, Parchman ML, Stange KC: Context matters: the experience of 14 research teams in systematically reporting contextual factors important for practice change. Ann Fam Med. 2013, 11 (Suppl 1): S115-S123. 10.1370/afm.1549.CrossRefPubMedPubMedCentral
25.
go back to reference Prasad P: Systems of Meaning: Ethnography as a Methodology for the Study of Information Technologies. Information Systems and Qualitative Research. Edited by: Lee A, Liebenau J, DeGross J. 1997, Springer US, New York, NY, 101-118. 10.1007/978-0-387-35309-8_7.CrossRef Prasad P: Systems of Meaning: Ethnography as a Methodology for the Study of Information Technologies. Information Systems and Qualitative Research. Edited by: Lee A, Liebenau J, DeGross J. 1997, Springer US, New York, NY, 101-118. 10.1007/978-0-387-35309-8_7.CrossRef
26.
go back to reference Eccles MP, Foy R, Sales A, Wensing M, Mittman B: Implementation Science six years on–our evolving scope and common reasons for rejection without review. Implement Sci. 2012, 7: 71-10.1186/1748-5908-7-71.CrossRefPubMedPubMedCentral Eccles MP, Foy R, Sales A, Wensing M, Mittman B: Implementation Science six years on–our evolving scope and common reasons for rejection without review. Implement Sci. 2012, 7: 71-10.1186/1748-5908-7-71.CrossRefPubMedPubMedCentral
27.
go back to reference Greenhalgh T, Russell J, Ashcroft RE, Parsons W: Why national eHealth programs need dead philosophers: Wittgensteinian reflections on policymakers’ reluctance to learn from history. Milbank Q. 2011, 89: 533-563. 10.1111/j.1468-0009.2011.00642.x.CrossRefPubMedPubMedCentral Greenhalgh T, Russell J, Ashcroft RE, Parsons W: Why national eHealth programs need dead philosophers: Wittgensteinian reflections on policymakers’ reluctance to learn from history. Milbank Q. 2011, 89: 533-563. 10.1111/j.1468-0009.2011.00642.x.CrossRefPubMedPubMedCentral
28.
go back to reference Dourish P: Process Descriptions as Organisational Accounting Devices: The Dual use of Workflow Technologies. Proceedings of the 2001 International ACM SIGGROUP Conference on Supporting Group Work (GROUP’01). Edited by: Ellis C, Zigurs I. 2001, Association of Computing Machinery, New York, NY Dourish P: Process Descriptions as Organisational Accounting Devices: The Dual use of Workflow Technologies. Proceedings of the 2001 International ACM SIGGROUP Conference on Supporting Group Work (GROUP’01). Edited by: Ellis C, Zigurs I. 2001, Association of Computing Machinery, New York, NY
29.
go back to reference Sittig DF, Singh H: A new sociotechnical model for studying health information technology in complex adaptive healthcare systems. Qual Saf Health Care. 2010, 19 (Suppl 3): i68-i74. 10.1136/qshc.2010.042085.CrossRefPubMedPubMedCentral Sittig DF, Singh H: A new sociotechnical model for studying health information technology in complex adaptive healthcare systems. Qual Saf Health Care. 2010, 19 (Suppl 3): i68-i74. 10.1136/qshc.2010.042085.CrossRefPubMedPubMedCentral
30.
go back to reference Goodson L, Vassar M: An overview of ethnography in healthcare and medical education research. J Educ Eval Health Prof. 2011, 8: 4-10.3352/jeehp.2011.8.4.CrossRefPubMedPubMedCentral Goodson L, Vassar M: An overview of ethnography in healthcare and medical education research. J Educ Eval Health Prof. 2011, 8: 4-10.3352/jeehp.2011.8.4.CrossRefPubMedPubMedCentral
31.
go back to reference Morse JM: What Is Qualitative Health Research?. The SAGE Handbook of Qualitative Research. Edited by: Denzin NK, Lincoln YS. 2011, Sage Publications, Los Angeles, 401-414. 4 Morse JM: What Is Qualitative Health Research?. The SAGE Handbook of Qualitative Research. Edited by: Denzin NK, Lincoln YS. 2011, Sage Publications, Los Angeles, 401-414. 4
33.
go back to reference Nastasi BK, Berg MJ: Chapter 1, Using Ethnography to Strengthen and Evaluate Intervention Programs. Using Ethnographic Data: Interventions, Public Programming, and Public Policy. Edited by: Schensul JJ, LeCompte MD, Hess A Jr, Nastasi BK, Berg MJ, Williamson L, Brecher J, Glasser R. 1999, Altamira Press, Walnut Creek, CA, 1-49. Nastasi BK, Berg MJ: Chapter 1, Using Ethnography to Strengthen and Evaluate Intervention Programs. Using Ethnographic Data: Interventions, Public Programming, and Public Policy. Edited by: Schensul JJ, LeCompte MD, Hess A Jr, Nastasi BK, Berg MJ, Williamson L, Brecher J, Glasser R. 1999, Altamira Press, Walnut Creek, CA, 1-49.
34.
go back to reference Lincoln YS, Guba EG: Naturalistic Inquiry. 1985, SAGE Publications, Newbury Park, CA Lincoln YS, Guba EG: Naturalistic Inquiry. 1985, SAGE Publications, Newbury Park, CA
35.
go back to reference Borkan J: Immersion/Crystallization. Doing Qualitative Research, Second Edition edition. Edited by: Crabtree BF, Miller WL. 2014, Sage Publications, Thousand Oaks, CA, 179-194. Borkan J: Immersion/Crystallization. Doing Qualitative Research, Second Edition edition. Edited by: Crabtree BF, Miller WL. 2014, Sage Publications, Thousand Oaks, CA, 179-194.
36.
go back to reference Bradley EH, Curry LA, Devers KJ: Qualitative data analysis for health services research: developing taxonomy, themes, and theory. Health Serv Res. 2007, 42: 1758-1772. 10.1111/j.1475-6773.2006.00684.x.CrossRefPubMedPubMedCentral Bradley EH, Curry LA, Devers KJ: Qualitative data analysis for health services research: developing taxonomy, themes, and theory. Health Serv Res. 2007, 42: 1758-1772. 10.1111/j.1475-6773.2006.00684.x.CrossRefPubMedPubMedCentral
37.
go back to reference Krueger RA: Analyzing and Reporting Focus Group Results. Focus Group Kit 6. 1998, Sage Publications, Thousand Oaks, CACrossRef Krueger RA: Analyzing and Reporting Focus Group Results. Focus Group Kit 6. 1998, Sage Publications, Thousand Oaks, CACrossRef
38.
go back to reference LeCompte MD, Schensul JJ: Analyzing & Interpreting Ethnographic Data. Ethnographer’s Toolkit 5. 1999, AltaMira Press, Walnut Creek, CA LeCompte MD, Schensul JJ: Analyzing & Interpreting Ethnographic Data. Ethnographer’s Toolkit 5. 1999, AltaMira Press, Walnut Creek, CA
39.
go back to reference Miller WL, Crabtree BF: The Dance of Interpretation. Doing Qualitative Research. Edited by: Crabtree BF, Miller WL. 1999, Sage Publications, Thousand Oaks, CA, 127-143. 2 Miller WL, Crabtree BF: The Dance of Interpretation. Doing Qualitative Research. Edited by: Crabtree BF, Miller WL. 1999, Sage Publications, Thousand Oaks, CA, 127-143. 2
40.
go back to reference Guest G, Bunce A, Johnson L: How many interviews Are enough? an experiment with data saturation and variability. Field Methods. 2006, 18: 59-82. 10.1177/1525822X05279903.CrossRef Guest G, Bunce A, Johnson L: How many interviews Are enough? an experiment with data saturation and variability. Field Methods. 2006, 18: 59-82. 10.1177/1525822X05279903.CrossRef
41.
go back to reference Cohen DJ, Leviton LC, Isaacson N, Tallia AF, Crabtree BF: Online diaries for qualitative evaluation: gaining real-time insights. Am J Eval. 2006, 27: 163-184. 10.1177/1098214006288448.CrossRef Cohen DJ, Leviton LC, Isaacson N, Tallia AF, Crabtree BF: Online diaries for qualitative evaluation: gaining real-time insights. Am J Eval. 2006, 27: 163-184. 10.1177/1098214006288448.CrossRef
42.
go back to reference Davis K: A method of studying communication patterns in organizations. Pers Psychol. 1953, 6: 301-312. 10.1111/j.1744-6570.1953.tb01499.x.CrossRef Davis K: A method of studying communication patterns in organizations. Pers Psychol. 1953, 6: 301-312. 10.1111/j.1744-6570.1953.tb01499.x.CrossRef
43.
go back to reference Hargie O, Tourish D: Handbook of Communication Audits for Organisations. 2000, Routledge, Oxford, UK Hargie O, Tourish D: Handbook of Communication Audits for Organisations. 2000, Routledge, Oxford, UK
44.
go back to reference Centers for Medicare & Medicaid Services: Meaningful Use. Centers for Medicare & Medicaid Services; 2013. 12-20-2013., [http://www.cms.gov/Regulations-and-Guidance/Legislation/EHRIncentivePrograms/Meaningful_Use.html] Centers for Medicare & Medicaid Services: Meaningful Use. Centers for Medicare & Medicaid Services; 2013. 12-20-2013., [http://​www.​cms.​gov/​Regulations-and-Guidance/​Legislation/​EHRIncentiveProg​rams/​Meaningful_​Use.​html]
46.
go back to reference Morgan DL, Krueger RA: The Focus Group Kit, vols 1–6. 1997, SAGE Publications, Thousand Oaks, CA Morgan DL, Krueger RA: The Focus Group Kit, vols 1–6. 1997, SAGE Publications, Thousand Oaks, CA
47.
go back to reference Beebe J: Rapid Assessment Process: An Introduction. 2001, Altamira Press, Walnut Creek, CA Beebe J: Rapid Assessment Process: An Introduction. 2001, Altamira Press, Walnut Creek, CA
48.
go back to reference McMullen CK, Ash JS, Sittig DF, Bunce A, Guappone K, Dykstra R, Carpenter J, Richardson J, Wright A: Rapid assessment of clinical information systems in the healthcare setting: an efficient method for time-pressed evaluation. Methods Inf Med. 2011, 50: 299-307. 10.3414/ME10-01-0042.CrossRefPubMed McMullen CK, Ash JS, Sittig DF, Bunce A, Guappone K, Dykstra R, Carpenter J, Richardson J, Wright A: Rapid assessment of clinical information systems in the healthcare setting: an efficient method for time-pressed evaluation. Methods Inf Med. 2011, 50: 299-307. 10.3414/ME10-01-0042.CrossRefPubMed
49.
go back to reference Spradley JP: Participant Observation. 1980, Holt, Rinehart and Winston Spradley JP: Participant Observation. 1980, Holt, Rinehart and Winston
50.
go back to reference Butler MO: Translating evaluation anthropology. NAPA Bulletin. 2005, 24: 17-30. 10.1525/napa.2005.24.1.017.CrossRef Butler MO: Translating evaluation anthropology. NAPA Bulletin. 2005, 24: 17-30. 10.1525/napa.2005.24.1.017.CrossRef
51.
go back to reference Spector PE: Social Desirability Bias. The SAGE Encyclopedia of Social Science Research Methods. Edited by: Lewis-Beck MS, Bryman A, Futing T. 2004, SAGE Publication, Thousand Oaks, CA Spector PE: Social Desirability Bias. The SAGE Encyclopedia of Social Science Research Methods. Edited by: Lewis-Beck MS, Bryman A, Futing T. 2004, SAGE Publication, Thousand Oaks, CA
Metadata
Title
Ethnographic process evaluation in primary care: explaining the complexity of implementation
Authors
Arwen E Bunce
Rachel Gold
James V Davis
Carmit K McMullen
Victoria Jaworski
MaryBeth Mercer
Christine Nelson
Publication date
01-12-2014
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2014
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-014-0607-0

Other articles of this Issue 1/2014

BMC Health Services Research 1/2014 Go to the issue