Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2013

Open Access 01-12-2013 | Research article

Making sense of complex data: a mapping process for analyzing findings of a realist review on guideline implementability

Authors: Monika Kastner, Julie Makarski, Leigh Hayden, Lisa Durocher, Ananda Chatterjee, Melissa Brouwers, Onil Bhattacharyya

Published in: BMC Medical Research Methodology | Issue 1/2013

Login to get access

Abstract

Background

Realist reviews offer a rigorous method to analyze heterogeneous data emerging from multiple disciplines as a means to develop new concepts, understand the relationships between them, and identify the evidentiary base underpinning them. However, emerging synthesis methods such as the Realist Review are not well operationalized and may be difficult for the novice researcher to grasp. The objective of this paper is to describe the development of an analytic process to organize and synthesize data from a realist review.

Methods

Clinical practice guidelines have had an inconsistent and modest impact on clinical practice, which may in part be due to limitations in their design. This study illustrates the development of a transparent method for organizing and analyzing a complex data set informed by a Realist Review on guideline implementability to better understand the characteristics of guidelines that affect their uptake in practice (e.g., clarity, format). The data organization method consisted of 4 levels of refinement: 1) extraction and 2) organization of data; 3) creation of a conceptual map of guideline implementability; and 4) the development of a codebook of definitions.

Results

This new method is comprised of four steps: data extraction, data organization, development of a conceptual map, and operationalization vis-a-vis a codebook. Applying this method, we extracted 1736 guideline attributes from 278 articles into a consensus-based set of categories, and collapsed them into 5 core conceptual domains for our guideline implementability map: Language, Format, Rigor of development, Feasibility, Decision-making.

Conclusions

This study advances analysis methods by offering a systematic approach to analyzing complex data sets where the goals are to condense, organize and identify relationships.
Appendix
Available only for authorised users
Literature
1.
go back to reference Grimshaw J, Eccles MP: Is evidence-based implementation of evidence-based care possible?. Med J Aust. 2006, 180: S50-S51. Grimshaw J, Eccles MP: Is evidence-based implementation of evidence-based care possible?. Med J Aust. 2006, 180: S50-S51.
2.
go back to reference Pawson R, Greenhalgh T, Harvey G, Walshe K: Realist review-a new method of systematic review designed for complex policy interventions. J Health Serv Res. 2005, 19 (Suppl1): S21-S34. PolicyCrossRef Pawson R, Greenhalgh T, Harvey G, Walshe K: Realist review-a new method of systematic review designed for complex policy interventions. J Health Serv Res. 2005, 19 (Suppl1): S21-S34. PolicyCrossRef
3.
go back to reference Wong G, Greenhalgh T, Pawson R: Internet-based medical education: a realist review of what works, for whom and in what circumstances. BMC Med Edu. 2010, 10: 12-10.1186/1472-6920-10-12.CrossRef Wong G, Greenhalgh T, Pawson R: Internet-based medical education: a realist review of what works, for whom and in what circumstances. BMC Med Edu. 2010, 10: 12-10.1186/1472-6920-10-12.CrossRef
4.
go back to reference Wong G, Pawson R, Owen L: Policy guidance on threats to legislative interventions in public health: a realist review. BMC Publ Health. 2011, 11: 222-10.1186/1471-2458-11-222.CrossRef Wong G, Pawson R, Owen L: Policy guidance on threats to legislative interventions in public health: a realist review. BMC Publ Health. 2011, 11: 222-10.1186/1471-2458-11-222.CrossRef
5.
go back to reference Rycroft-Malone JMB, Hutchinson AM, DeCorby K, Bucknall TK, Kent B, Schultz A, Snelgrove-Clarke E, Stetler CB, Titler M, Wallin L, Wilson V: Realist synthesis: illustrating the method for implementation research. Implement Sci. 2012, 7 (7): 33-CrossRefPubMedPubMedCentral Rycroft-Malone JMB, Hutchinson AM, DeCorby K, Bucknall TK, Kent B, Schultz A, Snelgrove-Clarke E, Stetler CB, Titler M, Wallin L, Wilson V: Realist synthesis: illustrating the method for implementation research. Implement Sci. 2012, 7 (7): 33-CrossRefPubMedPubMedCentral
6.
go back to reference Greenhalgh T, Peacock R: Effectiveness and efficiency of search methods in systematic reviews of complex evidence: audit of primary sources. BMJ. 2005, 331: 1064-1065. 10.1136/bmj.38636.593461.68.CrossRefPubMedPubMedCentral Greenhalgh T, Peacock R: Effectiveness and efficiency of search methods in systematic reviews of complex evidence: audit of primary sources. BMJ. 2005, 331: 1064-1065. 10.1136/bmj.38636.593461.68.CrossRefPubMedPubMedCentral
7.
8.
go back to reference Rycroft-Malone J, Fontenla M, Bick D, Seers K: A realistic evaluation: the case of protocol-based care. Implement Sci. 2010, 5: 38-10.1186/1748-5908-5-38.CrossRefPubMedPubMedCentral Rycroft-Malone J, Fontenla M, Bick D, Seers K: A realistic evaluation: the case of protocol-based care. Implement Sci. 2010, 5: 38-10.1186/1748-5908-5-38.CrossRefPubMedPubMedCentral
9.
go back to reference Kendall E, Sunderland N, Muencheberger H, Armstrong K: When guidelines need guideance: considerations and strategies for improving the adoption of chronic disease evidence by general practitioners. J Eval Clin Prac. 2009, 15: 1082-1090. 10.1111/j.1365-2753.2009.01147.x.CrossRef Kendall E, Sunderland N, Muencheberger H, Armstrong K: When guidelines need guideance: considerations and strategies for improving the adoption of chronic disease evidence by general practitioners. J Eval Clin Prac. 2009, 15: 1082-1090. 10.1111/j.1365-2753.2009.01147.x.CrossRef
10.
go back to reference Brown LC, Johnson JA, Majumdar SR, et al: Evidence of suboptimal management of cardiovascular risk in patients with type 2 diabetes mellitus and symptomatic atherosclerosis. CMAJ. 2004, 171 (10): 1189-1192. 10.1503/cmaj.1031965.CrossRefPubMedPubMedCentral Brown LC, Johnson JA, Majumdar SR, et al: Evidence of suboptimal management of cardiovascular risk in patients with type 2 diabetes mellitus and symptomatic atherosclerosis. CMAJ. 2004, 171 (10): 1189-1192. 10.1503/cmaj.1031965.CrossRefPubMedPubMedCentral
11.
go back to reference Grimshaw J, Russell I: Achieving health gain through clinical guidelines I: Developing scientifically valid guidelines. Qual Health Care. 1993, 2: 243-248. 10.1136/qshc.2.4.243.CrossRefPubMedPubMedCentral Grimshaw J, Russell I: Achieving health gain through clinical guidelines I: Developing scientifically valid guidelines. Qual Health Care. 1993, 2: 243-248. 10.1136/qshc.2.4.243.CrossRefPubMedPubMedCentral
14.
go back to reference Kastner M, Estey E, Perrier L, et al: Understanding the relationship between the perceived characteristics of clinical practice guidelines and their uptake: protocol for a realist review. Impl Sci. 2011, 6: 69-10.1186/1748-5908-6-69.CrossRef Kastner M, Estey E, Perrier L, et al: Understanding the relationship between the perceived characteristics of clinical practice guidelines and their uptake: protocol for a realist review. Impl Sci. 2011, 6: 69-10.1186/1748-5908-6-69.CrossRef
15.
go back to reference Eppler MJ, Mengis J: Drawing Distinction: The Visualization of Classification in Qualitative Research. =mcm working paper, No. 2/2011, July 2011. 2011, St. Gallen: =mcm institute, University of St. Gallen, Retrieved online at: http://www.knowledge-communication.org Eppler MJ, Mengis J: Drawing Distinction: The Visualization of Classification in Qualitative Research. =mcm working paper, No. 2/2011, July 2011. 2011, St. Gallen: =mcm institute, University of St. Gallen, Retrieved online at: http://​www.​knowledge-communication.​org
16.
go back to reference Greenhalgh T, Robert G, Macfarlane F, et al: Storylines of research in diffusion of innovation: a meta-narrative approach to systematic review. Soc Sci & Med. 2005, 61: 417-430. 10.1016/j.socscimed.2004.12.001.CrossRef Greenhalgh T, Robert G, Macfarlane F, et al: Storylines of research in diffusion of innovation: a meta-narrative approach to systematic review. Soc Sci & Med. 2005, 61: 417-430. 10.1016/j.socscimed.2004.12.001.CrossRef
17.
go back to reference Noblit GW, Hare RD: Meta-ethnography: synthesizing qualitative studies. 1988, Newbury Park, California: SageCrossRef Noblit GW, Hare RD: Meta-ethnography: synthesizing qualitative studies. 1988, Newbury Park, California: SageCrossRef
18.
go back to reference Kastner M, Tricco AC, Straus SE: How can we make sense of Cochrane reviews of complex interventions? Consideration of 3 complementary synthesis methods (realist review, meta-narrative, meta-ethnography) to better understand the “how” and “why” of findings. 2011, Vancouver, BC: Canadian Cochrane Symposium 2011 Kastner M, Tricco AC, Straus SE: How can we make sense of Cochrane reviews of complex interventions? Consideration of 3 complementary synthesis methods (realist review, meta-narrative, meta-ethnography) to better understand the “how” and “why” of findings. 2011, Vancouver, BC: Canadian Cochrane Symposium 2011
Metadata
Title
Making sense of complex data: a mapping process for analyzing findings of a realist review on guideline implementability
Authors
Monika Kastner
Julie Makarski
Leigh Hayden
Lisa Durocher
Ananda Chatterjee
Melissa Brouwers
Onil Bhattacharyya
Publication date
01-12-2013
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2013
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-13-112

Other articles of this Issue 1/2013

BMC Medical Research Methodology 1/2013 Go to the issue