Skip to main content
Top
Published in: Systematic Reviews 1/2016

Open Access 01-12-2016 | Research

What is an evidence map? A systematic review of published evidence maps and their definitions, methods, and products

Authors: Isomi M. Miake-Lye, Susanne Hempel, Roberta Shanman, Paul G. Shekelle

Published in: Systematic Reviews | Issue 1/2016

Login to get access

Abstract

Background

The need for systematic methods for reviewing evidence is continuously increasing. Evidence mapping is one emerging method. There are no authoritative recommendations for what constitutes an evidence map or what methods should be used, and anecdotal evidence suggests heterogeneity in both. Our objectives are to identify published evidence maps and to compare and contrast the presented definitions of evidence mapping, the domains used to classify data in evidence maps, and the form the evidence map takes.

Methods

We conducted a systematic review of publications that presented results with a process termed “evidence mapping” or included a figure called an “evidence map.” We identified publications from searches of ten databases through 8/21/2015, reference mining, and consulting topic experts. We abstracted the research question, the unit of analysis, the search methods and search period covered, and the country of origin. Data were narratively synthesized.

Results

Thirty-nine publications met inclusion criteria. Published evidence maps varied in their definition and the form of the evidence map. Of the 31 definitions provided, 67 % described the purpose as identification of gaps and 58 % referenced a stakeholder engagement process or user-friendly product. All evidence maps explicitly used a systematic approach to evidence synthesis. Twenty-six publications referred to a figure or table explicitly called an “evidence map,” eight referred to an online database as the evidence map, and five stated they used a mapping methodology but did not present a visual depiction of the evidence.

Conclusions

The principal conclusion of our evaluation of studies that call themselves “evidence maps” is that the implied definition of what constitutes an evidence map is a systematic search of a broad field to identify gaps in knowledge and/or future research needs that presents results in a user-friendly format, often a visual figure or graph, or a searchable database. Foundational work is needed to better standardize the methods and products of an evidence map so that researchers and policymakers will know what to expect of this new type of evidence review.

Systematic review registration

Although an a priori protocol was developed, no registration was completed; this review did not fit the PROSPERO format.
Appendix
Available only for authorised users
Literature
1.
3.
go back to reference Colquhoun HL, Levac D, O'Brien KK, Straus S, Tricco AC, Perrier L, et al. Scoping reviews: time for clarity in definition, methods, and reporting. J Clin Epidemiol. 2014;67(12):1291–4.CrossRefPubMed Colquhoun HL, Levac D, O'Brien KK, Straus S, Tricco AC, Perrier L, et al. Scoping reviews: time for clarity in definition, methods, and reporting. J Clin Epidemiol. 2014;67(12):1291–4.CrossRefPubMed
4.
go back to reference Pawson R, Greenhalgh T, Harvey G, Walshe K. Realist review–a new method of systematic review designed for complex policy interventions. J Health Serv Res Policy. 2005;10 suppl 1:21–34.CrossRefPubMed Pawson R, Greenhalgh T, Harvey G, Walshe K. Realist review–a new method of systematic review designed for complex policy interventions. J Health Serv Res Policy. 2005;10 suppl 1:21–34.CrossRefPubMed
5.
go back to reference Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med. 2009;151(4):264–9.CrossRefPubMed Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med. 2009;151(4):264–9.CrossRefPubMed
9.
go back to reference Khangura S, Konnyu K, Cushman R, Grimshaw J, Moher D. Evidence summaries: the evolution of a rapid review approach. Syst Rev. 2012;1(1):1–9.CrossRef Khangura S, Konnyu K, Cushman R, Grimshaw J, Moher D. Evidence summaries: the evolution of a rapid review approach. Syst Rev. 2012;1(1):1–9.CrossRef
10.
go back to reference Polisena J, Garritty C, Kamel C, Stevens A, Abou-Setta AM. Rapid review programs to support health care and policy decision making: a descriptive analysis of processes and methods. Syst Rev. 2015;4(1):1–7.CrossRef Polisena J, Garritty C, Kamel C, Stevens A, Abou-Setta AM. Rapid review programs to support health care and policy decision making: a descriptive analysis of processes and methods. Syst Rev. 2015;4(1):1–7.CrossRef
11.
go back to reference Varker T, Forbes D, Dell L, Weston A, Merlin T, Hodson S, et al. Rapid evidence assessment: increasing the transparency of an emerging methodology. J Eval Clin Pract. 2015. Varker T, Forbes D, Dell L, Weston A, Merlin T, Hodson S, et al. Rapid evidence assessment: increasing the transparency of an emerging methodology. J Eval Clin Pract. 2015.
13.
go back to reference Harker J, Kleijnen J. What is a rapid review? A methodological exploration of rapid reviews in Health Technology Assessments. Int J Evid‐Based Healthc. 2012;10(4):397–410.CrossRefPubMed Harker J, Kleijnen J. What is a rapid review? A methodological exploration of rapid reviews in Health Technology Assessments. Int J Evid‐Based Healthc. 2012;10(4):397–410.CrossRefPubMed
15.
go back to reference Snilstveit B, Vojtkova M, Bhavsar A, Gaarder M. Evidence gap maps—a tool for promoting evidence-informed policy and prioritizing future research. 2013.CrossRef Snilstveit B, Vojtkova M, Bhavsar A, Gaarder M. Evidence gap maps—a tool for promoting evidence-informed policy and prioritizing future research. 2013.CrossRef
18.
go back to reference Katz DL, Williams AL, Girard C, Goodman J, Comerford B, Behrman A, et al. The evidence base for complementary and alternative medicine: methods of evidence mapping with application to CAM. Altern Ther Health Med. 2003;9(4):22–30.PubMed Katz DL, Williams AL, Girard C, Goodman J, Comerford B, Behrman A, et al. The evidence base for complementary and alternative medicine: methods of evidence mapping with application to CAM. Altern Ther Health Med. 2003;9(4):22–30.PubMed
19.
go back to reference Costello LA, Lithander FE, Gruen RL, Williams LT. Nutrition therapy in the optimisation of health outcomes in adult patients with moderate to severe traumatic brain injury: findings from a scoping review. Injury. 2014. doi:10.1016/j.injury.2014.06.004.PubMed Costello LA, Lithander FE, Gruen RL, Williams LT. Nutrition therapy in the optimisation of health outcomes in adult patients with moderate to severe traumatic brain injury: findings from a scoping review. Injury. 2014. doi:10.​1016/​j.​injury.​2014.​06.​004.PubMed
23.
go back to reference John BE. Evidence-based practice in human-computer interaction and evidence maps. Proceedings of the 2005 workshop on Realising evidence-based software engineering. St. Louis, Missouri: ACM; 2005:1–5. John BE. Evidence-based practice in human-computer interaction and evidence maps. Proceedings of the 2005 workshop on Realising evidence-based software engineering. St. Louis, Missouri: ACM; 2005:1–5.
25.
go back to reference Chorpita BF, Daleiden EL. Mapping evidence-based treatments for children and adolescents: application of the distillation and matching model to 615 treatments from 322 randomized trials. J Consult Clin Psychol. 2009;77(3):566–79. doi:10.1037/a0014565.CrossRefPubMed Chorpita BF, Daleiden EL. Mapping evidence-based treatments for children and adolescents: application of the distillation and matching model to 615 treatments from 322 randomized trials. J Consult Clin Psychol. 2009;77(3):566–79. doi:10.​1037/​a0014565.CrossRefPubMed
26.
go back to reference Bayley MT, Teasell RW, Wolfe DL, Gruen RL, Eng JJ, Ghajar J, et al. Where to build the bridge between evidence and practice?: results of an international workshop to prioritize knowledge translation activities in traumatic brain injury care. J Head Trauma Rehabil. 2014;29(4):268–76. doi:10.1097/htr.0000000000000053.CrossRefPubMed Bayley MT, Teasell RW, Wolfe DL, Gruen RL, Eng JJ, Ghajar J, et al. Where to build the bridge between evidence and practice?: results of an international workshop to prioritize knowledge translation activities in traumatic brain injury care. J Head Trauma Rehabil. 2014;29(4):268–76. doi:10.​1097/​htr.​0000000000000053​.CrossRefPubMed
27.
go back to reference Scott J. What interventions can be used in high risk offspring? An evidence map of currently available therapies, and their potential for preventing disease onset or progression. Int J Neuropsychopharmacol. 2014;17:14. Scott J. What interventions can be used in high risk offspring? An evidence map of currently available therapies, and their potential for preventing disease onset or progression. Int J Neuropsychopharmacol. 2014;17:14.
28.
go back to reference Clavisi O, Gruen R, Bragge P, Tavender E. A systematic method of identifying and prioritising research questions. Oral presentation at the 16th Cochrane Colloquium: Evidence in the era of globalisation; 2008 Oct 3–7; Freiburg, Germany [abstract]. Zeitschrift fur Evidenz, Fortbildung und Qualitat im Gesundheitswesen 2008. Clavisi O, Gruen R, Bragge P, Tavender E. A systematic method of identifying and prioritising research questions. Oral presentation at the 16th Cochrane Colloquium: Evidence in the era of globalisation; 2008 Oct 3–7; Freiburg, Germany [abstract]. Zeitschrift fur Evidenz, Fortbildung und Qualitat im Gesundheitswesen 2008.
29.
go back to reference Liu P, Parker A, Hetrick S, Purcell R. Evidence mapping for early psychotic disorders in young people. Schizophr Res. 2010;117(2–3):438–9.CrossRef Liu P, Parker A, Hetrick S, Purcell R. Evidence mapping for early psychotic disorders in young people. Schizophr Res. 2010;117(2–3):438–9.CrossRef
30.
go back to reference Voigt-Radloff S, Ruf G, Vogel A, van Nes F, Hull M. Occupational therapy for elderly: evidence mapping of randomised controlled trials from 2004–2012. Z Gerontol Geriatr. 2013. doi:10.1007/s00391-013-0540-6. Voigt-Radloff S, Ruf G, Vogel A, van Nes F, Hull M. Occupational therapy for elderly: evidence mapping of randomised controlled trials from 2004–2012. Z Gerontol Geriatr. 2013. doi:10.​1007/​s00391-013-0540-6.
32.
go back to reference Wysocki A, Butler M, Shamliyan T, Kane RL. Whole-body vibration therapy for osteoporosis. 2011. Rockville MD. Wysocki A, Butler M, Shamliyan T, Kane RL. Whole-body vibration therapy for osteoporosis. 2011. Rockville MD.
33.
go back to reference Curran C, Burchardt T, Knapp M, McDaid D, Li B. Challenges in multidisciplinary systematic reviewing: a study on social exclusion and mental health policy. Social Policy Adm. 2007;41(3):289–312.CrossRef Curran C, Burchardt T, Knapp M, McDaid D, Li B. Challenges in multidisciplinary systematic reviewing: a study on social exclusion and mental health policy. Social Policy Adm. 2007;41(3):289–312.CrossRef
34.
go back to reference Frampton GK, Harris P, Cooper K, Cooper T, Cleland J, Jones J, et al. Educational interventions for preventing vascular catheter bloodstream infections in critical care: evidence map, systematic review and economic evaluation. Health Technol Assess. 2014;18(15):1–365. doi:10.3310/hta18150.CrossRef Frampton GK, Harris P, Cooper K, Cooper T, Cleland J, Jones J, et al. Educational interventions for preventing vascular catheter bloodstream infections in critical care: evidence map, systematic review and economic evaluation. Health Technol Assess. 2014;18(15):1–365. doi:10.​3310/​hta18150.CrossRef
35.
go back to reference Althuis MD, Weed DL. Evidence mapping: methodologic foundations and application to intervention and observational research on sugar-sweetened beverages and health outcomes. Am J Clin Nutr. 2013;98(3):755–68. doi:10.3945/ajcn.113.058917.CrossRefPubMed Althuis MD, Weed DL. Evidence mapping: methodologic foundations and application to intervention and observational research on sugar-sweetened beverages and health outcomes. Am J Clin Nutr. 2013;98(3):755–68. doi:10.​3945/​ajcn.​113.​058917.CrossRefPubMed
38.
go back to reference Greer N, Brasure M, Wilt TJ. Wheeled mobility (wheelchair) service delivery. 2012. Rockville MD. Greer N, Brasure M, Wilt TJ. Wheeled mobility (wheelchair) service delivery. 2012. Rockville MD.
39.
go back to reference Chung M, Dahabreh IJ, Hadar N, Ratichek SJ, Gaylor JM, Trikalinos TA, et al. Emerging MRI Technologies for Imaging Musculoskeletal Disorders Under Loading Stress [Internet]. Rockville (MD): Agency for Healthcare Research and Quality (US); 2011. http://www.ncbi.nlm.nih.gov/books/NBK82287/. Accessed 9 February 2016. Chung M, Dahabreh IJ, Hadar N, Ratichek SJ, Gaylor JM, Trikalinos TA, et al. Emerging MRI Technologies for Imaging Musculoskeletal Disorders Under Loading Stress [Internet]. Rockville (MD): Agency for Healthcare Research and Quality (US); 2011. http://​www.​ncbi.​nlm.​nih.​gov/​books/​NBK82287/​. Accessed 9 February 2016.
45.
go back to reference Berger S, Wang D, Sackey J, Brown C, Chung M. Sugars and health: Applying evidence mapping techniques to assess the evidence. FASEB Journal. 2014;28(1):Supplement 630.10. Berger S, Wang D, Sackey J, Brown C, Chung M. Sugars and health: Applying evidence mapping techniques to assess the evidence. FASEB Journal. 2014;28(1):Supplement 630.10.
46.
go back to reference Bonell C, Jamal F, Harden A, Wells H, Parry W, Fletcher A et al. Public Health Research. Systematic review of the effects of schools and school environment interventions on health: evidence mapping and synthesis. Southampton (UK): NIHR Journals Library; 2013. Bonell C, Jamal F, Harden A, Wells H, Parry W, Fletcher A et al. Public Health Research. Systematic review of the effects of schools and school environment interventions on health: evidence mapping and synthesis. Southampton (UK): NIHR Journals Library; 2013.
47.
go back to reference Coast E, Leone T, Hirose A, Jones E. Poverty and postnatal depression: a systematic mapping of the evidence from low and lower middle income countries. Health Place. 2012;18(5):1188–97.CrossRefPubMed Coast E, Leone T, Hirose A, Jones E. Poverty and postnatal depression: a systematic mapping of the evidence from low and lower middle income countries. Health Place. 2012;18(5):1188–97.CrossRefPubMed
48.
go back to reference Coeytaux RR, McDuffie J, Goode A, Cassel S, Porter WD, Sharma P, et al. Evidence map of yoga for high-impact conditions affecting veterans. Washington (DC): Department of Veterans Affairs (US); 2014. Coeytaux RR, McDuffie J, Goode A, Cassel S, Porter WD, Sharma P, et al. Evidence map of yoga for high-impact conditions affecting veterans. Washington (DC): Department of Veterans Affairs (US); 2014.
51.
go back to reference Hempel S, Taylor SL, Marshall NJ, Miake-Lye IM, Beroes JM, Shanman R, et al. Evidence map of mindfulness. VA evidence-based synthesis program reports. Washington (DC): Department of Veterans Affairs (US); 2014. Hempel S, Taylor SL, Marshall NJ, Miake-Lye IM, Beroes JM, Shanman R, et al. Evidence map of mindfulness. VA evidence-based synthesis program reports. Washington (DC): Department of Veterans Affairs (US); 2014.
52.
go back to reference Hempel S, Taylor SL, Solloway MR, Miake-Lye IM, Beroes JM, Shanman R, et al. Evidence map of Tai Chi. Washington (DC): Department of Veterans Affairs (US); 2014. Hempel S, Taylor SL, Solloway MR, Miake-Lye IM, Beroes JM, Shanman R, et al. Evidence map of Tai Chi. Washington (DC): Department of Veterans Affairs (US); 2014.
53.
go back to reference Hitch D. Better access to mental health: mapping the evidence supporting participation in meaningful occupations. Advances in Mental Health. 2012;10(2):181–9.CrossRef Hitch D. Better access to mental health: mapping the evidence supporting participation in meaningful occupations. Advances in Mental Health. 2012;10(2):181–9.CrossRef
55.
go back to reference Northway R, Davies R, Jenkins R, Mansell I. Evidencing good practice in adult protection: informing the protection of people with learning disabilities from abuse. J Adult Prot. 2005;7(2):28–36.CrossRef Northway R, Davies R, Jenkins R, Mansell I. Evidencing good practice in adult protection: informing the protection of people with learning disabilities from abuse. J Adult Prot. 2005;7(2):28–36.CrossRef
56.
go back to reference Sawicki C, Livingston K, Obin M, Roberts S, Chung M, McKeown N. Dietary fiber and the human gut microbiome: application of evidence mapping methodology. FASEB Journal. 2015;29(1):Supplement 736.27. Sawicki C, Livingston K, Obin M, Roberts S, Chung M, McKeown N. Dietary fiber and the human gut microbiome: application of evidence mapping methodology. FASEB Journal. 2015;29(1):Supplement 736.27.
57.
go back to reference Singh K, Ansari M, Galipeau J, Garritty C, Keely E, Malcolm J, et al. An evidence map of systematic reviews to inform interventions in prediabetes. Can J Diabetes. 2012;36(5):281–91.CrossRef Singh K, Ansari M, Galipeau J, Garritty C, Keely E, Malcolm J, et al. An evidence map of systematic reviews to inform interventions in prediabetes. Can J Diabetes. 2012;36(5):281–91.CrossRef
58.
go back to reference Taylor S, Hempel S, Solloway M, Miake-Lye I, Beroes J, Shekelle P. An evidence map of the effects of acupuncture. J Altern Complement Med. 2014;20(5):A91–2.CrossRef Taylor S, Hempel S, Solloway M, Miake-Lye I, Beroes J, Shekelle P. An evidence map of the effects of acupuncture. J Altern Complement Med. 2014;20(5):A91–2.CrossRef
59.
go back to reference Vallarino M, Henry C, Etain B, Gehue LJ, Macneil C, Scott EM, et al. An evidence map of psychosocial interventions for the earliest stages of bipolar disorder. Lancet Psychiatry. 2015;2(6):548–63.CrossRefPubMedPubMedCentral Vallarino M, Henry C, Etain B, Gehue LJ, Macneil C, Scott EM, et al. An evidence map of psychosocial interventions for the earliest stages of bipolar disorder. Lancet Psychiatry. 2015;2(6):548–63.CrossRefPubMedPubMedCentral
60.
go back to reference Wang DD, Shams-White M, Bright OJ, Chung M. Low-calorie sweeteners and health. FASEB Journal. 2015;29(1):Supplement 587.12. Wang DD, Shams-White M, Bright OJ, Chung M. Low-calorie sweeteners and health. FASEB Journal. 2015;29(1):Supplement 587.12.
61.
64.
go back to reference Bragge P, Chau M, Pitt VJ, Bayley MT, Eng JJ, Teasell RW, et al. An overview of published research about the acute care and rehabilitation of traumatic brain injured and spinal cord injured patients. J Neurotrauma. 2012;29(8):1539–47. doi:10.1089/neu.2011.2193.CrossRefPubMed Bragge P, Chau M, Pitt VJ, Bayley MT, Eng JJ, Teasell RW, et al. An overview of published research about the acute care and rehabilitation of traumatic brain injured and spinal cord injured patients. J Neurotrauma. 2012;29(8):1539–47. doi:10.​1089/​neu.​2011.​2193.CrossRefPubMed
67.
go back to reference Arksey H, O'Malley L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol. 2005;8(1):19–32.CrossRef Arksey H, O'Malley L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol. 2005;8(1):19–32.CrossRef
Metadata
Title
What is an evidence map? A systematic review of published evidence maps and their definitions, methods, and products
Authors
Isomi M. Miake-Lye
Susanne Hempel
Roberta Shanman
Paul G. Shekelle
Publication date
01-12-2016
Publisher
BioMed Central
Published in
Systematic Reviews / Issue 1/2016
Electronic ISSN: 2046-4053
DOI
https://doi.org/10.1186/s13643-016-0204-x

Other articles of this Issue 1/2016

Systematic Reviews 1/2016 Go to the issue