Skip to main content
Top
Published in: Journal of General Internal Medicine 12/2019

01-12-2019 | Care | Review Paper

Impact of Project ECHO Models of Medical Tele-Education: a Systematic Review

Authors: Ryan K. McBain, PhD, MPH, Jessica L. Sousa, MPH, MSW, Adam J. Rose, MD, MS, Sangita M. Baxi, MAS, Laura J. Faherty, MD, MPH, MS, Caroline Taplin, MS, Andre Chappel, PhD, Shira H. Fischer, MD, PhD

Published in: Journal of General Internal Medicine | Issue 12/2019

Login to get access

Abstract

Background

Extension for Community Healthcare Outcomes (ECHO) and related models of medical tele-education are rapidly expanding; however, their effectiveness remains unclear. This systematic review examines the effectiveness of ECHO and ECHO-like medical tele-education models of healthcare delivery in terms of improved provider- and patient-related outcomes.

Methods

We searched English-language studies in PubMed, Embase, and PsycINFO databases from 1 January 2007 to 1 December 2018 as well as bibliography review. Two reviewers independently screened citations for peer-reviewed publications reporting provider- and/or patient-related outcomes of technology-enabled collaborative learning models that satisfied six criteria of the ECHO framework. Reviewers then independently abstracted data, assessed study quality, and rated strength of evidence (SOE) based on Cochrane GRADE criteria.

Results

Data from 52 peer-reviewed articles were included. Forty-three reported provider-related outcomes; 15 reported patient-related outcomes. Studies on provider-related outcomes suggested favorable results across three domains: satisfaction, increased knowledge, and increased clinical confidence. However, SOE was low, relying primarily on self-reports and surveys with low response rates. One randomized trial has been conducted. For patient-related outcomes, 11 of 15 studies incorporated a comparison group; none involved randomization. Four studies reported care outcomes, while 11 reported changes in care processes. Evidence suggested effectiveness at improving outcomes for patients with hepatitis C, chronic pain, dementia, and type 2 diabetes. Evidence is generally low-quality, retrospective, non-experimental, and subject to social desirability bias and low survey response rates.

Discussion

The number of studies examining ECHO and ECHO-like models of medical tele-education has been modest compared with the scope and scale of implementation throughout the USA and internationally. Given the potential of ECHO to broaden access to healthcare in rural, remote, and underserved communities, more studies are needed to evaluate effectiveness. This need for evidence follows similar patterns to other service delivery models in the literature.
Appendix
Available only for authorised users
Literature
1.
go back to reference Kvedar J, Coye MJ, Everett W. Connected health: A review of technologies and strategies to improve patient care with telemedicine and telehealth. Health Affairs (Project Hope) 2014;33(2):194–9.CrossRef Kvedar J, Coye MJ, Everett W. Connected health: A review of technologies and strategies to improve patient care with telemedicine and telehealth. Health Affairs (Project Hope) 2014;33(2):194–9.CrossRef
2.
go back to reference Dorsey ER, Topol EJ. State of telehealth. N Engl J Med 2016;375(2):154–61.CrossRef Dorsey ER, Topol EJ. State of telehealth. N Engl J Med 2016;375(2):154–61.CrossRef
3.
go back to reference Alkmim MB, Figueira RM, Marcolino MS, Cardoso CS, Abreu MPD, Cunha LR, et al. Improving patient access to specialized health care: The Telehealth Network of Minas Gerais, Brazil. Bull World Health Organ 2012;90:373–8.CrossRef Alkmim MB, Figueira RM, Marcolino MS, Cardoso CS, Abreu MPD, Cunha LR, et al. Improving patient access to specialized health care: The Telehealth Network of Minas Gerais, Brazil. Bull World Health Organ 2012;90:373–8.CrossRef
5.
go back to reference Ricketts TC. The migration of physicians and the local supply of practitioners: a five-year comparison. Acad Med 2013;88(12):1913–8.CrossRef Ricketts TC. The migration of physicians and the local supply of practitioners: a five-year comparison. Acad Med 2013;88(12):1913–8.CrossRef
6.
go back to reference Liddy C, Rowan MS, Afkham A, Maranger J, Keely E. Building access to specialist care through e-consultation. Open Med 2013;7(1):e1.PubMedPubMedCentral Liddy C, Rowan MS, Afkham A, Maranger J, Keely E. Building access to specialist care through e-consultation. Open Med 2013;7(1):e1.PubMedPubMedCentral
8.
go back to reference Kinfu Y, Dal Poz MR, Mercer H, Evans DB. The health worker shortage in Africa: Are enough physicians and nurses being trained? : SciELO Public Health; 2009. Kinfu Y, Dal Poz MR, Mercer H, Evans DB. The health worker shortage in Africa: Are enough physicians and nurses being trained? : SciELO Public Health; 2009.
9.
go back to reference ECHO Act, Pub L No. 114–270, 130 Stat 1395 (2016). ECHO Act, Pub L No. 114–270, 130 Stat 1395 (2016).
14.
go back to reference Moher D, Liberati A, Tetzlaff J, Altman DG, PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. Ann Intern Med 2009;151(4):264–9.CrossRef Moher D, Liberati A, Tetzlaff J, Altman DG, PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. Ann Intern Med 2009;151(4):264–9.CrossRef
19.
go back to reference Beste LA, Mattox EA, Pichler R, Young BA, Au DH, Kirsh SF, et al. Primary care team members report greater individual benefits from long- versus short-term specialty telemedicine mentorship. Telemedicine journal and e-health : the official journal of the American Telemedicine Association 2016;22(8):699–706. doi:https://doi.org/10.1089/tmj.2015.0185 CrossRef Beste LA, Mattox EA, Pichler R, Young BA, Au DH, Kirsh SF, et al. Primary care team members report greater individual benefits from long- versus short-term specialty telemedicine mentorship. Telemedicine journal and e-health : the official journal of the American Telemedicine Association 2016;22(8):699–706. doi:https://​doi.​org/​10.​1089/​tmj.​2015.​0185 CrossRef
22.
go back to reference Chaple MJ, Freese TE, Rutkowski BA, Krom L, Kurtz AS, Peck JA, Warren P, Garrett S. Using ECHO Clinics to Promote Capacity Building in Clinical Supervision. American Journal of Preventive Medicine, 54:S275-S280. 2018. Chaple MJ, Freese TE, Rutkowski BA, Krom L, Kurtz AS, Peck JA, Warren P, Garrett S. Using ECHO Clinics to Promote Capacity Building in Clinical Supervision. American Journal of Preventive Medicine, 54:S275-S280. 2018.
26.
go back to reference Eaton LH, Godfrey DS, Langford DJ, Rue T, Tauben DJ, Doorenbos AZ. Telementoring for improving primary care provider knowledge and competence in managing chronic pain: A randomised controlled trial. J Telemed Telecare. 2018:1357633x18802978. doi:https://doi.org/10.1177/1357633x18802978 Eaton LH, Godfrey DS, Langford DJ, Rue T, Tauben DJ, Doorenbos AZ. Telementoring for improving primary care provider knowledge and competence in managing chronic pain: A randomised controlled trial. J Telemed Telecare. 2018:1357633x18802978. doi:https://​doi.​org/​10.​1177/​1357633x18802978​
27.
31.
go back to reference Jansen BD, Brazil K, Passmore P, Buchanan H, Maxwell D, McIlfatrick SJ, Morgan SM, Watson M, Parsons C. Evaluation of the impact of telementoring using ECHO© technology on healthcare professionals’ knowledge and self-efficacy in assessing and managing pain for people with advanced dementia nearing the end of life. BMC Helath Services Research, 18:228. 2018. Jansen BD, Brazil K, Passmore P, Buchanan H, Maxwell D, McIlfatrick SJ, Morgan SM, Watson M, Parsons C. Evaluation of the impact of telementoring using ECHO© technology on healthcare professionals’ knowledge and self-efficacy in assessing and managing pain for people with advanced dementia nearing the end of life. BMC Helath Services Research, 18:228. 2018.
34.
go back to reference Kauth MR, Shipherd JC, Lindsay JA, Kirsh S, Knapp H, Matza L. Teleconsultation and training of VHA providers on transgender care: Implementation of a multisite hub system. Telemedicine journal and e-health : the official journal of the American Telemedicine Association. 2015;21(12):1012–8. doi:https://doi.org/10.1089/tmj.2015.0010 CrossRef Kauth MR, Shipherd JC, Lindsay JA, Kirsh S, Knapp H, Matza L. Teleconsultation and training of VHA providers on transgender care: Implementation of a multisite hub system. Telemedicine journal and e-health : the official journal of the American Telemedicine Association. 2015;21(12):1012–8. doi:https://​doi.​org/​10.​1089/​tmj.​2015.​0010 CrossRef
40.
go back to reference Mazurek MO, Brown R, Curran A, Sohl K. ECHO Autism. Clinical Pediatrics, 56: 247-256. 2017. Mazurek MO, Brown R, Curran A, Sohl K. ECHO Autism. Clinical Pediatrics, 56: 247-256. 2017.
44.
go back to reference Oliveira TC, Branquinho MJ, Goncalves L. State of the art in telemedicine - concepts, management, monitoring and evaluation of the telemedicine programme in Alentejo (Portugal). Stud Health Technol Inform 2012;179:29–37.PubMed Oliveira TC, Branquinho MJ, Goncalves L. State of the art in telemedicine - concepts, management, monitoring and evaluation of the telemedicine programme in Alentejo (Portugal). Stud Health Technol Inform 2012;179:29–37.PubMed
45.
go back to reference Parsons C, Mattox EA, Beste LA, Au DH, Young BA, Chang MF, Palen BN. Development of a Sleep Telementorship Program for Rural Department of Veterans Affairs Primary Care Providers: Sleep Veterans Affairs Extension for Community Healthcare Outcomes. Annals of American Thoracic Society, 14: 267-274. Parsons C, Mattox EA, Beste LA, Au DH, Young BA, Chang MF, Palen BN. Development of a Sleep Telementorship Program for Rural Department of Veterans Affairs Primary Care Providers: Sleep Veterans Affairs Extension for Community Healthcare Outcomes. Annals of American Thoracic Society, 14: 267-274.
49.
go back to reference Salgia RK, Mullan PB, McCurdy H, Sales A, Moseley RH, Su GL. The educational impact of the Specialty Care Access Network-Extension of Community Healthcare Outcomes program. Telemedicine Journal and E-Health, 20: 1004-8. Salgia RK, Mullan PB, McCurdy H, Sales A, Moseley RH, Su GL. The educational impact of the Specialty Care Access Network-Extension of Community Healthcare Outcomes program. Telemedicine Journal and E-Health, 20: 1004-8.
51.
go back to reference Sockalingam S, Arena A, Serhal E, Mohri L, Alloo J, Crawford A. Building Provincial Mental Health Capacity in Primary Care: An Evaluation of a Project ECHO Mental Health Program. Academic psychiatry : the journal of the American Association of Directors of Psychiatric Residency Training and the Association for Academic Psychiatry 2018;42(4):451–7. doi:https://doi.org/10.1007/s40596-017-0735-z CrossRef Sockalingam S, Arena A, Serhal E, Mohri L, Alloo J, Crawford A. Building Provincial Mental Health Capacity in Primary Care: An Evaluation of a Project ECHO Mental Health Program. Academic psychiatry : the journal of the American Association of Directors of Psychiatric Residency Training and the Association for Academic Psychiatry 2018;42(4):451–7. doi:https://​doi.​org/​10.​1007/​s40596-017-0735-z CrossRef
53.
go back to reference Van Ast P, Larson A. Supporting rural carers through telehealth. Rural Remote Health 2007;7(1):634.PubMed Van Ast P, Larson A. Supporting rural carers through telehealth. Rural Remote Health 2007;7(1):634.PubMed
54.
go back to reference Volpe T, Boydell KM, Pignatiello A. Mental health services for Nunavut children and youth: Evaluating a telepsychiatry pilot project. Rural Remote Health 2014;14(2):2673.PubMed Volpe T, Boydell KM, Pignatiello A. Mental health services for Nunavut children and youth: Evaluating a telepsychiatry pilot project. Rural Remote Health 2014;14(2):2673.PubMed
55.
go back to reference White C, McIlfatrick S, Dunwoody L, Watson M. Supporting and improving community health services--a prospective evaluation of ECHO technology in community palliative care nursing teams. BMJ Supportive & Palliative Care. 9: 202-208. White C, McIlfatrick S, Dunwoody L, Watson M. Supporting and improving community health services--a prospective evaluation of ECHO technology in community palliative care nursing teams. BMJ Supportive & Palliative Care. 9: 202-208.
57.
go back to reference Wood BR, Mann MS, Martinez-Paz N, Unruh KT, Annese M, Spach DH, Scott JD, Stekler JD. Project ECHO: telementoring to educate and support prescribing of HIV pre-exposure prophylaxis by community medical providers. Sexual Health, 15: 601-605. Wood BR, Mann MS, Martinez-Paz N, Unruh KT, Annese M, Spach DH, Scott JD, Stekler JD. Project ECHO: telementoring to educate and support prescribing of HIV pre-exposure prophylaxis by community medical providers. Sexual Health, 15: 601-605.
66.
go back to reference Moore JE, Rashid S, Park JS, Khan S, Straus SE. Longitudinal evaluation of a course to build core competencies in implementation practice. Implementation Sci : IS 2018;13(1):106.CrossRef Moore JE, Rashid S, Park JS, Khan S, Straus SE. Longitudinal evaluation of a course to build core competencies in implementation practice. Implementation Sci : IS 2018;13(1):106.CrossRef
67.
go back to reference Metz A, Louison L, Ward C, Burke K. Global Implementation Specialist Practice Profile: Skills and competencies for implementation practitioners. Chapel Hill, N.C.: National Implementation Research Network and Centre for Effective Services, 2017. Available at: https://fpg.unc.edu/node/9178. Metz A, Louison L, Ward C, Burke K. Global Implementation Specialist Practice Profile: Skills and competencies for implementation practitioners. Chapel Hill, N.C.: National Implementation Research Network and Centre for Effective Services, 2017. Available at: https://​fpg.​unc.​edu/​node/​9178.
69.
72.
go back to reference Baxter AJ, Tweed EJ, Katikireddi SV, Thomson H. Effects of Housing First approaches on health and well-being of adults who are homeless or at risk of homelessness: Systematic review and meta-analysis of randomised controlled trials. J Epidemiol Community Health. 2019:jech-2018-210981. Baxter AJ, Tweed EJ, Katikireddi SV, Thomson H. Effects of Housing First approaches on health and well-being of adults who are homeless or at risk of homelessness: Systematic review and meta-analysis of randomised controlled trials. J Epidemiol Community Health. 2019:jech-2018-210981.
Metadata
Title
Impact of Project ECHO Models of Medical Tele-Education: a Systematic Review
Authors
Ryan K. McBain, PhD, MPH
Jessica L. Sousa, MPH, MSW
Adam J. Rose, MD, MS
Sangita M. Baxi, MAS
Laura J. Faherty, MD, MPH, MS
Caroline Taplin, MS
Andre Chappel, PhD
Shira H. Fischer, MD, PhD
Publication date
01-12-2019
Publisher
Springer US
Keywords
Care
Hepatitis C
Published in
Journal of General Internal Medicine / Issue 12/2019
Print ISSN: 0884-8734
Electronic ISSN: 1525-1497
DOI
https://doi.org/10.1007/s11606-019-05291-1

Other articles of this Issue 12/2019

Journal of General Internal Medicine 12/2019 Go to the issue

Healing Arts

A Phone Call