Top

Published in:

01-06-2017 | Review

Neuropsychological Test Administration by Videoconference: A Systematic Review and Meta-Analysis

Authors: Timothy W. Brearly, Robert D. Shura, Sarah L. Martindale, Rory A. Lazowski, David D. Luxton, Brian V. Shenal, Jared A. Rowland

Published in: Neuropsychology Review | Issue 2/2017

Abstract

The purpose of the current systematic review and meta-analysis was to assess the effect of videoconference administration on adult neurocognitive tests. We investigated whether the scores acquired during a videoconference administration were different from those acquired during on-site administration. Relevant counterbalanced crossover studies were identified according to Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. Twelve studies met criteria for analysis. Included samples consisted of healthy adults as well as those with psychiatric or neurocognitive disorders, with mean ages ranging from 34 to 88 years. Heterogenous data precluded the interpretation of a summary effect for videoconference administration. Studies including particpants with a mean age of 65–75, as well as studies that utilized a high speed network connection, indicated consistent performance across videoconference and on-site conditions, however studies with older participants and slower connections were more variable. Subgroup analyses indicated that videoconference scores for untimed tasks and those allowing for repetition fell 1/10th of a standard deviation below on-site scores. Test specific analyses indicated that verbally-mediated tasks including digit span, verbal fluency, and list learning were not affected by videoconference administration. Scores for the Boston Naming Test fell 1/10th of a standard deviation below on-site scores. Heterogenous data precluded meaningful interpretation of tasks with a motor component. The administration of verbally-mediated tasks by qualified professionals using existing norms was supported, and the use of visually-dependent tasks may also be considered. Variability in previous studies indicates a need for further investigation of motor-dependent tasks. We recommend the development of clinical best practices for conducting neuropsychological assessments via videoconference, and advocate for reimbursement structures that allow consumers to benefit from the increased access, convenience, and cost-savings that remote assessment provides.

Available only for authorised users

Acierno, R., Gros, D. F., Ruggiero, K. J., Hernandez-Tejada, B. M. A., Knapp, R. G., Lejuez, C. W., et al. (2016). Behavioral activation and therapeutic exposure for posttraumatic stress disorder: a noninferiority trial of treatment delivered in person versus home-based telehealth. Depression and Anxiety. doi:10.1002/da.22476.

Adjorlolo, S. (2015). Can teleneuropsychology help meet the neuropsychological needs of western Africans? The case of Ghana. Applied Neuropsychology: Adult, 22(5), 388–398. doi:10.1080/23279095.2014.949718.CrossRef

Backhaus, A., Agha, Z., Maglione, M. L., Repp, A., Ross, B., Zuest, D., et al. (2012). Videoconferencing psychotherapy: a systematic review. Psychological Services, 9(2), 111–131. doi:10.1037/a0027924.CrossRefPubMed

Ball, C. J., Scott, N., McLaren, P. M., & Watson, J. P. (1993). Preliminary evaluation of a low-cost videoconferencing (LCVC) system for remote cognitive testing of adult psychiatric patients. British Journal of Clinical Psychology, 32(3), 303–307. doi:10.1111/j.2044-8260.1993.tb01060.x.CrossRefPubMed

Barak, A., Hen, L., Boniel-Nissim, M., & Shapira, N. (2008). A comprehensive review and a meta-analysis of the effectiveness of internet-based psychotherapeutic interventions. Journal of Technology in Human Services, 26(2–4), 109–160. doi:10.1080/15228830802094429.CrossRef

Barton, C., Morris, R., Rothlind, J., & Yaffe, K. (2011). Video-telemedicine in a memory disorders clinic: evaluation and management of rural elders with cognitive impairment. Telemedicine and e-Health, 17(10), 789–793.CrossRefPubMed

Bashshur, R. L., Shannon, G. W., Bashshur, N., & Yellowlees, P. M. (2015). The empirical evidence for telemedicine interventions in mental disorders. Telemedicine and e-Health. doi:10.1089/tmj.2015.0206.

Begg, C. B., & Mazumdar, M. (1994). Operating characteristics of a rank correlation test for publication bias. Biometrics, 50(4), 1088–1101. doi:10.2307/2533446.CrossRefPubMed

Beglinger, L. J., Gaydos, B., Tangphao-Daniels, O., Duff, K., Kareken, D. A., Crawford, J., et al. (2005). Practice effects and the use of alternate forms in serial neuropsychological testing. Archives of Clinical Neuropsychology, 20(4), 517–529. doi:10.1016/j.acn.2004.12.003.CrossRefPubMed

Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2010). A basic introduction to fixed-effect and random-effects models for meta-analysis. Research Synthesis Methods, 1(2), 97–111. doi:10.1002/jrsm.12.CrossRefPubMed

Cernich, A. N., Brennana, D. M., Barker, L. M., & Bleiberg, J. (2007). Sources of error in computerized neuropsychological assessment. Archives of Clinical Neuropsychology, 22(Suppl 1), S39–S48. doi:10.1016/j.acn.2006.10.004.CrossRefPubMed

Cheung, M. W.-L., & Vijayakumar, R. (2016). A guide to conducting a meta-analysis. Neuropsychology Review, 1–8. doi:10.1007/s11065-016-9319-z.

Ciemins, E., Halloway, B., Coon, P. J., McClosky-Armstrong, T., & Min, S. (2009). Telemedicine and the Mini-mental state Examination: Assessment from a distance. Telemedicine and e-Health. doi:10.1089/tmj.2008.0144.

Cohen, J. (1988). Statistical power analysis for the behavioral Sciences. Hillsdale: L. Erlbaum Associates.

Cullum, C., Weiner, M., Gehrmann, H., & Hynan, L. (2006). Feasibility of telecognitive assessment in dementia. Assessment, 13(4), 385–390. doi:10.1177/1073191106289065.CrossRefPubMed

Cullum, C., Hynan, L., Grosch, M., Parikh, M., & Weiner, M. (2014). Teleneuropsychology: evidence for video teleconference-based neuropsychological assessment. Journal of the International Neuropsychological Society, 20(10), 1028–1033. doi:10.1017/S1355617714000873.CrossRefPubMedCentral

Czaja, S. J. (2016). Long-term care services and support systems for older adults: the role of technology. American Psychologist, 71(4), 294–301. doi:10.1037/a0040258.CrossRefPubMed

Davis, L. E., Coleman, J., Harnar, J., & King, M. K. (2014). Teleneurology: successful delivery of chronic neurologic care to 354 patients living remotely in a rural state. Telemedicine and e-Health, 20(5), 473–477. doi:10.1089/tmj.2013.0217.CrossRefPubMed

DeYoung, N., Belkonen, S., Luci, K., Slater, M., Quigley, T., & Shenal, B. (2015). The reliability and accuracy of administering the Montreal cognitive assessment over telehealth. Presented at the 43rd annual meeting of the International neuropsychological Society, Denver, CO.

Ding, H., Hu, G. L., Zheng, X. Y., Chen, Q., Threapleton, D. E., & Zhou, Z. H. (2015). The method quality of cross-over studies involved in Cochrane systematic reviews. PloS One, 10(4). doi:10.1371/journal.pone.0120519.

Duff, K. (2012). Evidence-based indicators of neuropsychological change in the individual patient: relevant concepts and methods. Archives of Clinical Neuropsychology, 27(3), 248–261. doi:10.1093/arclin/acr120.

Fordyce, M. A., Chen, F. M., Doescher, M. P., & Hart, L. G. (2007). 2005 physician supply and distribution in rural areas of the United States. Final report, 116. http://depts.washington.edu/uwrhrc/uploads/RHRC%20FR116%20Fordyce.pdf. Accessed 20 July 2016.

Fortney, J. C., Pyne, J. M., Turner, E. E., Farris, K. M., Normoyle, T. M., Avery, M. D., et al. (2015). Telepsychiatry integration of mental health services into rural primary care settings. International Review of Psychiatry, 27(6), 525–539. doi:10.3109/09540261.2015.1085838.CrossRefPubMed

Galusha-Glasscock, J. M., Horton, D. K., Weiner, M. F., & Cullum, C. M. (2015). Video teleconference administration of the Repeatable Battery for the assessment of neuropsychological status. Archives of Clinical Neuropsychology. doi:10.1093/arclin/acv058.

Gros, D. F., Morland, L. A., Greene, C. J., Acierno, R., Strachan, M., Egede, L. E., et al. (2013). Delivery of evidence-based psychotherapy via video telehealth. Journal of Psychopathology and Behavioral Assessment, 35(4), 506–521. doi:10.1007/s10862-013-9363-4.CrossRef

Grosch, M. C., Gottlieb, M. C., & Cullum, C. M. (2011). Initial practice recommendations for teleneuropsychology. The Clinical Neuropsychologist, 25(7), 1119–1133. doi:10.1080/13854046.2011.609840.CrossRefPubMed

Grosch, M. C., Weiner, M. F., Hynan, L. S., Shore, J., & Cullum, C. M. (2015). Video teleconference-based neurocognitive screening in geropsychiatry. Psychiatry Research, 225(3), 734–735. doi:10.1016/j.psychres.2014.12.040.CrossRefPubMedPubMedCentral

Harrell, K. M., Wilkins, S. S., Connor, M. K., & Chodosh, J. (2014). Telemedicine and the evaluation of cognitive impairment: the additive value of neuropsychological assessment. Journal of the American Medical Directors Association, 15(8), 600–606. doi:10.1016/j.jamda.2014.04.015.CrossRefPubMed

Higgins, J. P., & Green, S. (2011). Cochrane handbook for systematic reviews of interventions. http://handbook.cochrane.org/front_page.htm. Accessed 8 Apr 2016.

Higgins, J. P. T., & Thompson, S. G. (2002). Quantifying heterogeneity in a meta-analysis. Statistics in Medicine, 21(11), 1539–1558. doi:10.1002/sim.1186.CrossRefPubMed

Higgins, J. P. T., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003). Measuring inconsistency in meta-analyses. BMJ: British Medical Journal, 327(7414), 557–560.CrossRefPubMedPubMedCentral

Hildebrand, R., Chow, H., Williams, C., Nelson, M., & Wass, P. (2004). Feasibility of neuropsychological testing of older adults via videoconference: implications for assessing the capacity for independent living. Journal of Telemedicine and Telecare, 10(3), 130–134.CrossRefPubMed

Hilty, D. M., Nesbitt, T. S., Kuenneth, C. A., Cruz, G. M., & Hales, R. E. (2007). Rural versus suburban primary care needs, utilization, and satisfaction with telepsychiatric consultation. The Journal of Rural Health, 23(2), 163–165. doi:10.1111/j.1748-0361.2007.00084.x.CrossRefPubMed

Hilty, D. M., Ferrer, D. C., Parish, M. B., Johnston, B., Callahan, E. J., & Yellowlees, P. M. (2013). The effectiveness of telemental health: a 2013 review. Telemedicine and e-Health, 19(6), 444–454. doi:10.1089/tmj.2013.0075.CrossRefPubMedPubMedCentral

Jacobsen, S. E., Sprenger, T., Andersson, S., & Krogstad, J.-M. (2003). Neuropsychological assessment and telemedicine: a preliminary study examining the reliability of neuropsychology services performed via telecommunication. Journal of the International Neuropsychological Society, 9(3), 472–478. doi:10.1017/S1355617703930128.CrossRefPubMed

Johnson, K. A., Meyer, J., Yazar, S., & Turner, A. W. (2015). Real-time teleophthalmology in rural Western Australia. Australian Journal of Rural Health, 23(3), 142–149. doi:10.1111/ajr.12150.CrossRefPubMed

Kirkwood, K. T., Peck, D. F., & Bennie, L. (2000). The consistency of neuropsychological assessments performed via telecommunication and face to face. Journal of Telemedicine and Telecare, 6, 147–151.CrossRefPubMed

Lilly, C. M., Zubrow, M. T., Kempner, K. M., Reynolds, H. N., Subramanian, S., Eriksson, E. A., et al. (2014). Critical care telemedicine: evolution and state of the art*. Critical Care Medicine, 42(11), 2429–2436. doi:10.1097/CCM.0000000000000539.CrossRefPubMed

Loh, P., Ramesh, P., Maher, S., Saligari, J., Flicker, L., & Goldswain, P. (2004). Can patients with dementia be assessed at a distance? The use of telehealth and standardised assessments. Internal Medicine Journal, 34(5), 239–242.CrossRefPubMed

Loh, P., Donaldson, M., Flicker, L., Maher, S., & Goldswain, P. (2007). Development of a telemedicine protocol for the diagnosis of Alzheimer’s disease. Journal of Telemedicine and Telecare, 13(2), 90–94. doi:10.1258/135763307780096159.CrossRefPubMed

Luxton, D. D., Pruitt, L. D., & Osenbach, J. E. (2014). Best practices for remote psychological assessment via telehealth technologies. Professional Psychology: Research and Practice, 45(1), 27–35. doi:10.1037/a0034547.CrossRef

McEachern, W., Kirk, A., Morgan, D. G., Crossley, M., & Henry, C. (2008). Reliability of the MMSE administered in-person and by telehealth. Canadian Journal of Neurological Sciences / Journal Canadien des Sciences Neurologiques, 35(5), 643–646. doi:10.1017/S0317167100009458.CrossRefPubMed

Menon, A. S., Kondapavalru, P., Krishna, P., Chrismer, J. B., Raskin, A., Hebel, J. R., & Ruskin, P. E. (2001). Evaluation of a portable low cost videophone system in the assessment of depressive symptoms and cognitive function in elderly medically ill veterans. The Journal of Nervous and Mental Disease, 189(6), 399–401.CrossRefPubMed

Montani, C., Billaud, N., Tyrrell, J., Fluchaire, I., Malterre, C., Lauvernay, N., et al. (1997). Psychological impact of a remote psychometric consultation with hospitalized elderly people. Journal of Telemedicine and Telecare, 3(3), 140–145. doi:10.1258/1357633971931048.

Parikh, M., Grosch, M. C., Graham, L. L., Hynan, L. S., Weiner, M., Shore, J. H., & Cullum, C. M. (2013). Consumer acceptability of brief videoconference-based neuropsychological assessment in older individuals with and without cognitive impairment. The Clinical Neuropsychologist, 27(5), 808–817. doi:10.1080/13854046.2013.791723.CrossRefPubMedPubMedCentral

Shores, M. M., Ryan-Dykes, P., Williams, R. M., Mamerto, B., Sadak, T., Pascualy, M., et al. (2004). Identifying undiagnosed dementia in residential care veterans: comparing telemedicine to in-person clinical examination. International Journal of Geriatric Psychiatry, 19(2), 101–108. doi:10.1002/gps.1029.CrossRefPubMed

Temple, V., Drummond, C., Valiquette, S., & Jozsvai, E. (2010). A comparison of intellectual assessments over video conferencing and in-person for individuals with ID: preliminary data. Journal of Intellectual Disability Research, 54(6), 573–577. doi:10.1111/j.1365-2788.2010.01282.x.CrossRefPubMed

Tensen, E., van der Heijden, J. P., Jaspers, M. W. M., & Witkamp, L. (2016). Two decades of teledermatology: current status and integration in national healthcare systems. Current Dermatology Reports, 5(2), 96–104. doi:10.1007/s13671-016-0136-7.CrossRefPubMedPubMedCentral

Turkstra, L. S., Quinn-Padron, M., Johnson, J. E., Workinger, M. S., & Antoniotti, N. (2012). In-person versus telehealth assessment of discourse ability in adults with traumatic brain injury. The Journal of Head Trauma Rehabilitation, 27(6), 424–432. doi:10.1097/HTR.0b013e31823346fc.CrossRefPubMedPubMedCentral

Turner, T. H., Horner, M. D., Vankirk, K. K., Myrick, H., & Tuerk, P. W. (2012). A pilot trial of neuropsychological evaluations conducted via telemedicine in the veterans health administration. Telemedicine Journal and E-Health: The Official Journal of the American Telemedicine Association, 18(9), 662–667. doi:10.1089/tmj.2011.0272.CrossRef

Vahia, I. V., Ng, B., Camacho, A., Cardenas, V., Cherner, M., Depp, C. A., et al. (2015). Telepsychiatry for neurocognitive testing in older rural Latino adults. The American Journal of Geriatric Psychiatry, 23(7), 666–670. doi:10.1016/j.jagp.2014.08.006.CrossRefPubMed

Vestal, L., Smith-Olinde, L., Hicks, G., Hutton, T., & Hart Jr., J. (2006). Efficacy of language assessment in Alzheimer’s disease: comparing in-person examination and telemedicine. Clinical Interventions in Aging, 1(4), 467.CrossRefPubMedPubMedCentral

Wadsworth, H. E., Galusha-Glasscock, J. M., Womack, K. B., Quiceno, M., Weiner, M. F., Hynan, L. S., et al. (2016). Remote neuropsychological assessment in rural American Indians with and without cognitive impairment. Archives of Clinical Neuropsychology, acw030. doi:10.1093/arclin/acw030.

Wechsler, L. R. (2015). Advantages and limitations of teleneurology. JAMA Neurology, 72(3), 349–354. doi:10.1001/jamaneurol.2014.3844.CrossRefPubMed

Wennergren, J., Munshi, I., Fajardo, A. D., & George, V. V. (2014). Implementation of clinical video telemedicine (CVT) within a VA medical center is cost effective and well received by veterans. International Journal of Clinical Medicine, 5(12), 711–716. doi:10.4236/ijcm.2014.512097.CrossRef

Title: Neuropsychological Test Administration by Videoconference: A Systematic Review and Meta-Analysis
Authors: Timothy W. Brearly
Robert D. Shura
Sarah L. Martindale
Rory A. Lazowski
David D. Luxton
Brian V. Shenal
Jared A. Rowland
Publication date: 01-06-2017
Publisher: Springer US
Published in: Neuropsychology Review / Issue 2/2017
Print ISSN: 1040-7308
Electronic ISSN: 1573-6660
DOI: https://doi.org/10.1007/s11065-017-9349-1

At a glance: The STEP trials

Springer Medicine

Neuropsychological Test Administration by Videoconference: A Systematic Review and Meta-Analysis

Abstract

At a glance: The STEP trials

Springer Medicine

Abstract

Please log in to get access to this content

Other articles of this Issue 2/2017

Erratum to: The Differential Contributions of Conceptual Representation Format and Language Structure to Levels of Semantic Abstraction Capacity

The Differential Contributions of Conceptual Representation Format and Language Structure to Levels of Semantic Abstraction Capacity

Long-Term Neuropsychological Outcomes of Childhood Onset Acute Disseminated Encephalomyelitis (ADEM): a Meta-Analysis

Heterogeneity of Neuropsychological Impairment in HIV Infection: Contributions from Mild Cognitive Impairment

Neuropsychological Measures in the Arab World: A Systematic Review

Historical Perspectives on Ancient Greek Derived “a” Prefixed Nomenclature for Acquired Neurocognitive Impairment