Skip to main content
Top
Published in: Neurological Sciences 3/2022

01-03-2022 | Multiple Sclerosis | Original Article

The reliability and validity of the Turkish version of the Telemedicine Satisfaction and Usefulness Questionnaire (TSUQ) and Telemedicine Patient Questionnaire (TPQ) in individuals with multiple sclerosis

Authors: Mehmet Özkeskin, Fatih Özden, Özgül Ekmekçi, Nur Yüceyar

Published in: Neurological Sciences | Issue 3/2022

Login to get access

Abstract

Objective

The study was aimed to translate and adapt the Telemedicine Satisfaction and Usefulness Questionnaire (TSUQ) and Telemedicine Patient Questionnaire (TPQ) into Turkish, thereafter to analyze the psychometric properties of both questionnaires.

Methods

A total of 149 multiple sclerosis (MS) patients were recruited in the study. For 4 years, all patients were supervised by a department clinician using telemedicine. Cronbach’s alpha coefficient was used to assess internal consistency. By evaluating the scores of 41 retested patients 1 week later, the test-retest reliability was determined using the intraclass correlation coefficient (ICC). Pearson’s correlation coefficient was used to assess the construct validity (r).

Results

A total of 149 patients (103 women, 46 men) with a mean age of 40.9±10.9 years were included in the study. MS duration of the patients was 9.15±6.24 years. Internal consistency of all items and the total score of the TSUQ were excellent (>0.80; ranged 0.971–0.974). On the other hand, the internal consistency of all items and total score of the TPQ was excellent, either (>0.80; ranged 0.878–0.890). The ICC of the TSUQ’s and TPQ’s total score was excellent (>0.80). The correlation between TSUQ and TPQ was strong (r=0.734, p<0.01). In addition, there was moderate relationship between the TSUQ and the Beck Depression Scale (BDS) (r=−0.363, p<0.01). On the other hand, there was low correlation between TPQ and BDS (r=−0.217, p<0.05).

Conclusion

The Turkish version of the TSUQ and the TPQ is valid and reliable in individuals with MS.
Literature
1.
go back to reference Mutgi SA, Zha AM, Behrouz R (2015) Emerging subspecialties in neurology: telestroke and teleneurology. Neurology 84(22):e191–e193CrossRef Mutgi SA, Zha AM, Behrouz R (2015) Emerging subspecialties in neurology: telestroke and teleneurology. Neurology 84(22):e191–e193CrossRef
2.
go back to reference Amatya B, Galea MP, Kesselring J, Khan F (2015) Effectiveness of telerehabilitation interventions in persons with multiple sclerosis: a systematic review. Mult Scler Relat Disord 4(4):358–369CrossRef Amatya B, Galea MP, Kesselring J, Khan F (2015) Effectiveness of telerehabilitation interventions in persons with multiple sclerosis: a systematic review. Mult Scler Relat Disord 4(4):358–369CrossRef
3.
go back to reference Veazie S, Bourne D, Peterson K, Anderson J (2019) Evidence brief: video telehealth for primary care and mental health services. Depart Vet Aff 1–35 Veazie S, Bourne D, Peterson K, Anderson J (2019) Evidence brief: video telehealth for primary care and mental health services. Depart Vet Aff 1–35
4.
go back to reference Pareyson D, Pantaleoni C, Eleopra R, De Filippis G, Moroni I, Freri E, Zibordi F, Bulgheroni S, Pagliano E, Sarti D (2021) Neuro-telehealth for fragile patients in a tertiary referral neurological institute during the COVID-19 pandemic in Milan, Lombardy. Neurol Sci 42(7):2637–2644 Pareyson D, Pantaleoni C, Eleopra R, De Filippis G, Moroni I, Freri E, Zibordi F, Bulgheroni S, Pagliano E, Sarti D (2021) Neuro-telehealth for fragile patients in a tertiary referral neurological institute during the COVID-19 pandemic in Milan, Lombardy. Neurol Sci 42(7):2637–2644
5.
go back to reference Minden SL, Frankel D, Hadden L, Hoaglin DC (2007) Access to health care for people with multiple sclerosis. Mult Scler J 13(4):547–558CrossRef Minden SL, Frankel D, Hadden L, Hoaglin DC (2007) Access to health care for people with multiple sclerosis. Mult Scler J 13(4):547–558CrossRef
6.
go back to reference Tornatore C, Phillips JT, Khan O, Miller AE, Hughes M (2016) Consensus opinion of US neurologists on practice patterns in RIS, CIS, and RRMS: evolution of treatment practices. Neurol Clin Pract 6(4):329–338CrossRef Tornatore C, Phillips JT, Khan O, Miller AE, Hughes M (2016) Consensus opinion of US neurologists on practice patterns in RIS, CIS, and RRMS: evolution of treatment practices. Neurol Clin Pract 6(4):329–338CrossRef
7.
go back to reference Robb JF, Hyland MH, Goodman AD (2019) Comparison of telemedicine versus in-person visits for persons with multiple sclerosis: a randomized crossover study of feasibility, cost, and satisfaction. Mult Scl Relat Disord 36:101258CrossRef Robb JF, Hyland MH, Goodman AD (2019) Comparison of telemedicine versus in-person visits for persons with multiple sclerosis: a randomized crossover study of feasibility, cost, and satisfaction. Mult Scl Relat Disord 36:101258CrossRef
8.
go back to reference Hatcher-Martin JM, Adams JL, Anderson ER, Bove R, Burrus TM, Chehrenama M, O’Brien MD, Eliashiv DS, Erten-Lyons D, Giesser BS (2020) Telemedicine in neurology: telemedicine work group of the American Academy of Neurology update. Neurology 94(1):30–38CrossRef Hatcher-Martin JM, Adams JL, Anderson ER, Bove R, Burrus TM, Chehrenama M, O’Brien MD, Eliashiv DS, Erten-Lyons D, Giesser BS (2020) Telemedicine in neurology: telemedicine work group of the American Academy of Neurology update. Neurology 94(1):30–38CrossRef
9.
go back to reference Shaw MT, Best P, Frontario A, Charvet LE (2021) Telerehabilitation benefits patients with multiple sclerosis in an urban setting. J Telemed Telecare 27(1):39–45CrossRef Shaw MT, Best P, Frontario A, Charvet LE (2021) Telerehabilitation benefits patients with multiple sclerosis in an urban setting. J Telemed Telecare 27(1):39–45CrossRef
10.
go back to reference Sesel A-L, Sharpe L, Beadnall HN, Barnett MH, Szabo M, Naismith SL (2019) The evaluation of an online mindfulness program for people with multiple sclerosis: study protocol. BMC Neurol 19(1):1–8CrossRef Sesel A-L, Sharpe L, Beadnall HN, Barnett MH, Szabo M, Naismith SL (2019) The evaluation of an online mindfulness program for people with multiple sclerosis: study protocol. BMC Neurol 19(1):1–8CrossRef
11.
go back to reference Healey K, Zabad R, Young L, Lindner A, Lenz N, Stewart R, Charlton M (2018) An initiative to improve care in the community: multiple sclerosis at home access (MAHA). Int J MS Care 21(3):101–12 Healey K, Zabad R, Young L, Lindner A, Lenz N, Stewart R, Charlton M (2018) An initiative to improve care in the community: multiple sclerosis at home access (MAHA). Int J MS Care 21(3):101–12
12.
go back to reference George MF, Holingue CB, Briggs FBS, Shao X, Bellesis KH, Whitmer RA, Schaefer C, Benedict RHB, Barcellos LF (2016) Feasibility study for remote assessment of cognitive function in multiple sclerosis. J Neurol Neuromed 1(8):10CrossRef George MF, Holingue CB, Briggs FBS, Shao X, Bellesis KH, Whitmer RA, Schaefer C, Benedict RHB, Barcellos LF (2016) Feasibility study for remote assessment of cognitive function in multiple sclerosis. J Neurol Neuromed 1(8):10CrossRef
13.
go back to reference Fuchs TA, Ziccardi S, Dwyer MG, Charvet LE, Bartnik A, Campbell R, Escobar J, Hojnacki D, Kolb C, Oship D (2019) Response heterogeneity to home-based restorative cognitive rehabilitation in multiple sclerosis: an exploratory study. Mult Scler Relat Disord 34:103–111CrossRef Fuchs TA, Ziccardi S, Dwyer MG, Charvet LE, Bartnik A, Campbell R, Escobar J, Hojnacki D, Kolb C, Oship D (2019) Response heterogeneity to home-based restorative cognitive rehabilitation in multiple sclerosis: an exploratory study. Mult Scler Relat Disord 34:103–111CrossRef
14.
go back to reference Khan F, Amatya B, Kesselring J, Galea M (2015) Telerehabilitation for persons with multiple sclerosis. Cochrane Database Syst Rev CD010508 Khan F, Amatya B, Kesselring J, Galea M (2015) Telerehabilitation for persons with multiple sclerosis. Cochrane Database Syst Rev CD010508
15.
go back to reference Stipa G, Gabbrielli F, Rabbito C, Di Lazzaro V, Amantini A, Grippo A, Carrai R, Pasqui R, Barloscio D, Olivi D (2021) The Italian technical/administrative recommendations for telemedicine in clinical neurophysiology. Neurol Sci 42(5):1923–1931CrossRef Stipa G, Gabbrielli F, Rabbito C, Di Lazzaro V, Amantini A, Grippo A, Carrai R, Pasqui R, Barloscio D, Olivi D (2021) The Italian technical/administrative recommendations for telemedicine in clinical neurophysiology. Neurol Sci 42(5):1923–1931CrossRef
16.
go back to reference Hajesmaeel-Gohari S, Bahaadinbeigy K (2021) The most used questionnaires for evaluating telemedicine services. BMC Med Inform Decis Mak 21(1):1–11CrossRef Hajesmaeel-Gohari S, Bahaadinbeigy K (2021) The most used questionnaires for evaluating telemedicine services. BMC Med Inform Decis Mak 21(1):1–11CrossRef
17.
go back to reference AlDossary S, Martin-Khan MG, Bradford NK, Smith AC (2017) A systematic review of the methodologies used to evaluate telemedicine service initiatives in hospital facilities. Int J Med Inform 97:171–194CrossRef AlDossary S, Martin-Khan MG, Bradford NK, Smith AC (2017) A systematic review of the methodologies used to evaluate telemedicine service initiatives in hospital facilities. Int J Med Inform 97:171–194CrossRef
18.
go back to reference Klaassen B, van Beijnum BJF, Hermens HJ (2016) Usability in telemedicine systems—a literature survey. Int J Med Inform 93:57–69CrossRef Klaassen B, van Beijnum BJF, Hermens HJ (2016) Usability in telemedicine systems—a literature survey. Int J Med Inform 93:57–69CrossRef
19.
go back to reference Kidholm K, Clemensen J, Caffery LJ, Smith AC (2017) The Model for Assessment of Telemedicine (MAST): a scoping review of empirical studies. J Telemed Telecare 23(9):803–813CrossRef Kidholm K, Clemensen J, Caffery LJ, Smith AC (2017) The Model for Assessment of Telemedicine (MAST): a scoping review of empirical studies. J Telemed Telecare 23(9):803–813CrossRef
20.
go back to reference Bakken S, Grullon-Figueroa L, Izquierdo R, Lee N-J, Morin P, Palmas W, Teresi J, Weinstock RS, Shea S, Starren J (2006) Development, validation, and use of English and Spanish versions of the telemedicine satisfaction and usefulness questionnaire. J Am Med Inform Assoc 13(6):660–667CrossRef Bakken S, Grullon-Figueroa L, Izquierdo R, Lee N-J, Morin P, Palmas W, Teresi J, Weinstock RS, Shea S, Starren J (2006) Development, validation, and use of English and Spanish versions of the telemedicine satisfaction and usefulness questionnaire. J Am Med Inform Assoc 13(6):660–667CrossRef
21.
go back to reference Demiris G, Speedie S, Finkelstein S (2000) A questionnaire for the assessment of patients’ impressions of the risks and benefits of home telecare. J Telemed Telecare 6(5):278–284CrossRef Demiris G, Speedie S, Finkelstein S (2000) A questionnaire for the assessment of patients’ impressions of the risks and benefits of home telecare. J Telemed Telecare 6(5):278–284CrossRef
22.
go back to reference Guillemin F, Bombardier C, Beaton D (1993) Cross-cultural adaptation of health-related quality of life measures: literature review and proposed guidelines. J Clin Epidemiol 46(12):1417–1432CrossRef Guillemin F, Bombardier C, Beaton D (1993) Cross-cultural adaptation of health-related quality of life measures: literature review and proposed guidelines. J Clin Epidemiol 46(12):1417–1432CrossRef
23.
go back to reference Beaton DE, Bombardier C, Guillemin F, Ferraz MB (2000) Guidelines for the process of cross-cultural adaptation of self-report measures. Spine 25(24):3186–3191CrossRef Beaton DE, Bombardier C, Guillemin F, Ferraz MB (2000) Guidelines for the process of cross-cultural adaptation of self-report measures. Spine 25(24):3186–3191CrossRef
24.
go back to reference Fayers PM, Machin D (1995) Sample size: how many patients are necessary? British J Cancer 72(1):1–9CrossRef Fayers PM, Machin D (1995) Sample size: how many patients are necessary? British J Cancer 72(1):1–9CrossRef
25.
go back to reference Faul F, Erdfelder E, Buchner A, Lang A-G (2009) Statistical power analyses using G* Power 3.1: tests for correlation and regression analyses. Behav Res Methods 41(4):1149–1160CrossRef Faul F, Erdfelder E, Buchner A, Lang A-G (2009) Statistical power analyses using G* Power 3.1: tests for correlation and regression analyses. Behav Res Methods 41(4):1149–1160CrossRef
26.
go back to reference Kurtzke JF (1983) Rating neurologic impairment in multiple sclerosis: an expanded disability status scale (EDSS). Neurology 33(11):1444–1444CrossRef Kurtzke JF (1983) Rating neurologic impairment in multiple sclerosis: an expanded disability status scale (EDSS). Neurology 33(11):1444–1444CrossRef
27.
go back to reference Kapci EG, Uslu R, Turkcapar H, Karaoglan A (2008) Beck Depression Inventory II: evaluation of the psychometric properties and cut-off points in a Turkish adult population. Depress Anxiety 25(10):E104–E110CrossRef Kapci EG, Uslu R, Turkcapar H, Karaoglan A (2008) Beck Depression Inventory II: evaluation of the psychometric properties and cut-off points in a Turkish adult population. Depress Anxiety 25(10):E104–E110CrossRef
28.
go back to reference Schermelleh-Engel K, Moosbrugger H, Müller H (2003) Evaluating the fit of structural equation models: tests of significance and descriptive goodness-of-fit measures. Methods Psychol Res Online 8(2):23–74 Schermelleh-Engel K, Moosbrugger H, Müller H (2003) Evaluating the fit of structural equation models: tests of significance and descriptive goodness-of-fit measures. Methods Psychol Res Online 8(2):23–74
29.
go back to reference Baumgartner TA, Chung H (2001) Confidence limits for intraclass reliability coefficients. Meas Phys Educ Exerc Sci 5(3):179–188CrossRef Baumgartner TA, Chung H (2001) Confidence limits for intraclass reliability coefficients. Meas Phys Educ Exerc Sci 5(3):179–188CrossRef
30.
go back to reference Juniper EF, Guyatt GH, Jaeschke R (1995) How to develop and validate a new quality of life instrument: quality of life and pharmacoeconomics in clinical trials. Lippincott-Raven Publishers, Philadelphia Juniper EF, Guyatt GH, Jaeschke R (1995) How to develop and validate a new quality of life instrument: quality of life and pharmacoeconomics in clinical trials. Lippincott-Raven Publishers, Philadelphia
31.
go back to reference Portnoy J, Waller M, Elliott T (2020) Telemedicine in the era of COVID-19. J Allergy Clin Immunol Pract 8(5):1489–1491CrossRef Portnoy J, Waller M, Elliott T (2020) Telemedicine in the era of COVID-19. J Allergy Clin Immunol Pract 8(5):1489–1491CrossRef
32.
go back to reference Corea F, Ciotti S, Cometa A, De Carlo C, Martini G, Baratta S, Zampolini M (2021) Telemedicine during the Coronavirus Disease (COVID-19) Pandemic: a multiple sclerosis (MS) outpatients service perspective. Neurol Int 13(1):25–31CrossRef Corea F, Ciotti S, Cometa A, De Carlo C, Martini G, Baratta S, Zampolini M (2021) Telemedicine during the Coronavirus Disease (COVID-19) Pandemic: a multiple sclerosis (MS) outpatients service perspective. Neurol Int 13(1):25–31CrossRef
33.
go back to reference Garg A, Goyal S, Thati R, Thati N (2021) Implementation of telemedicine in a tertiary hospital–based ambulatory practice in detroit during the COVID-19 pandemic: observational study. JMIR Publ Health Surveill 7(1):e21327CrossRef Garg A, Goyal S, Thati R, Thati N (2021) Implementation of telemedicine in a tertiary hospital–based ambulatory practice in detroit during the COVID-19 pandemic: observational study. JMIR Publ Health Surveill 7(1):e21327CrossRef
34.
go back to reference Saleem SM, Pasquale LR, Sidoti PA, Tsai JC (2020) Virtual ophthalmology: telemedicine in a COVID-19 era. Am J Ophthalmol 216:237–242CrossRef Saleem SM, Pasquale LR, Sidoti PA, Tsai JC (2020) Virtual ophthalmology: telemedicine in a COVID-19 era. Am J Ophthalmol 216:237–242CrossRef
35.
go back to reference Bahl S, Singh RP, Javaid M, Khan IH, Vaishya R, Suman R (2020) Telemedicine technologies for confronting COVID-19 pandemic: a review. J Ind Integr Manag 5(4):547–561 Bahl S, Singh RP, Javaid M, Khan IH, Vaishya R, Suman R (2020) Telemedicine technologies for confronting COVID-19 pandemic: a review. J Ind Integr Manag 5(4):547–561
36.
go back to reference Hau YS, Kim JK, Hur J, Chang MC (2020) How about actively using telemedicine during the COVID-19 pandemic? J Med Syst 44(6):1–2CrossRef Hau YS, Kim JK, Hur J, Chang MC (2020) How about actively using telemedicine during the COVID-19 pandemic? J Med Syst 44(6):1–2CrossRef
37.
go back to reference Brooke J (1996) SUS-A quick and dirty usability scale. Usability evaluation in industry 189(194):4–7 Brooke J (1996) SUS-A quick and dirty usability scale. Usability evaluation in industry 189(194):4–7
Metadata
Title
The reliability and validity of the Turkish version of the Telemedicine Satisfaction and Usefulness Questionnaire (TSUQ) and Telemedicine Patient Questionnaire (TPQ) in individuals with multiple sclerosis
Authors
Mehmet Özkeskin
Fatih Özden
Özgül Ekmekçi
Nur Yüceyar
Publication date
01-03-2022
Publisher
Springer International Publishing
Published in
Neurological Sciences / Issue 3/2022
Print ISSN: 1590-1874
Electronic ISSN: 1590-3478
DOI
https://doi.org/10.1007/s10072-021-05519-1

Other articles of this Issue 3/2022

Neurological Sciences 3/2022 Go to the issue