Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2023

Open Access 01-12-2023 | Malignant Hyperthermia | Research

A WeChat applet-based national remote emergency system for malignant hyperthermia in China: a usability study

Authors: Hong Yu, Lingcan Tan, Tao Zhu, Xiaoqian Deng

Published in: BMC Medical Informatics and Decision Making | Issue 1/2023

Login to get access

Abstract

Background

Malignant hyperthermia (MH) is a rare anesthetic emergency with a high mortality rate in China. We developed a WeChat applet–based National Remote Emergency System for Malignant Hyperthermia (MH-NRES) to provide a real-time emergency system to help Chinese anesthesiologists deal with MH crises. However, it is imperative that close attention should be paid to the usability of the applet.

Purpose

The objectives of this study were to (1) evaluate the usability of the applet-based MH-NRES for anesthesiologists; and (2) to test the validity and reliability of a modified mHealth app usability questionnaire.

Methods

A modified User Version of the Mobile Application Rating Scale (uMARS) was designed. Together with System Usability Scale (SUS) and Post-Study System Usability Questionnaire (PSSUQ), another two well-validated questionnaires, uMARS were then used to evaluate the usability of MH-NRES. The Cronbach alpha of the total score and the subscales of uMARS was calculated to evaluate the internal consistency. The correlation coefficients among three questionnaires were calculated.

Results

In this study, 118 anesthesiologists provided responses to the questionnaire. The overall mean uMARS score was 4.43 ± 0.61, which ranged from 3 to 5. The mean PSSUQ score were in good to excellent range with mean of 6.02 ± 0.97, which ranged from 3.19 to 7. The overall SUS score was 76.0 ± 17.6, which ranged from 45 to 100. The total uMARS score had excellent internal consistency (Cronbach alpha = 0.984). uMARS and its subscales were strongly correlated with PSSUQ (coefficient 0.758–0.819, P < 0.001) and SUS (coefficient 0.535–0.561, P < 0.001), respectively.

Conclusions

Data obtained from the usability evaluation questionnaires in this study indicated a high quality of the MH-NRES on the ease of use, satisfaction and perceived usefulness, which suggest this system might be a useful tool for anesthesiologists’ education and management of MH crises. Future feedback from high-fidelity simulation and clinical scenarios are need for further usability evaluation of this system.
Appendix
Available only for authorised users
Literature
2.
go back to reference Ording H. Incidence of malignant hyperthermia in Denmark. Anesth Analg. 1985;64(7):700–4.PubMed Ording H. Incidence of malignant hyperthermia in Denmark. Anesth Analg. 1985;64(7):700–4.PubMed
3.
go back to reference Yang L, Tautz T, Zhang S, Fomina A, Liu H. The current status of malignant hyperthermia. J Biomed Res. 2019;34(2):75–85.CrossRefPubMed Yang L, Tautz T, Zhang S, Fomina A, Liu H. The current status of malignant hyperthermia. J Biomed Res. 2019;34(2):75–85.CrossRefPubMed
4.
go back to reference Brandom BW, Bina S, Wong CA, Wallace T, Visoiu M, Isackson PJ, et al. Ryanodine receptor type 1 gene variants in the malignant hyperthermia-susceptible population of the United States. Anesth Analg. 2013;116(5):1078–86.CrossRefPubMedPubMedCentral Brandom BW, Bina S, Wong CA, Wallace T, Visoiu M, Isackson PJ, et al. Ryanodine receptor type 1 gene variants in the malignant hyperthermia-susceptible population of the United States. Anesth Analg. 2013;116(5):1078–86.CrossRefPubMedPubMedCentral
5.
go back to reference Riazi S, Kraeva N, Hopkins PM. Malignant hyperthermia in the post-genomics era: new perspectives on an old concept. Anesthesiology. 2018;128(1):168–80.CrossRefPubMed Riazi S, Kraeva N, Hopkins PM. Malignant hyperthermia in the post-genomics era: new perspectives on an old concept. Anesthesiology. 2018;128(1):168–80.CrossRefPubMed
6.
go back to reference Gonsalves SG, Ng D, Johnston JJ, Teer JK, Stenson PD, Cooper DN, et al. Using exome data to identify malignant hyperthermia susceptibility mutations. Anesthesiology. 2013;119(5):1043–53.CrossRefPubMed Gonsalves SG, Ng D, Johnston JJ, Teer JK, Stenson PD, Cooper DN, et al. Using exome data to identify malignant hyperthermia susceptibility mutations. Anesthesiology. 2013;119(5):1043–53.CrossRefPubMed
7.
go back to reference Monnier N, Krivosic-Horber R, Payen J-F, Kozak-Ribbens G, Nivoche Y, Adnet P, et al. Presence of two different genetic traits in malignant hyperthermia families: implication for genetic analysis, diagnosis, and incidence of malignant hyperthermia susceptibility. Anesthesiology. 2002;97(5):1067–74.CrossRefPubMed Monnier N, Krivosic-Horber R, Payen J-F, Kozak-Ribbens G, Nivoche Y, Adnet P, et al. Presence of two different genetic traits in malignant hyperthermia families: implication for genetic analysis, diagnosis, and incidence of malignant hyperthermia susceptibility. Anesthesiology. 2002;97(5):1067–74.CrossRefPubMed
8.
go back to reference Li Z, Liu K, Guo X. Dantrolene available in China for malignant hyperthermia treatment. Anesthesiology. 2022;136:515–6.CrossRef Li Z, Liu K, Guo X. Dantrolene available in China for malignant hyperthermia treatment. Anesthesiology. 2022;136:515–6.CrossRef
9.
go back to reference Hopkins PM, Girard T, Dalay S, Jenkins B, Thacker A, Patteril M, et al. Malignant hyperthermia 2020: guideline from the association of anaesthetists. Anaesthesia. 2021;76(5):655–64.CrossRefPubMed Hopkins PM, Girard T, Dalay S, Jenkins B, Thacker A, Patteril M, et al. Malignant hyperthermia 2020: guideline from the association of anaesthetists. Anaesthesia. 2021;76(5):655–64.CrossRefPubMed
10.
go back to reference Belani KG, Cao C, Daugherty D, Guo X, Hu L, Huang J, et al. Malignant Hyperthermia Status in China: a summary of an international conference. Anesth Analg. 2016;122. Belani KG, Cao C, Daugherty D, Guo X, Hu L, Huang J, et al. Malignant Hyperthermia Status in China: a summary of an international conference. Anesth Analg. 2016;122.
11.
go back to reference Yu H, Tan L, Teng Y, Xu Z, Xiao K, Yin J, et al. The first National Remote Emergency System for Malignant Hyperthermia (MH-NRES) in China: protocol for the design, development, and evaluation of a WeChat applet. JMIR Res Protoc. 2022;11(6): e37084.CrossRefPubMedPubMedCentral Yu H, Tan L, Teng Y, Xu Z, Xiao K, Yin J, et al. The first National Remote Emergency System for Malignant Hyperthermia (MH-NRES) in China: protocol for the design, development, and evaluation of a WeChat applet. JMIR Res Protoc. 2022;11(6): e37084.CrossRefPubMedPubMedCentral
12.
go back to reference Wolf JA, Moreau JF, Akilov O, Patton T, English JC 3rd, Ho J, et al. Diagnostic inaccuracy of smartphone applications for melanoma detection. JAMA Dermatol. 2013;149(4):422–6.CrossRefPubMedPubMedCentral Wolf JA, Moreau JF, Akilov O, Patton T, English JC 3rd, Ho J, et al. Diagnostic inaccuracy of smartphone applications for melanoma detection. JAMA Dermatol. 2013;149(4):422–6.CrossRefPubMedPubMedCentral
13.
go back to reference J. B. SUS: A quick and dirty usability scale. In: Jordan PW, Thomas B, Weerdmeester BA, McClelland AL, editors Usability Evaluation in Industry London: Taylor and Francis. 1996:189–94. J. B. SUS: A quick and dirty usability scale. In: Jordan PW, Thomas B, Weerdmeester BA, McClelland AL, editors Usability Evaluation in Industry London: Taylor and Francis. 1996:189–94.
14.
go back to reference Lewis, JR. Psychometric Evaluation of the PSSUQ Using Data from Five Years of Usability Studies. Int J Humancomputer Interaction. 2002;14(3):463–88. Lewis, JR. Psychometric Evaluation of the PSSUQ Using Data from Five Years of Usability Studies. Int J Humancomputer Interaction. 2002;14(3):463–88.
15.
go back to reference Zhou L, Bao J, Setiawan IMA, Saptono A, Parmanto B. The mHealth App usability questionnaire (mauq): development and validation study. JMIR Mhealth Uhealth. 2019;7(4): e11500.CrossRefPubMedPubMedCentral Zhou L, Bao J, Setiawan IMA, Saptono A, Parmanto B. The mHealth App usability questionnaire (mauq): development and validation study. JMIR Mhealth Uhealth. 2019;7(4): e11500.CrossRefPubMedPubMedCentral
16.
go back to reference Brown W 3rd, Yen PY, Rojas M, Schnall R. Assessment of the Health IT Usability Evaluation Model (Health-ITUEM) for evaluating mobile health (mHealth) technology. J Biomed Inform. 2013;46(6):1080–7.CrossRefPubMed Brown W 3rd, Yen PY, Rojas M, Schnall R. Assessment of the Health IT Usability Evaluation Model (Health-ITUEM) for evaluating mobile health (mHealth) technology. J Biomed Inform. 2013;46(6):1080–7.CrossRefPubMed
17.
go back to reference Schnall R, Cho H, Liu J. Health Information Technology Usability Evaluation Scale (Health-ITUES) for usability assessment of mobile health technology: validation study. JMIR Mhealth Uhealth. 2018;6(1): e4.CrossRefPubMedPubMedCentral Schnall R, Cho H, Liu J. Health Information Technology Usability Evaluation Scale (Health-ITUES) for usability assessment of mobile health technology: validation study. JMIR Mhealth Uhealth. 2018;6(1): e4.CrossRefPubMedPubMedCentral
18.
go back to reference Stoyanov SR, Hides L, Kavanagh DJ, Zelenko O, Tjondronegoro D, Mani M. Mobile app rating scale: a new tool for assessing the quality of health mobile apps. JMIR Mhealth Uhealth. 2015;3(1): e27.CrossRefPubMedPubMedCentral Stoyanov SR, Hides L, Kavanagh DJ, Zelenko O, Tjondronegoro D, Mani M. Mobile app rating scale: a new tool for assessing the quality of health mobile apps. JMIR Mhealth Uhealth. 2015;3(1): e27.CrossRefPubMedPubMedCentral
19.
go back to reference Stoyanov SR, Hides L, Kavanagh DJ, Wilson H. Development and validation of the user version of the Mobile Application Rating Scale (uMARS). JMIR Mhealth Uhealth. 2016;4(2): e72.CrossRefPubMedPubMedCentral Stoyanov SR, Hides L, Kavanagh DJ, Wilson H. Development and validation of the user version of the Mobile Application Rating Scale (uMARS). JMIR Mhealth Uhealth. 2016;4(2): e72.CrossRefPubMedPubMedCentral
21.
go back to reference Bangor AKP, Miller JT. An empirical evaluation of the system usability scale. Int J Human Comput Interact. 2008;24(6):574–94.CrossRef Bangor AKP, Miller JT. An empirical evaluation of the system usability scale. Int J Human Comput Interact. 2008;24(6):574–94.CrossRef
22.
go back to reference Landauer T. Behavioral research methods in human-computer interaction. In: Helander M, Landauer TK, Prabhu P, editors. Handbook of Human-Computer Interaction. 2nd ed. Amsterdam, Netherlands: Elsevier Inc; 1997. p. 203–27.CrossRef Landauer T. Behavioral research methods in human-computer interaction. In: Helander M, Landauer TK, Prabhu P, editors. Handbook of Human-Computer Interaction. 2nd ed. Amsterdam, Netherlands: Elsevier Inc; 1997. p. 203–27.CrossRef
23.
go back to reference William HD, Ephraim RM. The DeLone and McLean model of information systems success: a ten-year update. J Manag Inform Syst. 2003;19(4):9–30. William HD, Ephraim RM. The DeLone and McLean model of information systems success: a ten-year update. J Manag Inform Syst. 2003;19(4):9–30.
25.
go back to reference Alsabawy AY, Cater-Steel A, Soar J. Determinants of perceived usefulness of e-learning systems. Comput Human Behav. 2016;64:843–58. Alsabawy AY, Cater-Steel A, Soar J. Determinants of perceived usefulness of e-learning systems. Comput Human Behav. 2016;64:843–58.
26.
go back to reference Gelderman M. The relation between user satisfaction, usage of information systems and performance. Inform Manag. 1998;34(1):11–8. Gelderman M. The relation between user satisfaction, usage of information systems and performance. Inform Manag. 1998;34(1):11–8.
27.
go back to reference Bhattacherjee A. Understanding information systems continuance: an expectation-confirmation model. MIS Q. 2001;25(3):351–70.CrossRef Bhattacherjee A. Understanding information systems continuance: an expectation-confirmation model. MIS Q. 2001;25(3):351–70.CrossRef
28.
go back to reference Teferi GH, Tilahun BC, Guadie HA, Amare AT. Smartphone medical app use and associated factors among physicians at referral hospitals in Amhara Region, North Ethiopia, in 2019: cross-sectional study. JMIR Mhealth Uhealth. 2021;9(3): e19310.CrossRefPubMedPubMedCentral Teferi GH, Tilahun BC, Guadie HA, Amare AT. Smartphone medical app use and associated factors among physicians at referral hospitals in Amhara Region, North Ethiopia, in 2019: cross-sectional study. JMIR Mhealth Uhealth. 2021;9(3): e19310.CrossRefPubMedPubMedCentral
29.
go back to reference Song T, Deng N, Cui T, Qian S, Liu F, Guan Y, et al. Measuring success of patients’ continuous use of mobile health services for self-management of chronic conditions: model development and validation. J Med Internet Res. 2021;23(7): e26670.CrossRefPubMedPubMedCentral Song T, Deng N, Cui T, Qian S, Liu F, Guan Y, et al. Measuring success of patients’ continuous use of mobile health services for self-management of chronic conditions: model development and validation. J Med Internet Res. 2021;23(7): e26670.CrossRefPubMedPubMedCentral
30.
go back to reference Dittrich F, Back DA, Harren AK, Jäger M, Landgraeber S, Reinecke F, et al. A possible mobile health solution in orthopedics and trauma surgery: development protocol and user evaluation of the ankle joint app. JMIR Mhealth Uhealth. 2020;8(2): e16403.CrossRefPubMedPubMedCentral Dittrich F, Back DA, Harren AK, Jäger M, Landgraeber S, Reinecke F, et al. A possible mobile health solution in orthopedics and trauma surgery: development protocol and user evaluation of the ankle joint app. JMIR Mhealth Uhealth. 2020;8(2): e16403.CrossRefPubMedPubMedCentral
31.
go back to reference Soomro N, Chhaya M, Soomro M, Asif N, Saurman E, Lyle D, et al. Design, development, and evaluation of an injury surveillance app for cricket: protocol and qualitative study. JMIR Mhealth Uhealth. 2019;7(1): e10978.CrossRefPubMedPubMedCentral Soomro N, Chhaya M, Soomro M, Asif N, Saurman E, Lyle D, et al. Design, development, and evaluation of an injury surveillance app for cricket: protocol and qualitative study. JMIR Mhealth Uhealth. 2019;7(1): e10978.CrossRefPubMedPubMedCentral
32.
go back to reference Shahmoradi L, Azizpour A, Bejani M, Shadpour P, Rezayi S. Prevention and control of urinary tract stones using a smartphone-based self-care application: design and evaluation. BMC Med Inform Decis Mak. 2021;21(1):299.CrossRefPubMedPubMedCentral Shahmoradi L, Azizpour A, Bejani M, Shadpour P, Rezayi S. Prevention and control of urinary tract stones using a smartphone-based self-care application: design and evaluation. BMC Med Inform Decis Mak. 2021;21(1):299.CrossRefPubMedPubMedCentral
Metadata
Title
A WeChat applet-based national remote emergency system for malignant hyperthermia in China: a usability study
Authors
Hong Yu
Lingcan Tan
Tao Zhu
Xiaoqian Deng
Publication date
01-12-2023
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2023
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/s12911-023-02275-4

Other articles of this Issue 1/2023

BMC Medical Informatics and Decision Making 1/2023 Go to the issue