Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2019

Open Access 01-12-2019 | Bronchial Asthma | Research article

Constructing an assessment framework for the quality of asthma smartphone applications

Authors: Zhifang Guan, Liu Sun, Qian Xiao, Yanling Wang

Published in: BMC Medical Informatics and Decision Making | Issue 1/2019

Login to get access

Abstract

Background

Enhancing the self-management capability of asthma patients can improve their level of asthma control. Although the use of mobile health technology among asthmatics to facilitate self-management has become a growing area of research, studies of mobile health applications (apps), especially for evaluating indicators of asthma apps, are deficient in scope. This study aimed to develop a reliable framework to assess asthma apps (i.e., content and behavior change strategies) using the Delphi survey technique.

Methods

An initial list of quality rating criteria for asthma apps was derived from reviewing the literature and experts in the fields of respiratory disease and nursing informatics rated the items on the list in three rounds. The weights of items were determined employing an analytic hierarchy process (AHP).

Results

Sixty-two items were retained within 10 domains. Consensus was reached on 32 items concerning asthma self-management education, 25 items concerning behavioral change strategies, and five items concerning principles for app design. There was moderate agreement among participants across all items in round three. The weights of the dimensions, sub-dimensions, and items ranged from 0.049 to 0.203, 0.138 to 1.000, and 0.064 to 1.000, respectively. All random consistency ratio values were less than 0.1.

Conclusions

Asthma self-management education and strategies are essential parts to support self-management for patients. This analysis provides evidence of evaluating criteria for apps targeting chronic and common diseases.
Literature
2.
go back to reference Ahmetaj LN. The Global Asthma Report 2014. Auckland: Global Asthma Network; 2014. Ahmetaj LN. The Global Asthma Report 2014. Auckland: Global Asthma Network; 2014.
3.
go back to reference Wong GW, Kwon N, Hong JG, Hsu JY, Gunasekera KD. Pediatric asthma control in Asia: phase 2 of the asthma insights and reality in Asia-Pacific (AIRIAP 2) survey. Allergy. 2013;68(4):524–30.CrossRefPubMed Wong GW, Kwon N, Hong JG, Hsu JY, Gunasekera KD. Pediatric asthma control in Asia: phase 2 of the asthma insights and reality in Asia-Pacific (AIRIAP 2) survey. Allergy. 2013;68(4):524–30.CrossRefPubMed
4.
go back to reference Masoli M, Fabian D, Holt S, Beasley R. The global burden of asthma: executive summary of the GINA dissemination committee report. Allergy. 2004;59(5):469–78.CrossRefPubMed Masoli M, Fabian D, Holt S, Beasley R. The global burden of asthma: executive summary of the GINA dissemination committee report. Allergy. 2004;59(5):469–78.CrossRefPubMed
6.
go back to reference Gardner A, Kaplan B, Brown W, Krier-Morrow D, Rappaport S, Marcus L, Conboy-Ellis K, Mullen A, Rance K, Aaronson D. National standards for asthma self-management education. Ann Allergy Asthma Immunol. 2015;114(3):178–186.e171.CrossRefPubMed Gardner A, Kaplan B, Brown W, Krier-Morrow D, Rappaport S, Marcus L, Conboy-Ellis K, Mullen A, Rance K, Aaronson D. National standards for asthma self-management education. Ann Allergy Asthma Immunol. 2015;114(3):178–186.e171.CrossRefPubMed
7.
go back to reference Welsh EJ, Hasan M, Li P. Home-based educational interventions for children with asthma. Cochrane Database Syst Rev. 2011;66(10):CD008469. Welsh EJ, Hasan M, Li P. Home-based educational interventions for children with asthma. Cochrane Database Syst Rev. 2011;66(10):CD008469.
8.
go back to reference Morrison D, Mair FS, Yardley L, Kirby S, Thomas M. Living with asthma and chronic obstructive airways disease: Using technology to support self-management - an overview. Chron Respir Dis. 2016;14:407–19 (4%\ 2018-04-23 22:13:00).CrossRefPubMedPubMedCentral Morrison D, Mair FS, Yardley L, Kirby S, Thomas M. Living with asthma and chronic obstructive airways disease: Using technology to support self-management - an overview. Chron Respir Dis. 2016;14:407–19 (4%\ 2018-04-23 22:13:00).CrossRefPubMedPubMedCentral
9.
go back to reference Huckvale K, Morrison C, Ouyang J, Ghaghda A, Car J. The evolution of mobile apps for asthma: an updated systematic assessment of content and tools. BMC Med. 2015;13(1):58.CrossRefPubMedPubMedCentral Huckvale K, Morrison C, Ouyang J, Ghaghda A, Car J. The evolution of mobile apps for asthma: an updated systematic assessment of content and tools. BMC Med. 2015;13(1):58.CrossRefPubMedPubMedCentral
10.
go back to reference McLean G, Murray E, Band R, Moffat KR, Hanlon P, Bruton A, Thomas M, Yardley L, Mair FS. Interactive digital interventions to promote self-management in adults with asthma: systematic review and meta-analysis. BMC Pulmonary Med. 2016;16(1):83.CrossRef McLean G, Murray E, Band R, Moffat KR, Hanlon P, Bruton A, Thomas M, Yardley L, Mair FS. Interactive digital interventions to promote self-management in adults with asthma: systematic review and meta-analysis. BMC Pulmonary Med. 2016;16(1):83.CrossRef
14.
go back to reference Demidowich AP, Lu K, Tamler R, Bloomgarden Z. An evaluation of diabetes self-management applications for android smartphones. J Telemed Telecare. 2012;18(4):235–8.CrossRefPubMed Demidowich AP, Lu K, Tamler R, Bloomgarden Z. An evaluation of diabetes self-management applications for android smartphones. J Telemed Telecare. 2012;18(4):235–8.CrossRefPubMed
16.
go back to reference Bastawrous A, Armstrong MJ. Mobile health use in low- and high-income countries: an overview of the peer-reviewed literature. J R Soc Med. 2013;106(4):130–42.CrossRefPubMedPubMedCentral Bastawrous A, Armstrong MJ. Mobile health use in low- and high-income countries: an overview of the peer-reviewed literature. J R Soc Med. 2013;106(4):130–42.CrossRefPubMedPubMedCentral
17.
go back to reference Rosser BA, Eccleston C. Smartphone applications for pain management. J Telemed Telecare. 2011;17(6):308–12.CrossRefPubMed Rosser BA, Eccleston C. Smartphone applications for pain management. J Telemed Telecare. 2011;17(6):308–12.CrossRefPubMed
18.
go back to reference Pandey A, Hasan S, Dubey D, Sarangi S. Smartphone apps as a source of cancer information: changing trends in health information-seeking behavior. J Cancer Educ. 2013;28(1):138–42.CrossRefPubMed Pandey A, Hasan S, Dubey D, Sarangi S. Smartphone apps as a source of cancer information: changing trends in health information-seeking behavior. J Cancer Educ. 2013;28(1):138–42.CrossRefPubMed
19.
go back to reference Buijink AW, Visser BJ, Marshall L. Medical apps for smartphones: lack of evidence undermines quality and safety. Evid Based Med. 2013;18(3):90–2.CrossRefPubMed Buijink AW, Visser BJ, Marshall L. Medical apps for smartphones: lack of evidence undermines quality and safety. Evid Based Med. 2013;18(3):90–2.CrossRefPubMed
20.
21.
go back to reference Chan S, Torous J, Hinton L, Yellowlees P. Towards a framework for evaluating mobile mental health apps. Telemed J E Health. 2015;21(12):1038–41.CrossRefPubMed Chan S, Torous J, Hinton L, Yellowlees P. Towards a framework for evaluating mobile mental health apps. Telemed J E Health. 2015;21(12):1038–41.CrossRefPubMed
22.
23.
go back to reference Tinschert P, Jakob R, Barata F, Kramer JN, Kowatsch T. The potential of mobile apps for improving asthma self-management: a review of publicly available and well-adopted asthma apps. JMIR Mhealth Uhealth. 2017;5(8):e113.CrossRefPubMedPubMedCentral Tinschert P, Jakob R, Barata F, Kramer JN, Kowatsch T. The potential of mobile apps for improving asthma self-management: a review of publicly available and well-adopted asthma apps. JMIR Mhealth Uhealth. 2017;5(8):e113.CrossRefPubMedPubMedCentral
24.
go back to reference Ju QY, Huang LH, Zhao XH, Xing MY, Shao LW, Zhang MY, Shao RY. Development of evidence-based nursing-sensitive quality indicators for emergency nursing: a Delphi study. J Clin Nurs. 2018;27:3008–19.CrossRefPubMed Ju QY, Huang LH, Zhao XH, Xing MY, Shao LW, Zhang MY, Shao RY. Development of evidence-based nursing-sensitive quality indicators for emergency nursing: a Delphi study. J Clin Nurs. 2018;27:3008–19.CrossRefPubMed
25.
go back to reference Hasson F, Keeney S, McKenna H. Research guidelines for the Delphi survey technique. J Adv Nurs. 2000;32(4):1008–15.PubMed Hasson F, Keeney S, McKenna H. Research guidelines for the Delphi survey technique. J Adv Nurs. 2000;32(4):1008–15.PubMed
26.
go back to reference Hsu CC, Sandford BA. The Delphi technique: making sense of consensus. Pract Assess Res Eval. 2007;26(10):289–304. Hsu CC, Sandford BA. The Delphi technique: making sense of consensus. Pract Assess Res Eval. 2007;26(10):289–304.
27.
go back to reference Wu YL. Study on the index system of assessment in maternal and child health of counties in Sichuan province. Sichuan University: Master's thesis; 2005. Wu YL. Study on the index system of assessment in maternal and child health of counties in Sichuan province. Sichuan University: Master's thesis; 2005.
28.
go back to reference Saaty TL. How to make a decision: the analytic hierarchy process. Eur J Oper Res. 1994;48(1):9–26.CrossRef Saaty TL. How to make a decision: the analytic hierarchy process. Eur J Oper Res. 1994;48(1):9–26.CrossRef
29.
go back to reference Triantaphyllou E, Mann SH. Using the analytic hierarchy process for decision making in engineering applications: some challenges. Int J Ind Eng App Pract. 1995;2:35–44. Triantaphyllou E, Mann SH. Using the analytic hierarchy process for decision making in engineering applications: some challenges. Int J Ind Eng App Pract. 1995;2:35–44.
30.
go back to reference Guan ZF, Xiao Q, Sun L, Wang YL. Research on quality evaluation of bronchial asthma management application based on content analysis. Chin Nurs Res. 2018;32(12):1885–90. Guan ZF, Xiao Q, Sun L, Wang YL. Research on quality evaluation of bronchial asthma management application based on content analysis. Chin Nurs Res. 2018;32(12):1885–90.
31.
go back to reference Michie S, Richardson M, Johnston M, Abraham C, Francis J, Hardeman W, Eccles MP, Cane J, Wood CE. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Behav Med. 2013;46(1):81–95.CrossRefPubMed Michie S, Richardson M, Johnston M, Abraham C, Francis J, Hardeman W, Eccles MP, Cane J, Wood CE. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Behav Med. 2013;46(1):81–95.CrossRefPubMed
33.
go back to reference Michie S, Hyder N, Walia A, West R. Development of a taxonomy of behaviour change techniques used in individual behavioural support for smoking cessation. Addict Behav. 2011;36(4):315–9.CrossRefPubMed Michie S, Hyder N, Walia A, West R. Development of a taxonomy of behaviour change techniques used in individual behavioural support for smoking cessation. Addict Behav. 2011;36(4):315–9.CrossRefPubMed
34.
go back to reference Abraham C, Michie S. A taxonomy of behavior change techniques used in interventions. Health Psychol. 2008;27(3):379–87.CrossRefPubMed Abraham C, Michie S. A taxonomy of behavior change techniques used in interventions. Health Psychol. 2008;27(3):379–87.CrossRefPubMed
35.
go back to reference Michie S, Johnston M, Francis J, Hardeman W, Eccles M. From theory to intervention: mapping theoretically derived behavioural determinants to behaviour change techniques. Appl Psychol. 2008;57(4):660–80.CrossRef Michie S, Johnston M, Francis J, Hardeman W, Eccles M. From theory to intervention: mapping theoretically derived behavioural determinants to behaviour change techniques. Appl Psychol. 2008;57(4):660–80.CrossRef
36.
go back to reference Michie S, Ashford S, Sniehotta FF, Dombrowski SU, Bishop A, French DP. A refined taxonomy of behaviour change techniques to help people change their physical activity and healthy eating behaviours: the CALO-RE taxonomy. Psychol Health. 2011;26(11):1479–98.CrossRefPubMed Michie S, Ashford S, Sniehotta FF, Dombrowski SU, Bishop A, French DP. A refined taxonomy of behaviour change techniques to help people change their physical activity and healthy eating behaviours: the CALO-RE taxonomy. Psychol Health. 2011;26(11):1479–98.CrossRefPubMed
37.
go back to reference Reddy AP, Gupta MR. Management of asthma: the current US and European guidelines. Adv Exp Med Biol. 2014;795:81–103.CrossRefPubMed Reddy AP, Gupta MR. Management of asthma: the current US and European guidelines. Adv Exp Med Biol. 2014;795:81–103.CrossRefPubMed
38.
go back to reference Odom L, Christenbery T. There is an “app” for that: designing mobile phone technology to improve asthma action plan use in adolescent patients. J Am Assoc Nurse Pract. 2016;28(11):583–90.PubMed Odom L, Christenbery T. There is an “app” for that: designing mobile phone technology to improve asthma action plan use in adolescent patients. J Am Assoc Nurse Pract. 2016;28(11):583–90.PubMed
39.
go back to reference Jia G, Yang P, Zhou J, Zhang H, Lin C, Chen J, Cai G, Yan J, Ning G. A framework design for the mHealth system for self-management promotion. Biomed Mater Eng. 2015;26(Suppl 1):S1731–40.PubMed Jia G, Yang P, Zhou J, Zhang H, Lin C, Chen J, Cai G, Yan J, Ning G. A framework design for the mHealth system for self-management promotion. Biomed Mater Eng. 2015;26(Suppl 1):S1731–40.PubMed
40.
go back to reference Stoyanov SR, Hides L, Kavanagh DJ, Zelenko O, Tjondronegoro D, Mani M. Mobile app rating scale: a new tool for assessing the quality of health mobile apps. JMIR Mhealth Uhealth. 2015;3(1):e27.CrossRefPubMedPubMedCentral Stoyanov SR, Hides L, Kavanagh DJ, Zelenko O, Tjondronegoro D, Mani M. Mobile app rating scale: a new tool for assessing the quality of health mobile apps. JMIR Mhealth Uhealth. 2015;3(1):e27.CrossRefPubMedPubMedCentral
41.
go back to reference Brown BB. Delphi process: a methodology used for the elicitation of opinions of experts. Santa Monica: RAND Corp; 1968. Brown BB. Delphi process: a methodology used for the elicitation of opinions of experts. Santa Monica: RAND Corp; 1968.
42.
go back to reference Guo XH. Medical field investigation techniques and statistical analysis. Beijing: People's Medical Publishing House Co., LTD; 2009. Guo XH. Medical field investigation techniques and statistical analysis. Beijing: People's Medical Publishing House Co., LTD; 2009.
43.
go back to reference Sun ZQ, Wang LS. Comprehensive evaluation method and its application in medicine. Beijing: People's Medical Publishing House Co., LTD; 2014. Sun ZQ, Wang LS. Comprehensive evaluation method and its application in medicine. Beijing: People's Medical Publishing House Co., LTD; 2014.
44.
go back to reference Zhang X, Chen X, Duan PB, Zhang YY. Construction of an appraisal system of clinical synthetical competence for nursing undergraduates based on delphi method and analytic hierarchy process. Nursing J Chinese Peoples Liberation Army. 2012;3:12–14,45. Zhang X, Chen X, Duan PB, Zhang YY. Construction of an appraisal system of clinical synthetical competence for nursing undergraduates based on delphi method and analytic hierarchy process. Nursing J Chinese Peoples Liberation Army. 2012;3:12–14,45.
45.
go back to reference Martínez-Pérez B, Torre-Díez IDL, López-Coronado M. Experiences and results of applying tools for assessing the quality of a mHealth app named heartkeeper. J Med Syst. 2015;39(11):142.CrossRefPubMed Martínez-Pérez B, Torre-Díez IDL, López-Coronado M. Experiences and results of applying tools for assessing the quality of a mHealth app named heartkeeper. J Med Syst. 2015;39(11):142.CrossRefPubMed
46.
go back to reference Hale K, Capra S, Bauer J. A framework to assist health professionals in recommending high-quality apps for supporting chronic disease self-management: illustrative assessment of type 2 diabetes apps. Jmir Mhealth Uhealth. 2015;3(3):e87.CrossRefPubMedPubMedCentral Hale K, Capra S, Bauer J. A framework to assist health professionals in recommending high-quality apps for supporting chronic disease self-management: illustrative assessment of type 2 diabetes apps. Jmir Mhealth Uhealth. 2015;3(3):e87.CrossRefPubMedPubMedCentral
47.
go back to reference Reynoldson C, Stones C, Allsop M, Gardner P, Bennett MI, Closs SJ, Jones R, Knapp P. Assessing the quality and usability of smartphone apps for pain self-management. Pain Med. 2014;15(6):898–909.CrossRefPubMed Reynoldson C, Stones C, Allsop M, Gardner P, Bennett MI, Closs SJ, Jones R, Knapp P. Assessing the quality and usability of smartphone apps for pain self-management. Pain Med. 2014;15(6):898–909.CrossRefPubMed
49.
go back to reference Mobile Medical Applications-Guidance for Industry and Food and Drug Administration Staff. US Food and Drug Administration 2015. Mobile Medical Applications-Guidance for Industry and Food and Drug Administration Staff. US Food and Drug Administration 2015.
50.
go back to reference Walsh JC, Teresa C, Michael H, Jim D, Abra MN. An mHealth intervention using a smartphone app to increase walking behavior in young adults: a pilot study. Jmir Mhealth Uhealth. 2016;4(3):e109.CrossRefPubMedPubMedCentral Walsh JC, Teresa C, Michael H, Jim D, Abra MN. An mHealth intervention using a smartphone app to increase walking behavior in young adults: a pilot study. Jmir Mhealth Uhealth. 2016;4(3):e109.CrossRefPubMedPubMedCentral
51.
go back to reference Maher C, Ferguson M, Vandelanotte C, Plotnikoff R, Bourdeaudhuij ID, Thomas S, Nelsonfield K, Olds T. A web-based, social networking physical activity intervention for insufficiently active adults delivered via facebook app: randomized controlled trial. J Med Internet Res. 2015;17(7):e174.CrossRefPubMedPubMedCentral Maher C, Ferguson M, Vandelanotte C, Plotnikoff R, Bourdeaudhuij ID, Thomas S, Nelsonfield K, Olds T. A web-based, social networking physical activity intervention for insufficiently active adults delivered via facebook app: randomized controlled trial. J Med Internet Res. 2015;17(7):e174.CrossRefPubMedPubMedCentral
52.
go back to reference Genugten LV, Dusseldorp E, Webb TL, Empelen PV. Which combinations of techniques and modes of delivery in internet-based interventions effectively change health behavior? A meta-analysis. J Med Internet Res. 2016;18(6):e155.CrossRefPubMedPubMedCentral Genugten LV, Dusseldorp E, Webb TL, Empelen PV. Which combinations of techniques and modes of delivery in internet-based interventions effectively change health behavior? A meta-analysis. J Med Internet Res. 2016;18(6):e155.CrossRefPubMedPubMedCentral
Metadata
Title
Constructing an assessment framework for the quality of asthma smartphone applications
Authors
Zhifang Guan
Liu Sun
Qian Xiao
Yanling Wang
Publication date
01-12-2019
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2019
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/s12911-019-0923-8

Other articles of this Issue 1/2019

BMC Medical Informatics and Decision Making 1/2019 Go to the issue