Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2013

Open Access 01-12-2013 | Research article

The value of usability testing for Internet-based adolescent self-management interventions: “Managing Hemophilia Online”

Authors: Vicky R Breakey, Ashley V Warias, Danial M Ignas, Meghan White, Victor S Blanchette, Jennifer N Stinson

Published in: BMC Medical Informatics and Decision Making | Issue 1/2013

Login to get access

Abstract

Background

As adolescents with hemophilia approach adulthood, they are expected to assume responsibility for their disease management. A bilingual (English and French) Internet-based self-management program, “Teens Taking Charge: Managing Hemophilia Online,” was developed to support adolescents with hemophilia in this transition. This study explored the usability of the website and resulted in refinement of the prototype.

Methods

A purposive sample (n=18; age 13–18; mean age 15.5 years) was recruited from two tertiary care centers to assess the usability of the program in English and French. Qualitative observations using a “think aloud” usability testing method and semi-structured interviews were conducted in four iterative cycles, with changes to the prototype made as necessary following each cycle. This study was approved by research ethics boards at each site.

Results

Teens responded positively to the content and appearance of the website and felt that it was easy to navigate and understand. The multimedia components (videos, animations, quizzes) were felt to enrich the experience. Changes to the presentation of content and the website user-interface were made after the first, second and third cycles of testing in English. Cycle four did not result in any further changes.

Conclusions

Overall, teens found the website to be easy to use. Usability testing identified end-user concerns that informed improvements to the program. Usability testing is a crucial step in the development of Internet-based self-management programs to ensure information is delivered in a manner that is accessible and understood by users.
Appendix
Available only for authorised users
Literature
1.
go back to reference Bolton-Maggs PH, Pasi KJ: Haemophilias A and B. The Lancet. 2003, 361 (9371): 1801-1809. 10.1016/S0140-6736(03)13405-8.CrossRef Bolton-Maggs PH, Pasi KJ: Haemophilias A and B. The Lancet. 2003, 361 (9371): 1801-1809. 10.1016/S0140-6736(03)13405-8.CrossRef
2.
go back to reference Breakey VR, Blanchette VS, Bolton-Maggs PHB: Towards comprehensive care in transition for young people with haemophilia. Haemophilia. 2010, 16 (6): 848-857. 10.1111/j.1365-2516.2010.02249.x.CrossRefPubMed Breakey VR, Blanchette VS, Bolton-Maggs PHB: Towards comprehensive care in transition for young people with haemophilia. Haemophilia. 2010, 16 (6): 848-857. 10.1111/j.1365-2516.2010.02249.x.CrossRefPubMed
3.
go back to reference Lindvall K, Colstrup L, Wollter I, Klemenze G, Loogna K, Grӧnhaug S, et al: Compliance with treatment and understanding of own disease in patients with severe and moderate haemophilia. Haemophilia. 2006, 12 (1): 47-51. 10.1111/j.1365-2516.2006.01192.x.CrossRefPubMed Lindvall K, Colstrup L, Wollter I, Klemenze G, Loogna K, Grӧnhaug S, et al: Compliance with treatment and understanding of own disease in patients with severe and moderate haemophilia. Haemophilia. 2006, 12 (1): 47-51. 10.1111/j.1365-2516.2006.01192.x.CrossRefPubMed
4.
go back to reference Ritterband LM, Gonder-Frederick LA, Cox DJ, Clifton AD, West RW, Borowitz SM: Internet interventions: In review, in use, and into the future. Professional Psychology: Research and Practice. 2003, 34 (5): 527-534.CrossRef Ritterband LM, Gonder-Frederick LA, Cox DJ, Clifton AD, West RW, Borowitz SM: Internet interventions: In review, in use, and into the future. Professional Psychology: Research and Practice. 2003, 34 (5): 527-534.CrossRef
5.
go back to reference Geck C: The generation Z connection: Teaching information literacy to the newest net generation. Teacher Librarian. 2006, 33 (3): 19-23. Geck C: The generation Z connection: Teaching information literacy to the newest net generation. Teacher Librarian. 2006, 33 (3): 19-23.
6.
go back to reference Stinson J, Wilson R, Gill N, Yamada J, Holt J: A systematic review of internet-based self-management interventions for youth with health conditions. J Pediatr Psychol. 2009, 34 (5): 495-510. 10.1093/jpepsy/jsn115.CrossRefPubMed Stinson J, Wilson R, Gill N, Yamada J, Holt J: A systematic review of internet-based self-management interventions for youth with health conditions. J Pediatr Psychol. 2009, 34 (5): 495-510. 10.1093/jpepsy/jsn115.CrossRefPubMed
7.
go back to reference Stinson J, McGrath P, Hodnett E, Feldman B, Duffy C, Huber A, et al: Usability testing of an online self-management program for adolescents with juvenile idiopathic arthritis. J Med Internet Res. 2010, 12 (3): 141-CrossRef Stinson J, McGrath P, Hodnett E, Feldman B, Duffy C, Huber A, et al: Usability testing of an online self-management program for adolescents with juvenile idiopathic arthritis. J Med Internet Res. 2010, 12 (3): 141-CrossRef
8.
go back to reference Jaspers MWM: A comparison of usability methods for testing interactive health technologies: Methodological aspects and empirical evidence. Int J Med Inf. 2009, 78 (5): 340-353. 10.1016/j.ijmedinf.2008.10.002.CrossRef Jaspers MWM: A comparison of usability methods for testing interactive health technologies: Methodological aspects and empirical evidence. Int J Med Inf. 2009, 78 (5): 340-353. 10.1016/j.ijmedinf.2008.10.002.CrossRef
9.
go back to reference Kaufman DR, Patel VL, Hilliman C, Morin PC, Pevzner J, Weinstock RS, et al: Usability in the real world: Assessing medical information technologies in patients’ homes. J Biomed Inform. 2003, 36 (1–2): 45-60.CrossRefPubMed Kaufman DR, Patel VL, Hilliman C, Morin PC, Pevzner J, Weinstock RS, et al: Usability in the real world: Assessing medical information technologies in patients’ homes. J Biomed Inform. 2003, 36 (1–2): 45-60.CrossRefPubMed
10.
go back to reference Yen P, Bakken S: Review of health information technology usability study methodologies. J Am Med Inform Assoc. 2012, 19 (3): 413-422. 10.1136/amiajnl-2010-000020.CrossRefPubMed Yen P, Bakken S: Review of health information technology usability study methodologies. J Am Med Inform Assoc. 2012, 19 (3): 413-422. 10.1136/amiajnl-2010-000020.CrossRefPubMed
11.
go back to reference Breakey V, Ignas D, Denburg A, Blanchette V: The quality and accuracy of hemophilia information on the internet. J Am Soc Hem Annual Meeting Abstracts. 2009, 114 (22): 244- Breakey V, Ignas D, Denburg A, Blanchette V: The quality and accuracy of hemophilia information on the internet. J Am Soc Hem Annual Meeting Abstracts. 2009, 114 (22): 244-
12.
go back to reference Sterling L, Nyhof-Young J, Blanchette V, Breakey V: Growing up with hemophilia: An assessment of teens’ experiences and perceived transition need. UTMJ. 2013, 90 (4): 146-151. Sterling L, Nyhof-Young J, Blanchette V, Breakey V: Growing up with hemophilia: An assessment of teens’ experiences and perceived transition need. UTMJ. 2013, 90 (4): 146-151.
13.
go back to reference Sterling L, Nyhof-Young J, Blanchette V, Breakey V: Exploring internet needs and use among adolescents with haemophilia: A website development project. Haemophilia. 2012, 18 (2): 216-221. 10.1111/j.1365-2516.2011.02613.x.CrossRefPubMed Sterling L, Nyhof-Young J, Blanchette V, Breakey V: Exploring internet needs and use among adolescents with haemophilia: A website development project. Haemophilia. 2012, 18 (2): 216-221. 10.1111/j.1365-2516.2011.02613.x.CrossRefPubMed
14.
go back to reference D’Alessandro DM, Kingsley P, Johnson-West J: The readability of pediatric patient education materials on the world wide web. Arch Pediatr Adolesc Med. 2001, 155 (7): 807-812. 10.1001/archpedi.155.7.807.CrossRefPubMed D’Alessandro DM, Kingsley P, Johnson-West J: The readability of pediatric patient education materials on the world wide web. Arch Pediatr Adolesc Med. 2001, 155 (7): 807-812. 10.1001/archpedi.155.7.807.CrossRefPubMed
15.
go back to reference Ericsson KA, Simon HA: Revised ed. Protocol analysis: Verbal reports as data. 1993, Cambridge: The MIT Press Ericsson KA, Simon HA: Revised ed. Protocol analysis: Verbal reports as data. 1993, Cambridge: The MIT Press
16.
go back to reference Nielsen J, Landauer TK: A mathematical model of the finding of usability problems. Proceedings of the INTERACT '93 and CHI '93 Conference on Human Factors in Computing Systems: 24–29 April 1993. 1993, Amsterdam, Netherlands: Association for Computing Machinery, 206-213.CrossRef Nielsen J, Landauer TK: A mathematical model of the finding of usability problems. Proceedings of the INTERACT '93 and CHI '93 Conference on Human Factors in Computing Systems: 24–29 April 1993. 1993, Amsterdam, Netherlands: Association for Computing Machinery, 206-213.CrossRef
17.
go back to reference Virzi RA: Refining the test phase of usability evaluation: How many subjects is enough?. Hum Factors. 1992, 34 (4): 457-468. Virzi RA: Refining the test phase of usability evaluation: How many subjects is enough?. Hum Factors. 1992, 34 (4): 457-468.
18.
go back to reference Sandelowski M: Whatever happened to qualitative description?. Res Nurs Health. 2000, 23 (4): 334-340. 10.1002/1098-240X(200008)23:4<334::AID-NUR9>3.0.CO;2-G.CrossRefPubMed Sandelowski M: Whatever happened to qualitative description?. Res Nurs Health. 2000, 23 (4): 334-340. 10.1002/1098-240X(200008)23:4<334::AID-NUR9>3.0.CO;2-G.CrossRefPubMed
19.
go back to reference Patton MQ: Qualitative research and evaluation methods. 2002, Thousand Oaks, CA: Sage Publications, 3 Patton MQ: Qualitative research and evaluation methods. 2002, Thousand Oaks, CA: Sage Publications, 3
20.
go back to reference Wichansky AM: Usability testing in 2000 and beyond. Ergonomics. 2000, 43 (7): 998-1006. 10.1080/001401300409170.CrossRefPubMed Wichansky AM: Usability testing in 2000 and beyond. Ergonomics. 2000, 43 (7): 998-1006. 10.1080/001401300409170.CrossRefPubMed
21.
go back to reference Moore M, Bias RG, Prentice K, Fletcher R, Vaughn T: Web usability testing with a hispanic medically underserved population. J Med Libr Assoc. 2009, 97 (2): 114-121. 10.3163/1536-5050.97.2.008.CrossRefPubMedPubMedCentral Moore M, Bias RG, Prentice K, Fletcher R, Vaughn T: Web usability testing with a hispanic medically underserved population. J Med Libr Assoc. 2009, 97 (2): 114-121. 10.3163/1536-5050.97.2.008.CrossRefPubMedPubMedCentral
22.
go back to reference Tucci J, Podrabsky M, Burroughs C, Rakoz L, Stayton C, Egaas K, Harwood R: Connecting youth to quality health information: A lesson plan for high school health and fitness education. 2010, Public Health Nutrition: University of Washington Center for Tucci J, Podrabsky M, Burroughs C, Rakoz L, Stayton C, Egaas K, Harwood R: Connecting youth to quality health information: A lesson plan for high school health and fitness education. 2010, Public Health Nutrition: University of Washington Center for
23.
go back to reference Boren T, Ramey J: Thinking aloud: Reconciling theory and practice. Professional Communication, IEEE Transactions. 2000, 43 (3): 261-278. 10.1109/47.867942.CrossRef Boren T, Ramey J: Thinking aloud: Reconciling theory and practice. Professional Communication, IEEE Transactions. 2000, 43 (3): 261-278. 10.1109/47.867942.CrossRef
Metadata
Title
The value of usability testing for Internet-based adolescent self-management interventions: “Managing Hemophilia Online”
Authors
Vicky R Breakey
Ashley V Warias
Danial M Ignas
Meghan White
Victor S Blanchette
Jennifer N Stinson
Publication date
01-12-2013
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2013
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/1472-6947-13-113

Other articles of this Issue 1/2013

BMC Medical Informatics and Decision Making 1/2013 Go to the issue