Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2010

Open Access 01-12-2010 | Research article

An online network tool for quality information to answer questions about occupational safety and health: usability and applicability

Authors: Martijn DF Rhebergen, Carel TJ Hulshof, Annet F Lenderink, Frank JH van Dijk

Published in: BMC Medical Informatics and Decision Making | Issue 1/2010

Login to get access

Abstract

Background

Common information facilities do not always provide the quality information needed to answer questions on health or health-related issues, such as Occupational Safety and Health (OSH) matters. Barriers may be the accessibility, quantity and readability of information. Online Question & Answer (Q&A) network tools, which link questioners directly to experts can overcome some of these barriers. When designing and testing online tools, assessing the usability and applicability is essential. Therefore, the purpose of this study is to assess the usability and applicability of a new online Q&A network tool for answers on OSH questions.

Methods

We applied a cross-sectional usability test design. Eight occupational health experts and twelve potential questioners from the working population (workers) were purposively selected to include a variety of computer- and internet-experiences. During the test, participants were first observed while executing eight tasks that entailed important features of the tool. In addition, they were interviewed. Through task observations and interviews we assessed applicability, usability (effectiveness, efficiency and satisfaction) and facilitators and barriers in use.

Results

Most features were usable, though several could be improved. Most tasks were executed effectively. Some tasks, for example searching stored questions in categories, were not executed efficiently and participants were less satisfied with the corresponding features. Participants' recommendations led to improvements. The tool was found mostly applicable for additional information, to observe new OSH trends and to improve contact between OSH experts and workers. Hosting and support by a trustworthy professional organization, effective implementation campaigns, timely answering and anonymity were seen as important use requirements.

Conclusions

This network tool is a promising new strategy for offering company workers high quality information to answer OSH questions. Q&A network tools can be an addition to existing information facilities in the field of OSH, but also to other healthcare fields struggling with how to answer questions from people in practice with high quality information. In the near future, we will focus on the use of the tool and its effects on information and knowledge dissemination.
Appendix
Available only for authorised users
Literature
1.
go back to reference Deering MJ, Harris J: Consumer health information demand and delivery: implications for libraries. Bull Med Libr Assoc. 1996, 84: 209-216.PubMedPubMedCentral Deering MJ, Harris J: Consumer health information demand and delivery: implications for libraries. Bull Med Libr Assoc. 1996, 84: 209-216.PubMedPubMedCentral
2.
go back to reference Eysenbach G, Kohler C: Health-related searches on the Internet. JAMA. 2004, 291: 2946-10.1001/jama.291.24.2946.CrossRefPubMed Eysenbach G, Kohler C: Health-related searches on the Internet. JAMA. 2004, 291: 2946-10.1001/jama.291.24.2946.CrossRefPubMed
3.
go back to reference Hoekstra P, van der Laan N: Inventarisatie naar informatiebehoeften over arbeidsomstandigheden. [Inventory of Informational Needs in Occupational Health and Safety]. 2008, Amsterdam, C6403: 1-21. TNS-NIPO. Report Hoekstra P, van der Laan N: Inventarisatie naar informatiebehoeften over arbeidsomstandigheden. [Inventory of Informational Needs in Occupational Health and Safety]. 2008, Amsterdam, C6403: 1-21. TNS-NIPO. Report
4.
go back to reference Hugenholtz NI, Schreinemakers JF, Tjak MA, van Dijk FJ: Knowledge infrastructure needed for occupational health. Ind Health. 2007, 45: 13-18. 10.2486/indhealth.45.13.CrossRefPubMed Hugenholtz NI, Schreinemakers JF, Tjak MA, van Dijk FJ: Knowledge infrastructure needed for occupational health. Ind Health. 2007, 45: 13-18. 10.2486/indhealth.45.13.CrossRefPubMed
5.
go back to reference Hugenholtz NI, Schaafsma FG, Nieuwenhuijsen K, van Dijk FJ: Effect of an EBM course in combination with case method learning sessions: an RCT on professional performance, job satisfaction, and self-efficacy of occupational physicians. Int Arch Occup Environ Health. 2008, 82: 107-115. 10.1007/s00420-008-0315-3.CrossRefPubMedPubMedCentral Hugenholtz NI, Schaafsma FG, Nieuwenhuijsen K, van Dijk FJ: Effect of an EBM course in combination with case method learning sessions: an RCT on professional performance, job satisfaction, and self-efficacy of occupational physicians. Int Arch Occup Environ Health. 2008, 82: 107-115. 10.1007/s00420-008-0315-3.CrossRefPubMedPubMedCentral
6.
go back to reference Schaafsma F, Hugenholtz N, de BA, Smits P, Hulshof C, van Dijk FJ: Enhancing evidence-based advice of occupational health physicians. Scand J Work Environ Health. 2007, 33: 368-378.CrossRefPubMed Schaafsma F, Hugenholtz N, de BA, Smits P, Hulshof C, van Dijk FJ: Enhancing evidence-based advice of occupational health physicians. Scand J Work Environ Health. 2007, 33: 368-378.CrossRefPubMed
7.
go back to reference Eysenbach G, Powell J, Kuss O, Sa ER: Empirical studies assessing the quality of health information for consumers on the world wide web: a systematic review. JAMA. 2002, 287: 2691-2700. 10.1001/jama.287.20.2691.CrossRefPubMed Eysenbach G, Powell J, Kuss O, Sa ER: Empirical studies assessing the quality of health information for consumers on the world wide web: a systematic review. JAMA. 2002, 287: 2691-2700. 10.1001/jama.287.20.2691.CrossRefPubMed
8.
go back to reference Hugenholtz NI, Nieuwenhuijsen K, Sluiter JK, van Dijk FJ: Do knowledge infrastructure facilities support evidence-based practice in occupational health? An exploratory study across countries among occupational physicians enrolled on Evidence-Based Medicine courses. BMC Health Serv Res. 2009, 9: 18-10.1186/1472-6963-9-18.CrossRefPubMedPubMedCentral Hugenholtz NI, Nieuwenhuijsen K, Sluiter JK, van Dijk FJ: Do knowledge infrastructure facilities support evidence-based practice in occupational health? An exploratory study across countries among occupational physicians enrolled on Evidence-Based Medicine courses. BMC Health Serv Res. 2009, 9: 18-10.1186/1472-6963-9-18.CrossRefPubMedPubMedCentral
10.
go back to reference Iske P, Boersma W: Question and answer systems for knowledge sharing: concepts, implementation and return on investement. Journal of knowledge management. 2005, 9: 126-145. 10.1108/13673270510583018.CrossRef Iske P, Boersma W: Question and answer systems for knowledge sharing: concepts, implementation and return on investement. Journal of knowledge management. 2005, 9: 126-145. 10.1108/13673270510583018.CrossRef
11.
go back to reference Ackerman MS, Malone TW: Answer Garden: A tool for Growing Organizational Memory. proceedings of the ACM SIGOIS and IEEE CS TC-OA conference on office information systems: 25-27 April 1990. 1990, Cambridge, MA, USA. ACM, 31-39.CrossRef Ackerman MS, Malone TW: Answer Garden: A tool for Growing Organizational Memory. proceedings of the ACM SIGOIS and IEEE CS TC-OA conference on office information systems: 25-27 April 1990. 1990, Cambridge, MA, USA. ACM, 31-39.CrossRef
12.
go back to reference Pagliari C: Design and evaluation in eHealth: challenges and implications for an interdisciplinary field. J Med Internet Res. 2007, 9: e15-10.2196/jmir.9.2.e15.CrossRefPubMedPubMedCentral Pagliari C: Design and evaluation in eHealth: challenges and implications for an interdisciplinary field. J Med Internet Res. 2007, 9: e15-10.2196/jmir.9.2.e15.CrossRefPubMedPubMedCentral
13.
go back to reference International Organization for Standardization (ISO): Human-centred design processes for interactive systems. 1999, Geneva; International Organization for Standardization. Report ISO 13407 (2004 version), 1-26. International Organization for Standardization (ISO): Human-centred design processes for interactive systems. 1999, Geneva; International Organization for Standardization. Report ISO 13407 (2004 version), 1-26.
14.
go back to reference International Organization for Standardization (ISO): Ergonomics of human-system interaction -- Part 100: Introduction to standards related to software ergonomics. 2009, Geneva; International Organization for Standardization. Report ISO 9241-100 (concept), 1-29. International Organization for Standardization (ISO): Ergonomics of human-system interaction -- Part 100: Introduction to standards related to software ergonomics. 2009, Geneva; International Organization for Standardization. Report ISO 9241-100 (concept), 1-29.
15.
go back to reference Delone WH, McLean ER: The Delone and McLean Model of Information Systems Success: A Ten Year Update. Journal of Management Information Systems. 2003, 19: 9-30. Delone WH, McLean ER: The Delone and McLean Model of Information Systems Success: A Ten Year Update. Journal of Management Information Systems. 2003, 19: 9-30.
16.
go back to reference Flavian C, Guinaliu M, Gurrea R: The role played by perceived usability, satisfaction and consumer trust on website loyalty. Information & Management. 2006, 43: 1-14.CrossRef Flavian C, Guinaliu M, Gurrea R: The role played by perceived usability, satisfaction and consumer trust on website loyalty. Information & Management. 2006, 43: 1-14.CrossRef
17.
go back to reference Virzi RA: Refining the test phase of usability evaluation: How many subjects is enough?. Human Factors. 1992, 34: 457-468. Virzi RA: Refining the test phase of usability evaluation: How many subjects is enough?. Human Factors. 1992, 34: 457-468.
18.
go back to reference Caulton DA: Relaxing the homogeneity assumtion in usability testing. Behaviour and Information Technology. 2001, 20: 1-7. 10.1080/01449290010020648.CrossRef Caulton DA: Relaxing the homogeneity assumtion in usability testing. Behaviour and Information Technology. 2001, 20: 1-7. 10.1080/01449290010020648.CrossRef
19.
go back to reference Nielsen J: Usability Engeneering. 1993, Boston, MA, USA: Academic Press Nielsen J: Usability Engeneering. 1993, Boston, MA, USA: Academic Press
20.
go back to reference van den Haak MJ, de Jong MDT, Schellens J: Retrospective vs concurrent think-aloud protocols: testing the usability of an online library catalogue. Behaviour and Information Technology. 2003, 22: 339-351. 10.1080/0044929031000.CrossRef van den Haak MJ, de Jong MDT, Schellens J: Retrospective vs concurrent think-aloud protocols: testing the usability of an online library catalogue. Behaviour and Information Technology. 2003, 22: 339-351. 10.1080/0044929031000.CrossRef
21.
go back to reference Dumas JS, Redish JC: A Practical Guide to Usability Testing. revised edition ed. Exeter: Intellect. 1999 Dumas JS, Redish JC: A Practical Guide to Usability Testing. revised edition ed. Exeter: Intellect. 1999
22.
go back to reference Sainfort F, Jacko JA, Sears A: Human-computer interaction in health care. The human-Computer Interaction Handbook. Edited by: Sears A, Jacko JA. 2003, London: Earlbaum Associates, 802-822. Sainfort F, Jacko JA, Sears A: Human-computer interaction in health care. The human-Computer Interaction Handbook. Edited by: Sears A, Jacko JA. 2003, London: Earlbaum Associates, 802-822.
23.
go back to reference Denzin NK, Lincoln YS: Handbook of Qualitative Research. 2000, Thousand Oaks, California: Sage Publications Inc Denzin NK, Lincoln YS: Handbook of Qualitative Research. 2000, Thousand Oaks, California: Sage Publications Inc
24.
go back to reference Marco J, Barba R, Losa JE, de la Serna CM, Sainz M, Lantigua IF, de la Serna JL: Advice from a medical expert through the Internet on queries about AIDS and hepatitis: analysis of a pilot experiment. PLoS Med. 2006, 3: e256-10.1371/journal.pmed.0030256.CrossRefPubMedPubMedCentral Marco J, Barba R, Losa JE, de la Serna CM, Sainz M, Lantigua IF, de la Serna JL: Advice from a medical expert through the Internet on queries about AIDS and hepatitis: analysis of a pilot experiment. PLoS Med. 2006, 3: e256-10.1371/journal.pmed.0030256.CrossRefPubMedPubMedCentral
25.
go back to reference Umefjord G, Petersson G, Hamberg K: Reasons for consulting a doctor on the Internet: Web survey of users of an Ask the Doctor service. J Med Internet Res. 2003, 5: e26-10.2196/jmir.5.4.e26.CrossRefPubMedPubMedCentral Umefjord G, Petersson G, Hamberg K: Reasons for consulting a doctor on the Internet: Web survey of users of an Ask the Doctor service. J Med Internet Res. 2003, 5: e26-10.2196/jmir.5.4.e26.CrossRefPubMedPubMedCentral
26.
go back to reference Himmel W, Meyer J, Kochen MM, Michelmann HW: Information needs and visitors' experience of an Internet expert forum on infertility. J Med Internet Res. 2005, 7: e20-10.2196/jmir.7.2.e20.CrossRefPubMedPubMedCentral Himmel W, Meyer J, Kochen MM, Michelmann HW: Information needs and visitors' experience of an Internet expert forum on infertility. J Med Internet Res. 2005, 7: e20-10.2196/jmir.7.2.e20.CrossRefPubMedPubMedCentral
27.
go back to reference Eysenbach G, Diepgen TL: Patients looking for information on the Internet and seeking teleadvice: motivation, expectations, and misconceptions as expressed in e-mails sent to physicians. Arch Dermatol. 1999, 135: 151-156. 10.1001/archderm.135.2.151.CrossRefPubMed Eysenbach G, Diepgen TL: Patients looking for information on the Internet and seeking teleadvice: motivation, expectations, and misconceptions as expressed in e-mails sent to physicians. Arch Dermatol. 1999, 135: 151-156. 10.1001/archderm.135.2.151.CrossRefPubMed
28.
go back to reference Massone C, Soyer HP, Hofmann-Wellenhof R, Di SA, Lozzi GP, Gabler G, Dong H, Argenziano G, Ozdemir F, Fink-Puches R: Two years' experience with Web-based teleconsulting in dermatology. J Telemed Telecare. 2006, 12: 83-87. 10.1258/135763306776084419.CrossRefPubMed Massone C, Soyer HP, Hofmann-Wellenhof R, Di SA, Lozzi GP, Gabler G, Dong H, Argenziano G, Ozdemir F, Fink-Puches R: Two years' experience with Web-based teleconsulting in dermatology. J Telemed Telecare. 2006, 12: 83-87. 10.1258/135763306776084419.CrossRefPubMed
29.
go back to reference Schaafsma F, Verbeek J, Hulshof C, van Dijk FJ: Caution required when relying on a colleague's advice; a comparison between professional advice and evidence from the literature. BMC Health Serv Res. 2005, 5: 59-10.1186/1472-6963-5-59.CrossRefPubMedPubMedCentral Schaafsma F, Verbeek J, Hulshof C, van Dijk FJ: Caution required when relying on a colleague's advice; a comparison between professional advice and evidence from the literature. BMC Health Serv Res. 2005, 5: 59-10.1186/1472-6963-5-59.CrossRefPubMedPubMedCentral
30.
go back to reference Bastien JMC: Usability testing: a review of some methodological and technical aspects of the method. International Journal of Medical Informatics. 2010, 79: e18-23. 10.1016/j.ijmedinf.2008.12.004.CrossRefPubMed Bastien JMC: Usability testing: a review of some methodological and technical aspects of the method. International Journal of Medical Informatics. 2010, 79: e18-23. 10.1016/j.ijmedinf.2008.12.004.CrossRefPubMed
31.
go back to reference Barnum CM: Usability Testing and Research. 2002, New York: Longman Barnum CM: Usability Testing and Research. 2002, New York: Longman
32.
go back to reference Boren MT, Ramey J: Thinking aloud: reconciling theory and practice. IEEE Transactions on Professional Communication. 2000, 43: 261-278. 10.1109/47.867942.CrossRef Boren MT, Ramey J: Thinking aloud: reconciling theory and practice. IEEE Transactions on Professional Communication. 2000, 43: 261-278. 10.1109/47.867942.CrossRef
Metadata
Title
An online network tool for quality information to answer questions about occupational safety and health: usability and applicability
Authors
Martijn DF Rhebergen
Carel TJ Hulshof
Annet F Lenderink
Frank JH van Dijk
Publication date
01-12-2010
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2010
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/1472-6947-10-63

Other articles of this Issue 1/2010

BMC Medical Informatics and Decision Making 1/2010 Go to the issue