Skip to main content
Top
Published in: BMC Medicine 1/2010

Open Access 01-12-2010 | Research article

Assessment of the quality and variability of health information on chronic pain websites using the DISCERN instrument

Authors: Jatin Kaicker, Victoria Borg Debono, Wilfred Dang, Norman Buckley, Lehana Thabane

Published in: BMC Medicine | Issue 1/2010

Login to get access

Abstract

Background

The Internet is used increasingly by providers as a tool for disseminating pain-related health information and by patients as a resource about health conditions and treatment options. However, health information on the Internet remains unregulated and varies in quality, accuracy and readability. The objective of this study was to determine the quality of pain websites, and explain variability in quality and readability between pain websites.

Methods

Five key terms (pain, chronic pain, back pain, arthritis, and fibromyalgia) were entered into the Google, Yahoo and MSN search engines. Websites were assessed using the DISCERN instrument as a quality index. Grade level readability ratings were assessed using the Flesch-Kincaid Readability Algorithm. Univariate (using alpha = 0.20) and multivariable regression (using alpha = 0.05) analyses were used to explain the variability in DISCERN scores and grade level readability using potential for commercial gain, health related seals of approval, language(s) and multimedia features as independent variables.

Results

A total of 300 websites were assessed, 21 excluded in accordance with the exclusion criteria and 110 duplicate websites, leaving 161 unique sites. About 6.8% (11/161 websites) of the websites offered patients' commercial products for their pain condition, 36.0% (58/161 websites) had a health related seal of approval, 75.8% (122/161 websites) presented information in English only and 40.4% (65/161 websites) offered an interactive multimedia experience. In assessing the quality of the unique websites, of a maximum score of 80, the overall average DISCERN Score was 55.9 (13.6) and readability (grade level) of 10.9 (3.9). The multivariable regressions demonstrated that website seals of approval (P = 0.015) and potential for commercial gain (P = 0.189) were contributing factors to higher DISCERN scores, while seals of approval (P = 0.168) and interactive multimedia (P = 0.244) contributed to lower grade level readability, as indicated by estimates of the beta coefficients.

Conclusion

The overall quality of pain websites is moderate, with some shortcomings. Websites that scored high using the DISCERN questionnaire contained health related seals of approval and provided commercial solutions for pain related conditions while those with low readability levels offered interactive multimedia options and have been endorsed by health seals.
Appendix
Available only for authorised users
Literature
1.
go back to reference Eysenbach G, Powell J, Kuss O, Sa ER: Empirical studies assessing the quality of health information for consumers on the world wide web: a systematic review. JAMA. 2002, 20: 2691-2700. 10.1001/jama.287.20.2691.CrossRef Eysenbach G, Powell J, Kuss O, Sa ER: Empirical studies assessing the quality of health information for consumers on the world wide web: a systematic review. JAMA. 2002, 20: 2691-2700. 10.1001/jama.287.20.2691.CrossRef
3.
go back to reference Cline RJ, Haynes KM: Consumer health information seeking on the Internet: the state of the art. Health Educ Res. 2001, 6: 671-692. 10.1093/her/16.6.671.CrossRef Cline RJ, Haynes KM: Consumer health information seeking on the Internet: the state of the art. Health Educ Res. 2001, 6: 671-692. 10.1093/her/16.6.671.CrossRef
7.
go back to reference Maloney S, Ilic D, Green S: Accessibility, nature and quality of health information on the Internet: a survey on osteoarthritis. Rheumatology. 2005, 3: 382-385. 10.1093/rheumatology/keh498.CrossRef Maloney S, Ilic D, Green S: Accessibility, nature and quality of health information on the Internet: a survey on osteoarthritis. Rheumatology. 2005, 3: 382-385. 10.1093/rheumatology/keh498.CrossRef
9.
go back to reference Moody EM, Clemens KK, Storsley L, Waterman A, Parikh CR, Garg AX, Donor Nephrectomy Outcomes Research (Donor) Network: Improving on-line information for potential living kidney donors. Kidney Int. 2007, 10: 1062-1070. 10.1038/sj.ki.5002168.CrossRef Moody EM, Clemens KK, Storsley L, Waterman A, Parikh CR, Garg AX, Donor Nephrectomy Outcomes Research (Donor) Network: Improving on-line information for potential living kidney donors. Kidney Int. 2007, 10: 1062-1070. 10.1038/sj.ki.5002168.CrossRef
10.
go back to reference Henry JL: The need for knowledge translation in chronic pain. Pain Res Manag. 2008, 6: 465-476.CrossRef Henry JL: The need for knowledge translation in chronic pain. Pain Res Manag. 2008, 6: 465-476.CrossRef
12.
go back to reference Stewart WF, Ricci JA, Chee E, Morganstein D: Lost productive work time costs from health conditions in the United States: results from the American Productivity Audit. J Occup Environ Med. 2003, 12: 1234-1246.CrossRef Stewart WF, Ricci JA, Chee E, Morganstein D: Lost productive work time costs from health conditions in the United States: results from the American Productivity Audit. J Occup Environ Med. 2003, 12: 1234-1246.CrossRef
13.
go back to reference De Boer MJ, Versteegen GJ, van Wijhe M: Patients' use of the Internet for pain-related medical information. Patient Educ Couns. 2007, 1: 86-97. 10.1016/j.pec.2007.05.012.CrossRef De Boer MJ, Versteegen GJ, van Wijhe M: Patients' use of the Internet for pain-related medical information. Patient Educ Couns. 2007, 1: 86-97. 10.1016/j.pec.2007.05.012.CrossRef
14.
go back to reference Corcoran TB, Haigh F, Seabrook A, Schug SA: The quality of internet-sourced information for patients with chronic pain is poor. Clin J Pain. 2009, 25: 617-623. 10.1097/AJP.0b013e3181a5b5d5.CrossRef Corcoran TB, Haigh F, Seabrook A, Schug SA: The quality of internet-sourced information for patients with chronic pain is poor. Clin J Pain. 2009, 25: 617-623. 10.1097/AJP.0b013e3181a5b5d5.CrossRef
15.
go back to reference Khazaal Y, Chatton A, Cochand S, Coquard O, Fernandez S, Khan R, Billieux J, Zullino D: Brief DISCERN, six questions for the evaluation of evidence-based content of health-related websites. Patient Educ Couns. 2009, 1: 33-37. 10.1016/j.pec.2009.02.016.CrossRef Khazaal Y, Chatton A, Cochand S, Coquard O, Fernandez S, Khan R, Billieux J, Zullino D: Brief DISCERN, six questions for the evaluation of evidence-based content of health-related websites. Patient Educ Couns. 2009, 1: 33-37. 10.1016/j.pec.2009.02.016.CrossRef
16.
go back to reference Berland GK, Elliott MN, Morales LS, Algazy JI, Kravitz RL, Broder MS, Kanouse DE, Muñoz JA, Puyol JA, Lara M, Watkins KE, Yang H, McGlynn EA: Health information on the Internet: accessibility, quality, and readability in English and Spanish. JAMA. 2001, 20: 2612-2621. 10.1001/jama.285.20.2612.CrossRef Berland GK, Elliott MN, Morales LS, Algazy JI, Kravitz RL, Broder MS, Kanouse DE, Muñoz JA, Puyol JA, Lara M, Watkins KE, Yang H, McGlynn EA: Health information on the Internet: accessibility, quality, and readability in English and Spanish. JAMA. 2001, 20: 2612-2621. 10.1001/jama.285.20.2612.CrossRef
17.
go back to reference Batchelor JM, Ohya Y: Use of the DISCERN instrument by patients and health professionals to assess information resources on treatments for asthma and atopic dermatitis. Allergol Int. 2009, 1: 141-145. 10.2332/allergolint.08-SC-0022.CrossRef Batchelor JM, Ohya Y: Use of the DISCERN instrument by patients and health professionals to assess information resources on treatments for asthma and atopic dermatitis. Allergol Int. 2009, 1: 141-145. 10.2332/allergolint.08-SC-0022.CrossRef
18.
go back to reference Washington TA, Fanciullo GJ, Sorensen JA, Baird JC: Quality of Chronic Pain Websites. Pain Medicine. 2008, 9: 86-97. 10.1111/j.1526-4637.2008.00419.x.CrossRef Washington TA, Fanciullo GJ, Sorensen JA, Baird JC: Quality of Chronic Pain Websites. Pain Medicine. 2008, 9: 86-97. 10.1111/j.1526-4637.2008.00419.x.CrossRef
20.
go back to reference Flesch R: A new readability yardstick. J Appl Psychol. 1948, 3: 221-233. 10.1037/h0057532.CrossRef Flesch R: A new readability yardstick. J Appl Psychol. 1948, 3: 221-233. 10.1037/h0057532.CrossRef
22.
go back to reference Charnock D: The DISCERN Handbook. 1998, Abingdon, Oxford: Radcliffe Medical Press Charnock D: The DISCERN Handbook. 1998, Abingdon, Oxford: Radcliffe Medical Press
23.
go back to reference Flesch-Kincade : Flesch 2.0 [Software]. 2007 Flesch-Kincade : Flesch 2.0 [Software]. 2007
24.
go back to reference Sim J, Wright CC: The kappa statistic in reliability studies: use, interpretation, and sample size requirements. Phys Ther. 2005, 3: 257-268.CrossRef Sim J, Wright CC: The kappa statistic in reliability studies: use, interpretation, and sample size requirements. Phys Ther. 2005, 3: 257-268.CrossRef
25.
go back to reference MedCalc Software: MedCalc (Version 11.2). 1993 MedCalc Software: MedCalc (Version 11.2). 1993
26.
go back to reference Charnock D, Shepperd S, Needham G, Gann R: DISCERN: an instrument for judging the quality of written consumer health information on treatment choices. J Epidemiol Community Health. 1999, 2: 105-111. 10.1136/jech.53.2.105.CrossRef Charnock D, Shepperd S, Needham G, Gann R: DISCERN: an instrument for judging the quality of written consumer health information on treatment choices. J Epidemiol Community Health. 1999, 2: 105-111. 10.1136/jech.53.2.105.CrossRef
27.
go back to reference Davis TC, Crouch MA, Wills G, Miller S, Abdehou DM: The gap between patient reading comprehension and the readability of patient education materials. J Fam Pract. 1990, 5: 533-538. Davis TC, Crouch MA, Wills G, Miller S, Abdehou DM: The gap between patient reading comprehension and the readability of patient education materials. J Fam Pract. 1990, 5: 533-538.
28.
go back to reference Boyer C, Selby M, Scherrer JR, Appel RD: The Health On the Net Code of Conduct for medical and health Websites. Comput Biol Med. 1998, 5: 603-610. 10.1016/S0010-4825(98)00037-7.CrossRef Boyer C, Selby M, Scherrer JR, Appel RD: The Health On the Net Code of Conduct for medical and health Websites. Comput Biol Med. 1998, 5: 603-610. 10.1016/S0010-4825(98)00037-7.CrossRef
29.
go back to reference Lorence D, Abraham J: A study of undue pain and surfing: using hierarchical criteria to assess website quality. Health Informatics J. 2008, 3: 155-173. 10.1177/1081180X08092827.CrossRef Lorence D, Abraham J: A study of undue pain and surfing: using hierarchical criteria to assess website quality. Health Informatics J. 2008, 3: 155-173. 10.1177/1081180X08092827.CrossRef
30.
go back to reference Greene DL, Appel AJ, Reinert SE, Palumbo MA: Lumbar disc herniation: evaluation of information on the internet. Spine. 2005, 7: 826-829. 10.1097/01.brs.0000157754.98023.cd.CrossRef Greene DL, Appel AJ, Reinert SE, Palumbo MA: Lumbar disc herniation: evaluation of information on the internet. Spine. 2005, 7: 826-829. 10.1097/01.brs.0000157754.98023.cd.CrossRef
31.
go back to reference Li L, Irvin E, Guzman J, Bombardier C: Surfing for back pain patients: the nature and quality of back pain information on the Internet. Spine. 2001, 5: 545-557. 10.1097/00007632-200103010-00020.CrossRef Li L, Irvin E, Guzman J, Bombardier C: Surfing for back pain patients: the nature and quality of back pain information on the Internet. Spine. 2001, 5: 545-557. 10.1097/00007632-200103010-00020.CrossRef
32.
go back to reference Culver M, Chadwick A: Internet information on rheumatoid arthritis: an evaluation. Musculoskeletal Care. 2005, 1: 33-43. 10.1002/msc.24.CrossRef Culver M, Chadwick A: Internet information on rheumatoid arthritis: an evaluation. Musculoskeletal Care. 2005, 1: 33-43. 10.1002/msc.24.CrossRef
33.
34.
go back to reference Bohacek L, Gomez M, Fish JS: An evaluation of internet sites for burn scar management. J Burn Care Rehabil. 2003, 4: 246-251. 10.1097/01.BCR.0000075844.04297.D9.CrossRef Bohacek L, Gomez M, Fish JS: An evaluation of internet sites for burn scar management. J Burn Care Rehabil. 2003, 4: 246-251. 10.1097/01.BCR.0000075844.04297.D9.CrossRef
35.
go back to reference Pandolfini C, Impicciatore P, Bonati M: Parents on the web: risks for quality management of cough in children. Pediatrics. 2000, 1: e1-10.1542/peds.105.1.e1.CrossRef Pandolfini C, Impicciatore P, Bonati M: Parents on the web: risks for quality management of cough in children. Pediatrics. 2000, 1: e1-10.1542/peds.105.1.e1.CrossRef
Metadata
Title
Assessment of the quality and variability of health information on chronic pain websites using the DISCERN instrument
Authors
Jatin Kaicker
Victoria Borg Debono
Wilfred Dang
Norman Buckley
Lehana Thabane
Publication date
01-12-2010
Publisher
BioMed Central
Published in
BMC Medicine / Issue 1/2010
Electronic ISSN: 1741-7015
DOI
https://doi.org/10.1186/1741-7015-8-59

Other articles of this Issue 1/2010

BMC Medicine 1/2010 Go to the issue