Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2015

Open Access 01-12-2015 | Research article

Usefulness scale for patient information material (USE) - development and psychometric properties

Authors: Lars P Hölzel, Zivile Ries, Jörg Dirmaier, Jördis M Zill, Levente Kriston, Christian Klesse, Martin Härter, Isaac Bermejo

Published in: BMC Medical Informatics and Decision Making | Issue 1/2015

Login to get access

Abstract

Background

One economical way to inform patients about their illness and medical procedures is to provide written health information material. So far, a generic and psychometrically sound scale to evaluate cognitive, emotional, and behavioral aspects of the subjectively experienced usefulness of patient information material from the patient’s perspective is lacking. The aim of our study was to develop and psychometrically test such a scale.

Methods

The Usefulness Scale for Patient Information Material (USE) was developed using a multistep approach. Ultimately, three items for each subscale (cognitive, emotional, and behavioral) were selected under consideration of face validity, discrimination, difficulty, and item content.
The final version of the USE was subjected to reliability analysis. Structural validity was tested using confirmatory factor analysis, and convergent and divergent validity were tested using correlation analysis. The criterion validity of the USE was tested in an experimental design. To this aim, patients were randomly allocated to one of two groups. One group received a full version of an information brochure on depression or chronic low back pain depending on the respective primary diagnosis. Patients in the second group received a reduced version with a lower design quality, smaller font size and less information.
Patients were recruited in six hospitals in Germany. After reading the brochure, they were asked to fill in a questionnaire.

Results

Analyzable data were obtained from 120 questionnaires. The confirmatory factor analysis supported the structural validity of the scale. Reliability analysis of the total scale and its subscales showed Cronbach’s α values between .84 and .94. Convergent and divergent validity were supported. Criterion validity was confirmed in the experimental condition. Significant differences between the groups receiving full and reduced information were found for the total score (p<.001) and its three subscales (cognitive p<.001, emotional p=.001, and behavioral p<.001), supporting criterion validity.

Conclusions

We developed a generic scale to measure the subjective usefulness of written patient information material from a patient perspective. Our construct is defined in line with current theoretical models for the evaluation of written patient information material. The USE was shown to be a short, reliable and valid psychometric scale.
Appendix
Available only for authorised users
Literature
1.
go back to reference Bunge M, Mühlhauser I, Steckelberg A. What constitutes evidence-based patient information? Overview of discussed criteria. Patient Education and Counseling. 2010;78:316–28.CrossRefPubMed Bunge M, Mühlhauser I, Steckelberg A. What constitutes evidence-based patient information? Overview of discussed criteria. Patient Education and Counseling. 2010;78:316–28.CrossRefPubMed
2.
go back to reference Charnock D, Shepperd S, Needham G, Gann R. DISCERN: an instrument for judging the quality of written consumer health information on treatment choices. J Epidemiol Community Health. 1999;53:105–11.CrossRefPubMedPubMedCentral Charnock D, Shepperd S, Needham G, Gann R. DISCERN: an instrument for judging the quality of written consumer health information on treatment choices. J Epidemiol Community Health. 1999;53:105–11.CrossRefPubMedPubMedCentral
3.
go back to reference Moult B, Franck LS, Brady H. Ensuring quality information for patients: development and preliminary validation of a new instrument to improve the quality of written health care information. Health Expect. 2004;7:165–75.CrossRefPubMed Moult B, Franck LS, Brady H. Ensuring quality information for patients: development and preliminary validation of a new instrument to improve the quality of written health care information. Health Expect. 2004;7:165–75.CrossRefPubMed
4.
go back to reference Charvet-Berard AI, Chopard P, Perneger TV. Measuring quality of patient information documents with an expanded EQIP scale. Patient Educ Couns. 2008;70:407–11.CrossRefPubMed Charvet-Berard AI, Chopard P, Perneger TV. Measuring quality of patient information documents with an expanded EQIP scale. Patient Educ Couns. 2008;70:407–11.CrossRefPubMed
5.
go back to reference Doak CC, Doak LG, Root JH. Teaching Patients With Low Literacy Skills. Philadelphia: Lippincott Williams and Wilkins; 1985. Doak CC, Doak LG, Root JH. Teaching Patients With Low Literacy Skills. Philadelphia: Lippincott Williams and Wilkins; 1985.
6.
go back to reference Garner M, Ning Z, Francis J. A framework for the evaluation of patient information leaflets. Health Expect. 2012;15:283–94.CrossRefPubMed Garner M, Ning Z, Francis J. A framework for the evaluation of patient information leaflets. Health Expect. 2012;15:283–94.CrossRefPubMed
7.
go back to reference Dixon-Woods M. Writing wrongs? an analysis of published discourses about the use of patient information leaflets. Soc Sci Med. 2001;52:1417–32.CrossRefPubMed Dixon-Woods M. Writing wrongs? an analysis of published discourses about the use of patient information leaflets. Soc Sci Med. 2001;52:1417–32.CrossRefPubMed
8.
go back to reference Bettinghaus EP. Health promotion and the knowledge-attitude-behavior continuum. Prev Med. 1986;15:475–91.CrossRefPubMed Bettinghaus EP. Health promotion and the knowledge-attitude-behavior continuum. Prev Med. 1986;15:475–91.CrossRefPubMed
9.
go back to reference Davis FD. Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly. 1989;13:319–40.CrossRef Davis FD. Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly. 1989;13:319–40.CrossRef
10.
go back to reference Venkatesh V. Determinants of perceived ease of use: integrating control, intrinsic motivation, and emotion into the technology acceptance model. Inform Syst Res. 2000;11:342–65.CrossRef Venkatesh V. Determinants of perceived ease of use: integrating control, intrinsic motivation, and emotion into the technology acceptance model. Inform Syst Res. 2000;11:342–65.CrossRef
11.
go back to reference Slawson DC, Shaughnessy AF, Bennett JH. Becoming a medical information master: feeling good about not knowing everything. J Fam Pract. 1994;38:505–13.PubMed Slawson DC, Shaughnessy AF, Bennett JH. Becoming a medical information master: feeling good about not knowing everything. J Fam Pract. 1994;38:505–13.PubMed
12.
go back to reference Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16:297–334.CrossRef Cronbach LJ. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16:297–334.CrossRef
13.
go back to reference Hölzel LP, Ries Z, Zill JM, Kriston L, Dirmaier J, Härter M, et al. Development and testing of culturally sensitive patient information material for Turkish, Polish, Russian and Italian migrants with depression or chronic low back pain (KULTINFO): study protocol for a double-blind randomized controlled trial. Trials. 2014;15:265.CrossRefPubMedPubMedCentral Hölzel LP, Ries Z, Zill JM, Kriston L, Dirmaier J, Härter M, et al. Development and testing of culturally sensitive patient information material for Turkish, Polish, Russian and Italian migrants with depression or chronic low back pain (KULTINFO): study protocol for a double-blind randomized controlled trial. Trials. 2014;15:265.CrossRefPubMedPubMedCentral
14.
go back to reference Koo MM, Krass I, Aslani P. Evaluation of written medicine information: validation of the consumer information rating form. Ann Pharmacother. 2007;41:951–6.CrossRefPubMed Koo MM, Krass I, Aslani P. Evaluation of written medicine information: validation of the consumer information rating form. Ann Pharmacother. 2007;41:951–6.CrossRefPubMed
15.
go back to reference Pluye P, Granikov V, Bartlett G, Grad RM, Tang DL, Johnson-Lafleur J, et al. Development and Content Validation of the Information Assessment Method for Patients and Consumers. JMIR Res Protoc. 2014;3:e7.CrossRefPubMedPubMedCentral Pluye P, Granikov V, Bartlett G, Grad RM, Tang DL, Johnson-Lafleur J, et al. Development and Content Validation of the Information Assessment Method for Patients and Consumers. JMIR Res Protoc. 2014;3:e7.CrossRefPubMedPubMedCentral
16.
go back to reference Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Modeling J. 1999;6:1–55.CrossRef Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Modeling J. 1999;6:1–55.CrossRef
17.
go back to reference Kriston L, Günzler C, Harms A, Berner M. Confirmatory factor analysis of the german version of the international index of erectile function (iief): a comparison of four models. J Sex Med. 2008;5:92–9.CrossRefPubMed Kriston L, Günzler C, Harms A, Berner M. Confirmatory factor analysis of the german version of the international index of erectile function (iief): a comparison of four models. J Sex Med. 2008;5:92–9.CrossRefPubMed
18.
go back to reference Hair JF, Black WC, Babin BJ, Anderson RE. Multivariate Data Analysis. 7th ed. New Jersey: Prentice Hall; 2009. Hair JF, Black WC, Babin BJ, Anderson RE. Multivariate Data Analysis. 7th ed. New Jersey: Prentice Hall; 2009.
19.
go back to reference Schweizer K. Some guidelines concerning the modeling of traits and abilities in test construction. Eur J Psychol Assess. 2010;26:1–2.CrossRef Schweizer K. Some guidelines concerning the modeling of traits and abilities in test construction. Eur J Psychol Assess. 2010;26:1–2.CrossRef
20.
go back to reference Kline RB. Principles and Practice of Structural Equation Modeling, Third Edition. 3rd ed. New York City: The Guilford Press; 2010. Kline RB. Principles and Practice of Structural Equation Modeling, Third Edition. 3rd ed. New York City: The Guilford Press; 2010.
Metadata
Title
Usefulness scale for patient information material (USE) - development and psychometric properties
Authors
Lars P Hölzel
Zivile Ries
Jörg Dirmaier
Jördis M Zill
Levente Kriston
Christian Klesse
Martin Härter
Isaac Bermejo
Publication date
01-12-2015
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2015
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/s12911-015-0153-7

Other articles of this Issue 1/2015

BMC Medical Informatics and Decision Making 1/2015 Go to the issue